-- Logs begin at Tue 2022-03-29 00:56:58 UTC, end at Tue 2022-03-29 04:01:56 UTC. -- Mar 29 01:56:23.214955 n-d-828148-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 29 01:56:23.222478 n-d-828148-1 devstack@n-api.service[87906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 29 01:56:23 2022] *** Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: nodename: n-d-828148-1 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: machine: x86_64 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: clock source: unix Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: pcre jit disabled Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: detected number of CPU cores: 4 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: current working directory: / Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: detected binary path: /usr/bin/uwsgi-core Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: your processes number limit is 47680 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: your memory page size is 4096 bytes Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: detected max file descriptor number: 2048 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: lock engine: pthread robust mutexes Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: thunder lock: enabled Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 29 01:56:23.228615 n-d-828148-1 devstack@n-api.service[87906]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 29 01:56:23.270076 n-d-828148-1 devstack@n-api.service[87906]: Python main interpreter initialized at 0x55eb1744b9c0 Mar 29 01:56:23.270076 n-d-828148-1 devstack@n-api.service[87906]: python threads support enabled Mar 29 01:56:23.270076 n-d-828148-1 devstack@n-api.service[87906]: your server socket listen backlog is limited to 100 connections Mar 29 01:56:23.270076 n-d-828148-1 devstack@n-api.service[87906]: your mercy for graceful operations on workers is 90 seconds Mar 29 01:56:23.270425 n-d-828148-1 devstack@n-api.service[87906]: mapped 403077 bytes (393 KB) for 2 cores Mar 29 01:56:23.270523 n-d-828148-1 devstack@n-api.service[87906]: *** Operational MODE: preforking *** Mar 29 01:56:23.270794 n-d-828148-1 devstack@n-api.service[87906]: *** uWSGI is running in multiple interpreter mode *** Mar 29 01:56:23.270794 n-d-828148-1 devstack@n-api.service[87906]: spawned uWSGI master process (pid: 87906) Mar 29 01:56:23.270987 n-d-828148-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 29 01:56:23.272452 n-d-828148-1 devstack@n-api.service[87906]: spawned uWSGI worker 1 (pid: 87907, cores: 1) Mar 29 01:56:23.272452 n-d-828148-1 devstack@n-api.service[87906]: spawned uWSGI worker 2 (pid: 87908, cores: 1) Mar 29 01:56:23.272452 n-d-828148-1 devstack@n-api.service[87906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 29 01:56:27.304624 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 01:56:27.305417 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 01:56:27.305417 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 01:56:27.305704 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 01:56:27.305898 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 01:56:27.306295 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 01:56:27.306392 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 01:56:27.306481 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.306610 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 01:56:27.306699 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.306950 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.307060 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 01:56:27.307206 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 01:56:27.307301 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.307580 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.307664 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.307888 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.307986 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308203 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308291 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308517 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308601 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308869 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.308967 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309119 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309208 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309430 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309524 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309750 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-828148-1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.309845 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310068 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310161 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310331 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310417 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310642 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310736 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.310963 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-828148-1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311050 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311262 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311360 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311582 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311718 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311882 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.311982 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.312189 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.312372 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.312500 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.313523 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.313659 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.313780 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.313869 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.313869 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314080 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314192 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314281 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314366 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314455 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314544 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314629 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314721 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314806 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.314941 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315086 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315261 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315391 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315567 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315705 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.315882 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-828148-1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316009 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316194 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316327 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316503 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316634 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316812 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.316979 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-828148-1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.317241 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.317351 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.317555 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.317666 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.317861 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.318016 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.318179 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.318273 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319081 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319248 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319392 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319488 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319717 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.319816 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320033 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320126 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320347 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320442 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320662 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320759 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.320990 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321080 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321297 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321393 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321604 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321753 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321910 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.321995 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322211 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322306 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322512 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322600 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322765 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.322880 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323071 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323165 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323388 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323486 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323638 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323744 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.323941 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324037 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324245 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324333 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324494 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324592 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324809 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.324974 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325132 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325218 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325379 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325469 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325693 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.325780 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326008 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326096 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326312 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326400 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326614 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326705 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.326916 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327001 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327218 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327313 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327520 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327606 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327822 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.327917 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328125 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328213 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328427 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328512 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328732 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.328830 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329068 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329153 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329386 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329472 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329690 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329790 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.329993 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330079 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330329 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330421 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330615 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330709 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.330918 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331008 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331249 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331333 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331568 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331654 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331869 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.331954 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332174 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332261 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332480 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332568 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332781 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.332889 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333123 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333233 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333423 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333509 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333672 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333759 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.333993 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334085 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334297 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334392 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334582 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334675 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334880 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.334977 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335182 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335279 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335484 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335575 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335781 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.335881 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336081 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336177 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336383 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336468 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336677 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.336771 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337003 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337090 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337304 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337401 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337601 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337699 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337901 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.337987 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338204 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338288 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338501 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338594 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338802 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.338896 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339103 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339210 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339403 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339520 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339716 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.339810 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340030 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340124 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340331 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340425 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340633 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340719 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.340956 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341046 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341260 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341348 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341578 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341664 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341880 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.341976 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342179 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342267 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342490 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342575 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342789 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.342883 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343152 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343329 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343414 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343500 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343682 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343769 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.343980 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344073 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344289 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344382 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344582 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344677 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344904 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.344993 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345208 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345305 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345509 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345603 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345807 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.345918 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.346103 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.346195 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.346398 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.346489 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.346953 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347046 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347248 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347332 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347542 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347626 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347839 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.347928 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348132 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348221 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348441 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348543 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348739 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.348823 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.349067 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.349153 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.349368 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.349466 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.349691 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.349780 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350003 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 01:56:27.350113 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350329 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350431 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350653 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350739 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.350984 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351071 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351294 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351380 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351599 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351684 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351913 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.351999 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352234 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352321 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352540 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352626 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352862 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.352962 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353179 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353330 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353486 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353572 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353797 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.353884 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354105 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354208 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354419 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354508 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354731 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.354826 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355043 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355130 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355351 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355437 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355663 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355757 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.355976 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356082 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356284 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356372 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356592 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356677 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.356934 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357036 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357252 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357340 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357561 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357657 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357896 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.357992 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358211 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358296 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358522 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358622 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358829 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.358917 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359136 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359231 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359441 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359536 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359749 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.359840 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360055 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360143 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360368 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360463 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360680 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.360776 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361014 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361112 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361335 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361424 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361643 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361731 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.361953 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362048 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362260 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362358 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362567 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362656 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362876 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.362963 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363196 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363283 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363506 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363595 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363815 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.363909 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364122 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364210 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364430 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364516 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364735 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.364830 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.365065 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.365154 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.365907 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.365994 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366213 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366375 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366516 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366604 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366820 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.366913 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367128 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367229 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367431 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367518 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367748 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.367835 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368050 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368144 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368360 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368447 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368669 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368757 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.368996 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369102 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369305 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369392 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369613 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369699 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.369915 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370013 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370225 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370313 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370531 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370616 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370833 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.370922 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371151 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371236 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371457 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371542 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371760 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.371846 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372071 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372160 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372372 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372460 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372673 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.372761 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373003 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373091 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373316 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373400 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373624 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373715 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.373933 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374020 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374253 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374349 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374561 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374658 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374868 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.374955 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375199 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375295 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375529 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375617 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375832 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.375919 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376135 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376235 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376460 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376546 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376773 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.376912 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377102 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377202 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377410 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377498 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377712 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.377799 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378012 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378106 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378312 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378399 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378614 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378707 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378912 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.378999 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379210 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379305 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379510 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379603 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379810 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.379945 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380112 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380208 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380414 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380500 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380718 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.380807 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.381596 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.381736 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.381911 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382001 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382216 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382311 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382550 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382639 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382852 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.382948 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383175 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383260 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383482 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383573 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383785 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.383879 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384091 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384185 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384397 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384534 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384700 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.384797 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385027 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385128 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385337 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385424 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385641 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385735 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.385945 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386032 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386258 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386352 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386559 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386657 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386867 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.386954 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387173 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387266 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387492 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387588 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387795 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.387881 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388102 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388187 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388411 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388500 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388715 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.388862 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389044 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389133 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389352 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389439 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389657 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389751 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.389961 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390049 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390266 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390359 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390568 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390655 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390874 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.390959 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391177 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391264 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391478 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391563 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391783 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.391881 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392086 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392172 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392387 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392478 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392689 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.392785 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393023 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393181 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393342 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393430 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393645 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393740 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.393949 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394038 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394262 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394355 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394567 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394667 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394866 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.394953 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395168 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395253 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395472 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395639 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395771 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.395857 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396075 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396171 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396375 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396482 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396729 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.396869 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397070 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397184 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397370 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397458 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397682 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397767 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.397992 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398086 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398297 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398385 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398609 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398696 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.398916 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399003 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399222 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399310 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399532 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399627 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399841 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.399936 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400148 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400242 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400455 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400542 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400764 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.400918 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401095 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401181 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401402 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401494 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401714 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.401808 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402017 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402104 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402323 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402422 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402632 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402732 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.402932 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.403196 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.403283 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.403527 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.403624 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.403842 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404081 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404168 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404410 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404505 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404725 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.404813 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405065 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405156 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405381 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405469 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405698 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.405792 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406000 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406087 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406308 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406396 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406614 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406710 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.406918 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407039 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407222 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407316 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407523 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407619 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407824 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.407911 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408127 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408223 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408426 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408519 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408725 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.408813 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409050 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409154 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409352 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409445 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409650 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409736 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.409953 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410049 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410253 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410340 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410554 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410642 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410858 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.410953 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411158 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411251 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411467 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411554 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411771 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.411871 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412155 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412245 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412469 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412555 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412773 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.412892 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413103 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413191 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413402 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413489 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413740 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.413829 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414043 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414131 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414376 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414461 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414680 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.414769 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415003 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415091 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415308 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415408 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415608 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415693 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.415913 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416016 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416215 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416300 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416513 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416608 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416817 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.416980 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417145 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417232 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417443 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417529 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417745 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.417831 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418049 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418135 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418348 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418434 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418646 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418735 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.418948 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419082 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419246 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419340 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419545 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419633 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419847 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.419932 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420147 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420248 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420443 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420531 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420747 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.420858 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421076 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421177 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421377 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421465 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421686 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421772 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.421988 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422085 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422287 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422374 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422592 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422710 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422893 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.422994 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423194 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423281 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423493 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423626 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423803 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.423892 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424105 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424193 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424403 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424489 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424702 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.424790 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425028 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425126 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425324 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425409 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425624 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425710 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.425922 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426008 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426218 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426310 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426517 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426612 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426814 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.426908 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.427117 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.427259 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.427417 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.427506 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428222 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428317 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428534 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428631 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428852 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.428978 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429156 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429246 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429458 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429554 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429797 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.429885 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430098 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430185 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430422 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430520 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430736 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.430824 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431043 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431145 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431354 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431453 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431659 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431756 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.431964 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432050 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432277 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432374 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432576 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432663 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432902 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.432991 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433208 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433297 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433518 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433603 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433823 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.433910 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434126 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434215 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434443 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434528 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434750 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.434843 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435060 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435161 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435365 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435450 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435674 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435761 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.435985 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436081 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436286 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436371 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436590 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436675 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.436919 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437021 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437228 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437315 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437535 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437629 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437839 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.437924 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438145 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438230 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438454 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438552 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438759 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.438845 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439066 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439152 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439372 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439470 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439674 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439760 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.439980 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440067 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440286 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440382 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440585 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440670 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.440909 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441001 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441216 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441306 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441516 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441603 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441817 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.441902 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442117 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442239 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442433 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442550 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442737 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.442858 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.443153 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.443243 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444000 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444105 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444310 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444399 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444625 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444714 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.444956 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445055 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445260 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445347 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445572 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445660 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445884 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.445979 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446187 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446284 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446563 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446649 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446868 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.446956 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447171 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447267 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447481 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447569 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447780 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.447873 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448083 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448185 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448383 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448468 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448685 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.448772 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449012 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449115 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449317 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449403 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449617 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449702 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.449936 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450032 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450238 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450326 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450558 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450693 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.450965 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451062 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451277 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451372 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451582 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451670 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451910 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.451997 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452235 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452322 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452558 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452645 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452873 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.452966 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453190 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453277 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453500 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453600 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453820 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.453952 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454130 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454216 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454439 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454542 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454751 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.454837 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455055 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455149 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455363 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455459 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455678 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455773 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.455983 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456073 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456301 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456395 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456617 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456702 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.456970 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.457108 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.457291 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.457558 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.457701 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.457803 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458023 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458113 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458331 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458591 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458717 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458825 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.458976 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459067 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459253 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459355 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459561 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459654 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459869 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.459955 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460174 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460262 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460478 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460565 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460786 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.460905 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461117 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461206 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461419 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461505 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461723 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.461820 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462030 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462115 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462336 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462423 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462639 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462735 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.462950 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463037 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463250 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463336 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463568 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463664 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463868 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.463967 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464184 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464271 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464488 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464646 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464789 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.464904 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465117 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465203 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465422 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465521 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465722 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.465808 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466026 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466113 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466330 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466419 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466668 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466765 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.466973 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467067 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467286 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467388 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467612 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467707 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.467934 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468021 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468239 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468333 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468552 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468641 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468892 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.468985 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469198 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469287 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469504 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469594 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469813 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.469909 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470114 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470200 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470418 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470507 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470719 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.470805 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471020 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471113 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471318 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471414 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471616 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.471966 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472186 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472282 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472488 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472574 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472789 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.472891 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473124 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473225 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473432 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473519 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473734 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.473821 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474038 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474133 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474343 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474431 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474668 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474820 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.474971 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475133 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475275 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475466 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475618 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475785 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.475923 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476108 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476255 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476435 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476572 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476746 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.476914 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477092 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477251 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477486 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477576 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477808 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.477906 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478122 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478219 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478441 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478529 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478758 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.478855 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479069 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479167 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479380 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479476 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479689 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479786 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.479998 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480085 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480306 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480395 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480616 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480713 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.480950 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.481157 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.481266 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.481487 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.481780 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.481876 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482107 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482194 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482426 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482514 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482743 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.482842 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483055 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483143 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483368 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483519 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483677 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483767 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.483986 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484084 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484294 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484390 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484601 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484682 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.484937 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485040 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485264 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485362 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485589 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485677 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.485905 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486000 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486221 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486311 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486536 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486625 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486849 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.486947 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487163 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487253 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487481 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487569 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487805 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.487901 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488124 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488213 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488437 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488525 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488752 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.488901 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489094 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489180 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489412 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489502 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489729 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.489894 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.490042 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.490131 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.490867 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.490959 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491181 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491271 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491496 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491595 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491808 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.491896 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492123 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492219 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492441 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492559 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492771 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.492923 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493136 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493226 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493456 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493592 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493771 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.493869 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.494086 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.494322 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.494423 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.494639 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.494905 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495006 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495225 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495313 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495557 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495644 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495885 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.495982 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496205 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496294 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496522 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496609 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496827 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.496947 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497155 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497246 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497469 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497566 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497773 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.497932 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498075 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498170 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498383 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498471 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498687 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498776 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.498991 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499077 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499304 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499391 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499610 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499699 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.499930 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.500138 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.500236 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.500485 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.500755 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.500884 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501122 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501222 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501441 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501529 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501756 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.501844 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502064 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502153 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502388 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502486 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502693 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.502790 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503002 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503098 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503305 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503401 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503613 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503701 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.503916 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504004 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504221 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504319 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504525 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504612 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504831 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.504951 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505158 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505253 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505465 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505563 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505767 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.505903 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.506634 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.506723 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.506940 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507037 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507245 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507333 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507551 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507647 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507853 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.507948 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508157 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508246 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508461 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508554 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508766 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.508872 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509093 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509181 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509400 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509488 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509702 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.509796 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510012 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510101 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510313 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510401 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510622 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510708 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.510924 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511018 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511229 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511323 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511530 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511623 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511838 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.511942 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512138 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512224 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512445 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512534 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512750 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.512870 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513076 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513164 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513392 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513479 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513713 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.513868 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514010 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514099 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514320 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514517 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514631 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.514836 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.515134 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.515370 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.515459 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.515704 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.515969 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516058 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516303 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516400 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516626 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516720 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.516992 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517084 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517300 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517398 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517606 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517707 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.517921 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518010 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518227 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518315 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518536 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518627 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518846 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.518936 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519155 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519242 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519464 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519559 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519772 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.519858 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520081 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520169 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520389 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520485 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520698 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.520784 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521033 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521122 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521348 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521467 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521683 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521773 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.521997 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522094 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522306 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522394 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522624 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522712 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.522956 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523051 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523272 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523360 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523586 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523678 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523895 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.523983 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524209 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524297 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524515 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524601 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524823 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.524944 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525155 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525243 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525465 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525553 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525779 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.525879 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526086 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526175 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526400 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526488 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526705 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.526802 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527100 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527187 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527411 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527505 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527718 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.527881 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528040 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528129 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528351 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528441 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528679 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.528768 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529023 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529112 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529328 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529417 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529634 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529736 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.529938 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530026 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530242 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530328 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530546 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530636 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530856 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.530944 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531194 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531287 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531513 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531603 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531828 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.531923 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532144 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532245 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532462 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532552 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532775 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.532889 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533114 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533213 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533429 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533519 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533744 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.533832 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534058 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534155 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534376 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534463 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534688 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.534787 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535004 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535099 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535315 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535409 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535635 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535730 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.535936 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536038 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536252 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536341 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536555 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536642 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536888 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.536980 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537224 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537314 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537544 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537640 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537863 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.537951 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538176 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538263 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538494 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538589 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538803 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.538891 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539120 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539214 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539428 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539522 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539747 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.539835 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540058 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540147 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540373 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540460 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540685 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.540775 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541018 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541107 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541330 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541428 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541639 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541727 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.541948 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542036 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542261 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542358 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542576 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542665 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542888 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.542984 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543189 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543291 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543514 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543603 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543820 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.543906 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544138 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544234 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544453 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544540 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544762 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.544873 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545103 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545192 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545410 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545498 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545724 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.545812 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546033 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546121 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546341 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546427 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546648 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546744 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.546957 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547047 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547271 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547360 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547584 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547681 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547901 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.547988 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548222 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548308 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548542 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548638 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548880 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.548972 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.549223 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.549310 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.549535 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.549636 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.549779 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 01:56:27.549866 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.550187 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 01:56:27.550428 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 01:56:27.583155 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_db.sqlalchemy.engines [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.583789 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_db.sqlalchemy.engines [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.825107 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.context [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=87908) load_cells /opt/stack/nova/nova/context.py:464}} Mar 29 01:56:27.825746 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.context [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=87907) load_cells /opt/stack/nova/nova/context.py:464}} Mar 29 01:56:27.829286 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_concurrency.lockutils [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 01:56:27.829893 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 01:56:27.830883 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_concurrency.lockutils [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 01:56:27.831494 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 01:56:27.831664 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_concurrency.lockutils [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 01:56:27.832275 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 01:56:27.833698 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_concurrency.lockutils [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 01:56:27.834282 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 01:56:27.859884 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_db.sqlalchemy.engines [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.863776 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_db.sqlalchemy.engines [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.869704 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_db.sqlalchemy.engines [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.870410 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_db.sqlalchemy.engines [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.896927 n-d-828148-1 devstack@n-api.service[87908]: DEBUG oslo_db.sqlalchemy.engines [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:27.898152 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_db.sqlalchemy.engines [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 01:56:28.157510 n-d-828148-1 devstack@n-api.service[87908]: INFO keyring.backend [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Loading KWallet Mar 29 01:56:28.173295 n-d-828148-1 devstack@n-api.service[87907]: INFO keyring.backend [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Loading KWallet Mar 29 01:56:28.262057 n-d-828148-1 devstack@n-api.service[87908]: INFO keyring.backend [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Loading SecretService Mar 29 01:56:28.265602 n-d-828148-1 devstack@n-api.service[87908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 01:56:28.265602 n-d-828148-1 devstack@n-api.service[87908]: from cryptography.utils import int_from_bytes Mar 29 01:56:28.265915 n-d-828148-1 devstack@n-api.service[87908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 01:56:28.265915 n-d-828148-1 devstack@n-api.service[87908]: from cryptography.utils import int_from_bytes Mar 29 01:56:28.266645 n-d-828148-1 devstack@n-api.service[87908]: INFO keyring.backend [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Loading Windows Mar 29 01:56:28.268488 n-d-828148-1 devstack@n-api.service[87908]: INFO keyring.backend [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Loading chainer Mar 29 01:56:28.269298 n-d-828148-1 devstack@n-api.service[87908]: INFO keyring.backend [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Loading macOS Mar 29 01:56:28.276435 n-d-828148-1 devstack@n-api.service[87907]: INFO keyring.backend [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Loading SecretService Mar 29 01:56:28.279926 n-d-828148-1 devstack@n-api.service[87907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 01:56:28.279926 n-d-828148-1 devstack@n-api.service[87907]: from cryptography.utils import int_from_bytes Mar 29 01:56:28.280241 n-d-828148-1 devstack@n-api.service[87907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 01:56:28.280241 n-d-828148-1 devstack@n-api.service[87907]: from cryptography.utils import int_from_bytes Mar 29 01:56:28.280987 n-d-828148-1 devstack@n-api.service[87907]: INFO keyring.backend [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Loading Windows Mar 29 01:56:28.282810 n-d-828148-1 devstack@n-api.service[87907]: INFO keyring.backend [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Loading chainer Mar 29 01:56:28.283596 n-d-828148-1 devstack@n-api.service[87907]: INFO keyring.backend [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Loading macOS Mar 29 01:56:28.516758 n-d-828148-1 devstack@n-api.service[87908]: WARNING keystonemiddleware.auth_token [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 01:56:28.523892 n-d-828148-1 devstack@n-api.service[87908]: WARNING keystonemiddleware.auth_token [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 01:56:28.531690 n-d-828148-1 devstack@n-api.service[87907]: WARNING keystonemiddleware.auth_token [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 01:56:28.538303 n-d-828148-1 devstack@n-api.service[87907]: WARNING keystonemiddleware.auth_token [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 01:56:28.730874 n-d-828148-1 devstack@n-api.service[87908]: WARNING keystonemiddleware.auth_token [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 01:56:28.735948 n-d-828148-1 devstack@n-api.service[87908]: WARNING keystonemiddleware.auth_token [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 01:56:28.742083 n-d-828148-1 devstack@n-api.service[87908]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eb1744b9c0 pid: 87908 (default app) Mar 29 01:56:28.744137 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:56:28.745255 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001624 Mar 29 01:56:28.745659 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Mar 29 01:56:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:56:28.753990 n-d-828148-1 devstack@n-api.service[87907]: WARNING keystonemiddleware.auth_token [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 01:56:28.760506 n-d-828148-1 devstack@n-api.service[87907]: WARNING keystonemiddleware.auth_token [None req-06b91a67-15ee-4453-b753-bd59867b6a5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 01:56:28.767869 n-d-828148-1 devstack@n-api.service[87907]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55eb1744b9c0 pid: 87907 (default app) Mar 29 01:57:50.706209 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:57:50.707207 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 29 01:57:50.707666 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:57:51.249944 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-9dab83fc-eb9d-4656-801e-fd3bfc8e825c admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:57:51.275267 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-9dab83fc-eb9d-4656-801e-fd3bfc8e825c admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.560926 Mar 29 01:57:51.275794 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 01:57:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:57:53.411838 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:57:53.412829 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-c81dcb81-ebe4-42da-833a-461ba30e212e None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Mar 29 01:57:53.413249 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:57:53.469561 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-ed14f013-705b-433d-a05a-80f14105b8c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:53.487525 n-d-828148-1 devstack@n-api.service[87907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 01:57:53.487525 n-d-828148-1 devstack@n-api.service[87907]: warnings.warn(msg) Mar 29 01:57:53.570338 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-ed14f013-705b-433d-a05a-80f14105b8c2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.150860 Mar 29 01:57:53.570893 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:57:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:57:53.898909 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-e5b746bf-ab2b-43ef-bb6a-1a5eb67eee18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:53.901252 n-d-828148-1 devstack@n-api.service[87908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 01:57:53.901252 n-d-828148-1 devstack@n-api.service[87908]: warnings.warn(msg) Mar 29 01:57:53.978589 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-e5b746bf-ab2b-43ef-bb6a-1a5eb67eee18 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.399787 Mar 29 01:57:53.979103 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Mar 29 01:57:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:57:56.107651 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-ed14f013-705b-433d-a05a-80f14105b8c2 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:57:56.108688 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-ed14f013-705b-433d-a05a-80f14105b8c2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Mar 29 01:57:56.109131 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:57:56.213355 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-47e5ba0d-286f-44e7-811f-7ac3065c9b60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 5, "id": "d1"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:56.230816 n-d-828148-1 devstack@n-api.service[87908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 01:57:56.230816 n-d-828148-1 devstack@n-api.service[87908]: warnings.warn(msg) Mar 29 01:57:56.321830 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-47e5ba0d-286f-44e7-811f-7ac3065c9b60 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.206238 Mar 29 01:57:56.322370 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:57:56.334547 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-c90b6ca1-5e40-42f9-96d0-ab35d4a2f41f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:56.336071 n-d-828148-1 devstack@n-api.service[87907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 01:57:56.336071 n-d-828148-1 devstack@n-api.service[87907]: warnings.warn(msg) Mar 29 01:57:56.421297 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-c90b6ca1-5e40-42f9-96d0-ab35d4a2f41f admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090522 Mar 29 01:57:56.421859 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Mar 29 01:57:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:57:58.578455 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-47e5ba0d-286f-44e7-811f-7ac3065c9b60 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:57:58.579452 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-47e5ba0d-286f-44e7-811f-7ac3065c9b60 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Mar 29 01:57:58.579871 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:57:58.639972 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-b3af1c5c-5886-474c-86e2-d48aecf1295d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "vcpus": 1}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:58.739196 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-b3af1c5c-5886-474c-86e2-d48aecf1295d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153190 Mar 29 01:57:58.739746 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:57:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:57:58.751118 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-4fd42c40-6820-4873-8692-ef08351b5a42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:57:58.872194 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-4fd42c40-6820-4873-8692-ef08351b5a42 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124644 Mar 29 01:57:58.872821 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Mar 29 01:57:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:01.027222 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-b3af1c5c-5886-474c-86e2-d48aecf1295d admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:01.028218 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-b3af1c5c-5886-474c-86e2-d48aecf1295d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 29 01:58:01.028626 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:01.084478 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-0f53f175-d5cc-40bb-8b7f-5ce63b5dc1ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "name": "ds2G", "vcpus": 2, "id": "d3", "swap": 0}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:01.188347 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-0f53f175-d5cc-40bb-8b7f-5ce63b5dc1ab admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153652 Mar 29 01:58:01.189539 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:58:01.200996 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-2bc69449-a5c4-4db0-86e4-53e01fb6a56d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:01.283268 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-2bc69449-a5c4-4db0-86e4-53e01fb6a56d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085824 Mar 29 01:58:01.283747 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Mar 29 01:58:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:03.432536 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-0f53f175-d5cc-40bb-8b7f-5ce63b5dc1ab admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:03.433558 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-0f53f175-d5cc-40bb-8b7f-5ce63b5dc1ab admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Mar 29 01:58:03.433954 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:03.489458 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "id": "d4", "swap": 0, "name": "ds4G"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:03.589241 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149315 Mar 29 01:58:03.589787 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:58:03.602136 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-0b0d2f90-9b70-4eb7-8529-587217bc9bbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:03.696457 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-0b0d2f90-9b70-4eb7-8529-587217bc9bbb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097836 Mar 29 01:58:03.697070 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Mar 29 01:58:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:05.810177 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:05.811290 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Mar 29 01:58:05.811741 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:05.869172 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-d59b66f9-8bcf-4a10-8c9d-4c3996876af7 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:05.889798 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-d59b66f9-8bcf-4a10-8c9d-4c3996876af7 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.071291 Mar 29 01:58:05.890323 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 01:58:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:58:08.024257 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:08.025296 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-3ed9db17-67cd-47a2-8cd6-3b61ed3d697b admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Mar 29 01:58:08.025701 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:08.081250 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-38c5ae4c-542d-4ac8-ae79-1cdaf3cc30ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:08.172743 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-38c5ae4c-542d-4ac8-ae79-1cdaf3cc30ed admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.141212 Mar 29 01:58:08.173308 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:58:08.184806 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-2fde7238-926c-4d87-aa61-e4aa15c4e4e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:08.278243 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-2fde7238-926c-4d87-aa61-e4aa15c4e4e0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096989 Mar 29 01:58:08.278737 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Mar 29 01:58:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:10.445502 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-38c5ae4c-542d-4ac8-ae79-1cdaf3cc30ed admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:10.446485 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-38c5ae4c-542d-4ac8-ae79-1cdaf3cc30ed admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Mar 29 01:58:10.446873 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:10.502080 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-07124655-2006-429a-8b6e-e95966048948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 20}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:10.588330 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-07124655-2006-429a-8b6e-e95966048948 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135364 Mar 29 01:58:10.588921 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:58:10.601194 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-9a270222-4af2-4ac8-a3d3-85de4cc96f8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:10.694661 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-9a270222-4af2-4ac8-a3d3-85de4cc96f8e admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097028 Mar 29 01:58:10.695232 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Mar 29 01:58:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:12.840909 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-07124655-2006-429a-8b6e-e95966048948 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:12.841938 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-07124655-2006-429a-8b6e-e95966048948 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Mar 29 01:58:12.842337 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:12.898789 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-2e25203e-079e-4b05-a1d6-56183c8d9ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "disk": 40, "id": "3", "swap": 0, "vcpus": 2}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:12.977417 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-2e25203e-079e-4b05-a1d6-56183c8d9ca7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128410 Mar 29 01:58:12.977901 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:58:12.990169 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-8cc75cda-9ab4-4069-a165-ebdfa4459024 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:13.076949 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-8cc75cda-9ab4-4069-a165-ebdfa4459024 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090925 Mar 29 01:58:13.077500 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Mar 29 01:58:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:15.258756 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-2e25203e-079e-4b05-a1d6-56183c8d9ca7 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:15.259826 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-2e25203e-079e-4b05-a1d6-56183c8d9ca7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Mar 29 01:58:15.260343 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:15.315713 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-e8fd8e9b-2bcb-4fe0-8201-2cb28c91df53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:15.405425 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-e8fd8e9b-2bcb-4fe0-8201-2cb28c91df53 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139191 Mar 29 01:58:15.405967 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:58:15.417654 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-5b85e8e7-2867-4a69-9cac-c1c7559c2ca2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:15.506219 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-5b85e8e7-2867-4a69-9cac-c1c7559c2ca2 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092141 Mar 29 01:58:15.506710 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Mar 29 01:58:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:58:17.675103 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-e8fd8e9b-2bcb-4fe0-8201-2cb28c91df53 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:58:17.676160 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-e8fd8e9b-2bcb-4fe0-8201-2cb28c91df53 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Mar 29 01:58:17.676566 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:58:17.731962 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:17.822684 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.140233 Mar 29 01:58:17.823214 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Mar 29 01:58:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:58:17.835175 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-22598ecc-c5c2-4fcd-b656-6e34faaa262d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:58:17.958509 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-22598ecc-c5c2-4fcd-b656-6e34faaa262d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126954 Mar 29 01:58:17.959095 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Mar 29 01:58:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 01:59:29.525408 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:29.526393 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Mar 29 01:59:29.526783 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue Mar 29 01:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:29.583080 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-0deda699-4a53-4809-9313-da91ca105915 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:29.606419 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-0deda699-4a53-4809-9313-da91ca105915 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073362 Mar 29 01:59:29.606944 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 01:59:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:59:31.020765 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:31.021819 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-8c540f63-a8a3-499c-bca2-9be374f4b7f4 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Mar 29 01:59:31.022219 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:31.207674 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-0dc80c9d-d339-4fed-9589-0888df106054 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:31.220130 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.wsgi [None req-0dc80c9d-d339-4fed-9589-0888df106054 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 29 01:59:31.220705 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-0dc80c9d-d339-4fed-9589-0888df106054 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:31.221524 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-0dc80c9d-d339-4fed-9589-0888df106054 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.063632 Mar 29 01:59:31.222035 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 01:59:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:31.232129 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-242d70c2-e32c-4e00-81c1-555f41c65a69 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:31.252542 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-242d70c2-e32c-4e00-81c1-555f41c65a69 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024493 Mar 29 01:59:31.253102 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:59:31.262680 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-acefa874-f06c-4701-a00e-72d52d7431e2 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:31.282863 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-acefa874-f06c-4701-a00e-72d52d7431e2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023687 Mar 29 01:59:31.286750 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 01:59:31.292442 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-b9ef7e89-8c37-438e-896d-efe3cb0958a2 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:31.305130 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.wsgi [None req-b9ef7e89-8c37-438e-896d-efe3cb0958a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 29 01:59:31.305709 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-b9ef7e89-8c37-438e-896d-efe3cb0958a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:31.306498 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-b9ef7e89-8c37-438e-896d-efe3cb0958a2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017554 Mar 29 01:59:31.306994 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 01:59:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:32.666540 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-acefa874-f06c-4701-a00e-72d52d7431e2 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:32.667538 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-acefa874-f06c-4701-a00e-72d52d7431e2 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Mar 29 01:59:32.667940 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:32.854403 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-d4f52ce6-b055-4f28-ba7c-ee38e7f78efb admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:32.866431 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.wsgi [None req-d4f52ce6-b055-4f28-ba7c-ee38e7f78efb admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 29 01:59:32.866988 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-d4f52ce6-b055-4f28-ba7c-ee38e7f78efb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:32.867764 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-d4f52ce6-b055-4f28-ba7c-ee38e7f78efb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063687 Mar 29 01:59:32.868268 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 01:59:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:32.878453 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-9837ecf5-b921-4898-bab9-bff42127d239 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:32.898788 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-9837ecf5-b921-4898-bab9-bff42127d239 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023986 Mar 29 01:59:32.899315 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:59:32.908774 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-a3af69b7-ecc2-4cc3-9631-b97fcc7c720a admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:32.928170 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-a3af69b7-ecc2-4cc3-9631-b97fcc7c720a admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022871 Mar 29 01:59:32.928701 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:59:32.938359 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-03e1d975-d676-45b5-9f18-3e27d92f6e02 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:32.950630 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.wsgi [None req-03e1d975-d676-45b5-9f18-3e27d92f6e02 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 29 01:59:32.951200 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-03e1d975-d676-45b5-9f18-3e27d92f6e02 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:32.952569 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-03e1d975-d676-45b5-9f18-3e27d92f6e02 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017817 Mar 29 01:59:32.953091 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 01:59:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:34.303140 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-a3af69b7-ecc2-4cc3-9631-b97fcc7c720a admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:34.304165 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-a3af69b7-ecc2-4cc3-9631-b97fcc7c720a admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Mar 29 01:59:34.304562 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:34.489659 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-1573cafb-6d9e-4751-ac0f-f18eb1e4688d admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:34.502241 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.wsgi [None req-1573cafb-6d9e-4751-ac0f-f18eb1e4688d admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 29 01:59:34.502807 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-1573cafb-6d9e-4751-ac0f-f18eb1e4688d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:34.503599 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-1573cafb-6d9e-4751-ac0f-f18eb1e4688d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.062468 Mar 29 01:59:34.504101 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 01:59:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:34.513517 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-0e8242a2-9b22-4079-8b77-5acfa0fbae43 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:34.533824 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-0e8242a2-9b22-4079-8b77-5acfa0fbae43 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023808 Mar 29 01:59:34.534383 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 01:59:34.543674 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:34.563745 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023478 Mar 29 01:59:34.564264 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 01:59:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 01:59:34.573435 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-1d751914-133c-4dcd-9947-739d1411a0de admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:34.586484 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.wsgi [None req-1d751914-133c-4dcd-9947-739d1411a0de admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 29 01:59:34.587038 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-1d751914-133c-4dcd-9947-739d1411a0de admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 01:59:34.587818 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-1d751914-133c-4dcd-9947-739d1411a0de admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017958 Mar 29 01:59:34.588328 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 01:59:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 29 01:59:35.923852 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:35.924883 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Mar 29 01:59:35.925358 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:36.111006 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-3f93be5c-b7a1-4f8d-9c7b-aa29548ed8d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:59:36.183966 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-3f93be5c-b7a1-4f8d-9c7b-aa29548ed8d3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.122594 Mar 29 01:59:36.184501 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Mar 29 01:59:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:59:37.534952 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:37.535983 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Mar 29 01:59:37.536385 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 01:59:37.724201 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-3e538eae-c8a5-4f19-84db-cb6218147373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:59:37.803604 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-3e538eae-c8a5-4f19-84db-cb6218147373 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.128726 Mar 29 01:59:37.804053 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Mar 29 01:59:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:59:39.148414 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:39.149485 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Mar 29 01:59:39.149878 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:39.338213 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-401e13ea-3542-4bb4-bdc9-c49d4e361a7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:59:39.458802 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-401e13ea-3542-4bb4-bdc9-c49d4e361a7a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.169882 Mar 29 01:59:39.459269 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Mar 29 01:59:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 01:59:40.810797 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:40.811853 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Mar 29 01:59:40.812261 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:40.999750 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-c2d606c5-ce8d-49d2-8b75-2428db99a07b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 01:59:41.108720 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-c2d606c5-ce8d-49d2-8b75-2428db99a07b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.159514 Mar 29 01:59:41.109289 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Mar 29 01:59:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 01:59:42.449500 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:42.450484 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Mar 29 01:59:42.450881 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 01:59:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 01:59:42.636826 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-7bad8765-e353-4144-970a-25233c5ee0b5 admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 01:59:42.662414 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-7bad8765-e353-4144-970a-25233c5ee0b5 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076776 Mar 29 01:59:42.662892 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Mar 29 01:59:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:00:22.953956 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:00:22.954943 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-50918c18-ebea-4f3c-aa3f-7d51345965fe admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001395 Mar 29 02:00:22.955337 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 31/63] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 02:00:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:00:23.140300 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:00:23.165619 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.076051 Mar 29 02:00:23.166165 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Mar 29 02:00:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:02:30.538896 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-2e8c980a-939e-4773-a9d6-7bd842c17849 tempest-verify_tempest_config-1133149441 tempest-verify_tempest_config-1133149441-project] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:02:30.540811 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-2e8c980a-939e-4773-a9d6-7bd842c17849 tempest-verify_tempest_config-1133149441 tempest-verify_tempest_config-1133149441-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.112601 Mar 29 02:02:30.541365 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Mar 29 02:02:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:06:17.878354 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:06:17.879981 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Mar 29 02:06:17.880384 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 34/66] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 02:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:06:18.131995 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:06:18.133203 n-d-828148-1 devstack@n-api.service[87907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:06:18.133203 n-d-828148-1 devstack@n-api.service[87907]: warnings.warn(msg) Mar 29 02:06:18.134729 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:06:18.135172 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:06:18.135962 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:06:18.136389 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:06:18.174052 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-31209006-7135-4338-a610-2440972fbcd2 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.88 time: 0.158348 Mar 29 02:06:18.174599 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:06:18 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:06:19.530235 n-d-828148-1 devstack@n-api.service[87908]: DEBUG nova.api.openstack.wsgi [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] Calling method '>' {{(pid=87908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:06:19.531229 n-d-828148-1 devstack@n-api.service[87908]: INFO nova.api.openstack.requestlog [None req-7cacabb5-ba10-45a7-82e6-51d8604832fb admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Mar 29 02:06:19.531672 n-d-828148-1 devstack@n-api.service[87908]: [pid: 87908|app: 0|req: 35/68] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Mar 29 02:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:06:19.720336 n-d-828148-1 devstack@n-api.service[87907]: DEBUG nova.api.openstack.wsgi [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] Calling method '>' {{(pid=87907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:06:19.721536 n-d-828148-1 devstack@n-api.service[87907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:06:19.721536 n-d-828148-1 devstack@n-api.service[87907]: warnings.warn(msg) Mar 29 02:06:19.723623 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:06:19.724061 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:06:19.724926 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:06:19.725351 n-d-828148-1 devstack@n-api.service[87907]: DEBUG oslo_concurrency.lockutils [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:06:19.751669 n-d-828148-1 devstack@n-api.service[87907]: INFO nova.api.openstack.requestlog [None req-bce51d15-9e98-4c38-942d-2f1c7f6505a9 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.88 time: 0.081332 Mar 29 02:06:19.752145 n-d-828148-1 devstack@n-api.service[87907]: [pid: 87907|app: 0|req: 34/69] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:06:19 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:07:06.295469 n-d-828148-1 devstack@n-api.service[87906]: Tue Mar 29 02:07:06 2022 - graceful shutdown triggered... Mar 29 02:07:06.295238 n-d-828148-1 systemd[1]: Stopping Devstack devstack@n-api.service... Mar 29 02:07:06.296419 n-d-828148-1 devstack@n-api.service[87908]: Gracefully killing worker 2 (pid: 87908)... Mar 29 02:07:06.296791 n-d-828148-1 devstack@n-api.service[87907]: Gracefully killing worker 1 (pid: 87907)... Mar 29 02:07:07.296243 n-d-828148-1 devstack@n-api.service[87906]: worker 1 buried after 1 seconds Mar 29 02:07:07.296243 n-d-828148-1 devstack@n-api.service[87906]: worker 2 buried after 1 seconds Mar 29 02:07:07.296243 n-d-828148-1 devstack@n-api.service[87906]: goodbye to uWSGI. Mar 29 02:07:07.297913 n-d-828148-1 systemd[1]: devstack@n-api.service: Succeeded. Mar 29 02:07:07.298492 n-d-828148-1 systemd[1]: Stopped Devstack devstack@n-api.service. Mar 29 02:07:07.302061 n-d-828148-1 systemd[1]: Starting Devstack devstack@n-api.service... Mar 29 02:07:07.312399 n-d-828148-1 devstack@n-api.service[103504]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 29 02:07:07.315043 n-d-828148-1 devstack@n-api.service[103504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 29 02:07:07 2022] *** Mar 29 02:07:07.315198 n-d-828148-1 devstack@n-api.service[103504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 29 02:07:07.315334 n-d-828148-1 devstack@n-api.service[103504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 29 02:07:07.315457 n-d-828148-1 devstack@n-api.service[103504]: nodename: n-d-828148-1 Mar 29 02:07:07.315568 n-d-828148-1 devstack@n-api.service[103504]: machine: x86_64 Mar 29 02:07:07.315676 n-d-828148-1 devstack@n-api.service[103504]: clock source: unix Mar 29 02:07:07.315784 n-d-828148-1 devstack@n-api.service[103504]: pcre jit disabled Mar 29 02:07:07.315892 n-d-828148-1 devstack@n-api.service[103504]: detected number of CPU cores: 4 Mar 29 02:07:07.316007 n-d-828148-1 devstack@n-api.service[103504]: current working directory: / Mar 29 02:07:07.316141 n-d-828148-1 devstack@n-api.service[103504]: detected binary path: /usr/bin/uwsgi-core Mar 29 02:07:07.316141 n-d-828148-1 devstack@n-api.service[103504]: your processes number limit is 47680 Mar 29 02:07:07.316141 n-d-828148-1 devstack@n-api.service[103504]: your memory page size is 4096 bytes Mar 29 02:07:07.316141 n-d-828148-1 devstack@n-api.service[103504]: detected max file descriptor number: 2048 Mar 29 02:07:07.316141 n-d-828148-1 devstack@n-api.service[103504]: lock engine: pthread robust mutexes Mar 29 02:07:07.316559 n-d-828148-1 devstack@n-api.service[103504]: thunder lock: enabled Mar 29 02:07:07.316559 n-d-828148-1 devstack@n-api.service[103504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 29 02:07:07.316559 n-d-828148-1 devstack@n-api.service[103504]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 29 02:07:07.360203 n-d-828148-1 devstack@n-api.service[103504]: Python main interpreter initialized at 0x5622e643f9c0 Mar 29 02:07:07.360203 n-d-828148-1 devstack@n-api.service[103504]: python threads support enabled Mar 29 02:07:07.360203 n-d-828148-1 devstack@n-api.service[103504]: your server socket listen backlog is limited to 100 connections Mar 29 02:07:07.360203 n-d-828148-1 devstack@n-api.service[103504]: your mercy for graceful operations on workers is 90 seconds Mar 29 02:07:07.360600 n-d-828148-1 devstack@n-api.service[103504]: mapped 403077 bytes (393 KB) for 2 cores Mar 29 02:07:07.360600 n-d-828148-1 devstack@n-api.service[103504]: *** Operational MODE: preforking *** Mar 29 02:07:07.360881 n-d-828148-1 devstack@n-api.service[103504]: *** uWSGI is running in multiple interpreter mode *** Mar 29 02:07:07.360881 n-d-828148-1 devstack@n-api.service[103504]: spawned uWSGI master process (pid: 103504) Mar 29 02:07:07.361081 n-d-828148-1 systemd[1]: Started Devstack devstack@n-api.service. Mar 29 02:07:07.363044 n-d-828148-1 devstack@n-api.service[103504]: spawned uWSGI worker 1 (pid: 103513, cores: 1) Mar 29 02:07:07.363044 n-d-828148-1 devstack@n-api.service[103504]: spawned uWSGI worker 2 (pid: 103514, cores: 1) Mar 29 02:07:07.363044 n-d-828148-1 devstack@n-api.service[103504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 29 02:07:11.417870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 02:07:11.418466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 02:07:11.418591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 02:07:11.419009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 02:07:11.419272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 02:07:11.419665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-828148-1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.423999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.424405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.424713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.425863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.425863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.425863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-828148-1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.435725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.436357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 29 02:07:11.437879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.437965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 29 02:07:11.438045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 29 02:07:11.438196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 29 02:07:11.438335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 29 02:07:11.438504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.438948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.439950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-828148-1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.440800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.441785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.442956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.443922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.444913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.445845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.446993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-828148-1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.447926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.448948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.449963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.450948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.451907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.452936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.453846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.454958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.455070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.455215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.455316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.456310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.456419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.456646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.456753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.457940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.458950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.459871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.460776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.461966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.462933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.463034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.463261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.463370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.463577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.463676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.463894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.463996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.464207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.464302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.464535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.464659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.464879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.464977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.465192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.465290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.465452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.465561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.465761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.465863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.466073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.466170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.466399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.466512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.466716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.466814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.467028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.467126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.467352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.467534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.467654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.467775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.467968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.468082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.468285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.468400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.468595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.468693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.468928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.469045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.469244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.469336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.469557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.469656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.469870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.469966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.470181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.470281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.470491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.470589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.470817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.470915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.471701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.471801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.472046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.472157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.472371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.472538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.472684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.472787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.473023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.473129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.473341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.473442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.473654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.473745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.473966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.474058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.474282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.474389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.474601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.474693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.474915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.475014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.475231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.475325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.475545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.475643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.475858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.475986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.476174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.476274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.476480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.476579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.476801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.476963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.477141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.477236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.477550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.477672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.477767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.477860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.478073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.478174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.478409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.478538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.478688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.478787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.478995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.479101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.479302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.479400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.479609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.479700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.479912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.480047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.480217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.480307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.480542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.480659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.480874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.480984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.481200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.481320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.481498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.481601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.481819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.481906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 29 02:07:11.482153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.482266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.482468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.482611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.482777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.482879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.483826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.484770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.485954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.486908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.487980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.488197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.488296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.488526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.488663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.488830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.492887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.493975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.494917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.495980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.496998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.497779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.498940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.499991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.500954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.501887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.502099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.502190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.502930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.503968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.504932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.505854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.506814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.507937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.508903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.509957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.510891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.511827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.512775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.513948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.514977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.515916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.516871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.517120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.517347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.517484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.517681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.517774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.518587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.518709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.518872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.519939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.520972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.521877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.522972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.523898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.524964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.525871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.526821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.527962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.528996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.529985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.530908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.531842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.532767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.533974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.534986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.535910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.536130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.536219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.536435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.536705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.536797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.537847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.538933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.539950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.540881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.541805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.542943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.543975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.544958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.545881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.546815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.547963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.548919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.549912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.550931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.551871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.552791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.553987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.554925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.555944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.556899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.557862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.558793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.559946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.560917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.561949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.562172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.562325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.562494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.562636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.562937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.563949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.564087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.564234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.564380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.564530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.564671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.565308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.565505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.565656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.565832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.565966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.566953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.567812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.568770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.569963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.570999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.571969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.572185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.572277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.572504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.572597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.572823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.573888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.574823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.575965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.576913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.577993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.578963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.579123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.579307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.579416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.579702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.579803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.580019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.580145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.580315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.580431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.581970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.582921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.583871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.584865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.585950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.586966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.587968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.588924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.589776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.590976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.591937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.592916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.593968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.594913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.595892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.596981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.597929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.598983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.599921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.600955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.601889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.602866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.603799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.604985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.605925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.606961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.607908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.608126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.608219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.608440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.608547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.608749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.609954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.610068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.610276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.610377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.610597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.610789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.611979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.612900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.615398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.615586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.615758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.615906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.616967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.617873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.618936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.619958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.620161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.620309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.620509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.620665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.621977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.622919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.623938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.624913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.625968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.626887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.627018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.627147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.627817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.627968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.628985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.629118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.629342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.629475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.629610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.629817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.630033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.630183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.630379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.630634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.630863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.631945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.632902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.633934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.634966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.635771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.636945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.637879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.638893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.639885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.641339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.641505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.641647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.641797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.641937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.642960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.643601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.643718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.643933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.644928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.645041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.649853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.650950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.651097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.651510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.651674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.651822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.651966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.652920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.653839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.654979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.655892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.656914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.657937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.658089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.658240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.658384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.658384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.658680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.659898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.660924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.661073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.661220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.661624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.661829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.661987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.662856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.663907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.664966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.665882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.666967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.667942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.668095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.668240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.668383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.668531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.668531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.669898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.670890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.671044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.671201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.671354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.671776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.671930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.672529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.673662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.674842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.675958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.677933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.678345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.678488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.678735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.679240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.679420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.679707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.680043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.680428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.680747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.681099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.681423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.682056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.682936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.683264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.683711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.683945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.685917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.686297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.686638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.687010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.687336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 29 02:07:11.687588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 29 02:07:11.701940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:11.721707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_db.sqlalchemy.engines [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:11.945183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.context [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103513) load_cells /opt/stack/nova/nova/context.py:464}} Mar 29 02:07:11.949337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:07:11.950974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:07:11.951769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:07:11.953761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:07:11.968043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.context [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103514) load_cells /opt/stack/nova/nova/context.py:464}} Mar 29 02:07:11.972400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:07:11.974092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:07:11.974912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:07:11.976938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:07:11.986619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:11.997798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:12.007451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_db.sqlalchemy.engines [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:12.010740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_db.sqlalchemy.engines [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:12.026176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:12.040721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_db.sqlalchemy.engines [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Mar 29 02:07:12.279702 n-d-828148-1 devstack@n-api.service[103513]: INFO keyring.backend [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Loading KWallet Mar 29 02:07:12.287703 n-d-828148-1 devstack@n-api.service[103514]: INFO keyring.backend [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Loading KWallet Mar 29 02:07:12.289046 n-d-828148-1 devstack@n-api.service[103513]: INFO keyring.backend [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Loading SecretService Mar 29 02:07:12.292521 n-d-828148-1 devstack@n-api.service[103513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 02:07:12.292521 n-d-828148-1 devstack@n-api.service[103513]: from cryptography.utils import int_from_bytes Mar 29 02:07:12.293167 n-d-828148-1 devstack@n-api.service[103513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 02:07:12.293167 n-d-828148-1 devstack@n-api.service[103513]: from cryptography.utils import int_from_bytes Mar 29 02:07:12.294218 n-d-828148-1 devstack@n-api.service[103513]: INFO keyring.backend [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Loading Windows Mar 29 02:07:12.295716 n-d-828148-1 devstack@n-api.service[103513]: INFO keyring.backend [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Loading chainer Mar 29 02:07:12.296498 n-d-828148-1 devstack@n-api.service[103513]: INFO keyring.backend [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Loading macOS Mar 29 02:07:12.296688 n-d-828148-1 devstack@n-api.service[103514]: INFO keyring.backend [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Loading SecretService Mar 29 02:07:12.300806 n-d-828148-1 devstack@n-api.service[103514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 02:07:12.300806 n-d-828148-1 devstack@n-api.service[103514]: from cryptography.utils import int_from_bytes Mar 29 02:07:12.301162 n-d-828148-1 devstack@n-api.service[103514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 29 02:07:12.301162 n-d-828148-1 devstack@n-api.service[103514]: from cryptography.utils import int_from_bytes Mar 29 02:07:12.301907 n-d-828148-1 devstack@n-api.service[103514]: INFO keyring.backend [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Loading Windows Mar 29 02:07:12.303751 n-d-828148-1 devstack@n-api.service[103514]: INFO keyring.backend [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Loading chainer Mar 29 02:07:12.304544 n-d-828148-1 devstack@n-api.service[103514]: INFO keyring.backend [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Loading macOS Mar 29 02:07:12.554059 n-d-828148-1 devstack@n-api.service[103513]: WARNING keystonemiddleware.auth_token [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 02:07:12.557231 n-d-828148-1 devstack@n-api.service[103514]: WARNING keystonemiddleware.auth_token [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 02:07:12.560548 n-d-828148-1 devstack@n-api.service[103513]: WARNING keystonemiddleware.auth_token [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 02:07:12.563729 n-d-828148-1 devstack@n-api.service[103514]: WARNING keystonemiddleware.auth_token [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 02:07:12.774821 n-d-828148-1 devstack@n-api.service[103513]: WARNING keystonemiddleware.auth_token [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 02:07:12.776005 n-d-828148-1 devstack@n-api.service[103514]: WARNING keystonemiddleware.auth_token [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 29 02:07:12.780992 n-d-828148-1 devstack@n-api.service[103513]: WARNING keystonemiddleware.auth_token [None req-e0fc2085-baf6-4355-ba85-0bd813dd8012 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 02:07:12.782137 n-d-828148-1 devstack@n-api.service[103514]: WARNING keystonemiddleware.auth_token [None req-9519751a-4296-47dd-b4cb-683fc88fd425 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 29 02:07:12.786844 n-d-828148-1 devstack@n-api.service[103513]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622e643f9c0 pid: 103513 (default app) Mar 29 02:07:12.787729 n-d-828148-1 devstack@n-api.service[103514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5622e643f9c0 pid: 103514 (default app) Mar 29 02:08:08.968746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Calling method '.version_select at 0x7f8726001e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:08.971493 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:08.971493 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:08.977917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103513) load_cells /opt/stack/nova/nova/compute/api.py:294}} Mar 29 02:08:08.978728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:08.979175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.002260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.002868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.017130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.017575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.030824 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc756f50-c129-4195-b1ea-b82f04cfab6a tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.709447 Mar 29 02:08:09.030824 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1207 bytes} [Tue Mar 29 02:08:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:09.427926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:09.429602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.430239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.431034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.431479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.467982 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9673f4fd-c40f-4f9a-a098-2b7d53012727 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.441793 Mar 29 02:08:09.468551 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2/2] 10.222.0.36 () {58 vars in 1163 bytes} [Tue Mar 29 02:08:09 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:09.473468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-486ba9d7-4e2d-4a59-9bae-b6e811aa9325 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1099014772"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:09.490623 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:09.490623 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:09.491852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-486ba9d7-4e2d-4a59-9bae-b6e811aa9325 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Generated uuid df490dac-8b53-4296-b156-0d1423170e7e for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:09.598516 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-486ba9d7-4e2d-4a59-9bae-b6e811aa9325 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.128590 Mar 29 02:08:09.599490 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3/3] 10.222.0.36 () {62 vars in 1204 bytes} [Tue Mar 29 02:08:09 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:09.727383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-821b0f6e-45a5-498a-8841-d5c9e0661a6e tempest-AZAdminNegativeTestJSON-1268594818 tempest-AZAdminNegativeTestJSON-1268594818-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:09.728157 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:09.728157 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:09.729539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-821b0f6e-45a5-498a-8841-d5c9e0661a6e tempest-AZAdminNegativeTestJSON-1268594818 tempest-AZAdminNegativeTestJSON-1268594818-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '3cea92c866ff4ca59556d027329fb4c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293ab7b9f7c64edeb2090aab812af0c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:09.730217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-821b0f6e-45a5-498a-8841-d5c9e0661a6e tempest-AZAdminNegativeTestJSON-1268594818 tempest-AZAdminNegativeTestJSON-1268594818-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:09.731037 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-821b0f6e-45a5-498a-8841-d5c9e0661a6e tempest-AZAdminNegativeTestJSON-1268594818 tempest-AZAdminNegativeTestJSON-1268594818-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.130218 Mar 29 02:08:09.736935 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 4/4] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:08:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:09.857911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '.version_select at 0x7f8726000e50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:09.859994 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:09.859994 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:09.866180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103514) load_cells /opt/stack/nova/nova/compute/api.py:294}} Mar 29 02:08:09.866990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.867415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.889377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.890017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.902279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.902722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.909019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6934e3d7-7db8-4f9d-9188-0ae17455bcdf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.159963 Mar 29 02:08:09.909582 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1/5] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:08:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:09.981206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:09.982520 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:09.982520 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:09.984373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.985438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:09.986237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:09.986667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:10.019704 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.279411 Mar 29 02:08:10.020653 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 5/6] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:08:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:10.022041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:10.023258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-945c03a6-d880-4a21-8a20-4292be3a7c3f tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001612 Mar 29 02:08:10.023584 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 6/7] 10.222.0.36 () {56 vars in 885 bytes} [Tue Mar 29 02:08:10 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 29 02:08:10.030288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:10.030588 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:10.030588 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:10.032551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:10.033025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:10.034105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:10.034375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:10.061198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-14f8d921-4084-48df-9ba7-e77a3b368717 tempest-AZAdminV2TestJSON-2053609310 tempest-AZAdminV2TestJSON-2053609310-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.035255 Mar 29 02:08:10.061793 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 7/8] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:08:10 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:10.066056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea103abb-6a4b-4ada-af2f-428c9b861866 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-823820820"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:10.137677 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:10.137677 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:10.215185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1040092186", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:10.262317 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea103abb-6a4b-4ada-af2f-428c9b861866 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.199493 Mar 29 02:08:10.262965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 8/9] 10.222.0.36 () {62 vars in 1209 bytes} [Tue Mar 29 02:08:10 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:10.274722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56790b86-6fa0-4422-84fd-8f62c56c393f tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:10.275677 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:10.275677 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:10.288022 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56790b86-6fa0-4422-84fd-8f62c56c393f tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.016992 Mar 29 02:08:10.290184 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 9/10] 10.222.0.36 () {60 vars in 1189 bytes} [Tue Mar 29 02:08:10 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:10.303950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e8b37488-9dc6-4102-ab39-12b1963b3dfc tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:10.305444 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:10.305444 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:10.315420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8b37488-9dc6-4102-ab39-12b1963b3dfc tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:10.315872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8b37488-9dc6-4102-ab39-12b1963b3dfc tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:11.203309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:11.284761 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e8b37488-9dc6-4102-ab39-12b1963b3dfc tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.980746 Mar 29 02:08:11.284761 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 10/11] 10.222.0.36 () {62 vars in 1231 bytes} [Tue Mar 29 02:08:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:08:11.293160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-021b14f7-a2be-4bf9-a4f2-81c2a1642ec7 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:11.294810 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:11.294810 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:11.305892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-021b14f7-a2be-4bf9-a4f2-81c2a1642ec7 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:11.306347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-021b14f7-a2be-4bf9-a4f2-81c2a1642ec7 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:11.600390 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-021b14f7-a2be-4bf9-a4f2-81c2a1642ec7 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.311248 Mar 29 02:08:11.608071 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 11/12] 10.222.0.36 () {62 vars in 1231 bytes} [Tue Mar 29 02:08:11 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:11.608294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:11.615304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-273dd6f9-751e-46aa-a060-5ec9f0286416 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:11.615701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:11.616590 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:11.616590 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:11.616824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:11.617365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:11.617876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:11.637312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:11.639186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:11.641276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:11.642450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:11.678431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Getting quotas for project 48d5c6c7d3ff402db72fada2a0083d87. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:11.686662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Getting quotas for user e130c0deae154519887add62142d7cac and project 48d5c6c7d3ff402db72fada2a0083d87. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:11.702176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-273dd6f9-751e-46aa-a060-5ec9f0286416 tempest-AggregatesAdminTestV241-80489900 tempest-AggregatesAdminTestV241-80489900-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.092252 Mar 29 02:08:11.706217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:08:11.712310 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 12/13] 10.222.0.36 () {60 vars in 1192 bytes} [Tue Mar 29 02:08:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:11.721042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:08:11.784066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5647ad5-7446-4ad4-9db5-288a119b8f8d tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1496333216", "name": "tempest-test_aggregate-1913490019"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:11.812774 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:11.812774 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:11.816439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-f5647ad5-7446-4ad4-9db5-288a119b8f8d tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid cd821d93-583b-4884-a82d-d4ac1a78128c for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:11.952798 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5647ad5-7446-4ad4-9db5-288a119b8f8d tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.175459 Mar 29 02:08:11.953744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fe5b7637-2dc5-4dc7-8e4a-d89fecdbd241 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039734 Mar 29 02:08:11.957257 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 13/14] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Mar 29 02:08:11 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:11.960269 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2/15] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:08:11.966491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-07fd14d4-e9a1-4d8d-a7d3-594597fab648 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:11.967567 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:11.967567 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:11.969647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27e2d563-6925-45d7-a0b9-4809c47a2a3d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:11.970431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27e2d563-6925-45d7-a0b9-4809c47a2a3d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:11.983446 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-07fd14d4-e9a1-4d8d-a7d3-594597fab648 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.021534 Mar 29 02:08:11.984615 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3/16] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:08:11 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:11.996044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d4be815a-7f38-4d06-83df-135e0c04a760 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:11.997801 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:11.997801 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:12.052380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4be815a-7f38-4d06-83df-135e0c04a760 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:12.054965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4be815a-7f38-4d06-83df-135e0c04a760 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:13.354908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27e2d563-6925-45d7-a0b9-4809c47a2a3d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:13.380772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27e2d563-6925-45d7-a0b9-4809c47a2a3d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1220 microversion: 2.1 time: 1.418940 Mar 29 02:08:13.381402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 14/17] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:11 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1220 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:13.713046 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d4be815a-7f38-4d06-83df-135e0c04a760 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 1.720073 Mar 29 02:08:13.716285 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 4/18] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:14.398340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6995bbb9-67d9-49f0-951b-4659b5be665a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:14.399091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6995bbb9-67d9-49f0-951b-4659b5be665a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:14.454156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1742022363", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "availability_zone": "tempest-test_az-1496333216"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:14.477852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:14.478452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:14.479359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:14.479900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:14.518981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6995bbb9-67d9-49f0-951b-4659b5be665a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:14.539709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6995bbb9-67d9-49f0-951b-4659b5be665a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1220 microversion: 2.1 time: 0.144957 Mar 29 02:08:14.541485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 5/19] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:14 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:14.597824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:14.931724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:14.932263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:14.932803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:14.933315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:14.934492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:14.964781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:14.964781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:14.964957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:14.965522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:14.995518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Getting quotas for project 5e1ab6d9264d4787b326c98d4720cd5d. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:15.002282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Getting quotas for user 49f10dace9144930b80ee7d0aca09772 and project 5e1ab6d9264d4787b326c98d4720cd5d. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:15.014243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:08:15.017917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:08:15.162772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66a0409e-88f8-4aae-9619-71066b6d9607 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289775 Mar 29 02:08:15.163424 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 15/20] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:08:15.174588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1379dd0-8d67-44c7-afc5-4c9d96262c48 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:15.175470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1379dd0-8d67-44c7-afc5-4c9d96262c48 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:15.304515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1379dd0-8d67-44c7-afc5-4c9d96262c48 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:15.314926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1379dd0-8d67-44c7-afc5-4c9d96262c48 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1243 microversion: 2.1 time: 0.145439 Mar 29 02:08:15.315489 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 6/21] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:15 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1243 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:15.557224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:15.557874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:15.565775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:15.566410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:15.567357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:15.567793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:15.708451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:15.720759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e51e8c0-de2c-4e02-b53a-84514667c22e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1238 microversion: 2.1 time: 0.166777 Mar 29 02:08:15.721278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 16/22] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:15 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1238 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:16.333011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-42011eb2-2ef3-4d90-9c6f-3c10520a4fbe tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:16.334194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-42011eb2-2ef3-4d90-9c6f-3c10520a4fbe tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:16.439673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42011eb2-2ef3-4d90-9c6f-3c10520a4fbe tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:16.447999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-42011eb2-2ef3-4d90-9c6f-3c10520a4fbe tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1243 microversion: 2.1 time: 0.119744 Mar 29 02:08:16.448556 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 7/23] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:16 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1243 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:16.737928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:16.738617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:16.751411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:16.751411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:16.751411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:16.751749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:16.882603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:16.902701 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8e7324a1-1646-4b1c-b860-25ec75505fc5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1312 microversion: 2.1 time: 0.168517 Mar 29 02:08:16.904857 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 17/24] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:16 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:17.467064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:17.470030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:17.489515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:17.490409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:17.491234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:17.491675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:17.713309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:17.724282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae1dfee3-ee3a-4d4c-8cbc-db9a1703d680 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1291 microversion: 2.1 time: 0.261965 Mar 29 02:08:17.725466 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 8/25] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:17 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1291 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:17.923805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:17.923805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:17.930377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:17.930826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:17.931601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:17.932036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:18.354062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:18.367272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc5bfa53-9f32-4b8d-89ac-8290b211f3c1 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.446097 Mar 29 02:08:18.368555 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 18/26] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:17 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:18.749576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:18.753727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:18.763584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:18.765817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:18.766066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:18.767027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:18.921263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:18.932349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3b8ea358-b1e2-4ad2-b7ba-82036e16134d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1297 microversion: 2.1 time: 0.186426 Mar 29 02:08:18.943237 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 9/27] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:18 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1297 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:19.401672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:19.402684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:19.415942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:19.416649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:19.425083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:19.425768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:19.949967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:19.950605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:19.980954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:19.980954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:19.980954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:19.980954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:20.121725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:20.134707 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22d88ab3-7165-47b3-b892-5d58263ff622 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.752161 Mar 29 02:08:20.138580 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 19/28] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:19 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:20.486083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:20.505452 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2cdaf309-e380-46d3-8e5b-9610e362bf5b tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.555768 Mar 29 02:08:20.512623 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 10/29] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:19 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:21.048394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8725ea0b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.054122 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:21.054122 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:21.054122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.054122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.086177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.087035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.115324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.116090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.147685 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99869619-f541-42ac-808b-3da027a00450 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.006916 Mar 29 02:08:21.153179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 20/30] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:21.162179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.163527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:21.169985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d901f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.170794 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:21.170794 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:21.172893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.180145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.183959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.184417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.186206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.188273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.227593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.228243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.246746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.247203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.262558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10a574d1-9661-440b-97e1-25526bb68dca tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.092364 Mar 29 02:08:21.262558 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 21/31] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:21.283672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d60b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.288282 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:21.288282 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:21.289131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.289756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.348027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.355036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.372641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.372641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.402886 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a6d6994-b32e-4981-836e-7cb045c05974 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127728 Mar 29 02:08:21.402886 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 22/32] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:21.573563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Calling method '.version_select at 0x7f8724d74dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.576683 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:21.576683 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:21.580535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.581472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.614736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.615187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.648214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.648657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.674122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.674469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.706568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.707029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.717305 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61adfdb8-5e12-41bb-8267-6342fd4598de tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.317279 Mar 29 02:08:21.727503 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 23/33] 10.222.0.36 () {60 vars in 1242 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:21.727503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d74ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.727503 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:21.727503 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:21.728730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.729351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.749697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.750153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.760089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86b1a863-0860-4807-bbf1-7e52c7b6c9ed tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.039800 Mar 29 02:08:21.761662 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 24/34] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:21.766546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:21.767153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:21.777033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.778169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:21.778668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:21.779304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.289799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:22.304494 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81e991fc-291e-45d2-adfc-ad6b991bb173 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 1.154294 Mar 29 02:08:22.305565 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 11/35] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:22.316666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Calling method '.version_select at 0x7f8724d555e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:22.318676 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:22.318676 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:22.320333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.320786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.351602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.352166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.459328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.459328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.487927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.489791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.544449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.545064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.571923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-45b61bd0-3beb-4d5f-a370-4f874917ef1d tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.265209 Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 12/36] 10.222.0.36 () {60 vars in 1221 bytes} [Tue Mar 29 02:08:22 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84696eea-4e4a-43f2-8ab1-b5b9806ca124 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d41820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84696eea-4e4a-43f2-8ab1-b5b9806ca124 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:22.601034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84696eea-4e4a-43f2-8ab1-b5b9806ca124 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:22.626997 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84696eea-4e4a-43f2-8ab1-b5b9806ca124 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.053292 Mar 29 02:08:22.633761 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 13/37] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Mar 29 02:08:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.090921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:23.106950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07544441-c5c3-4ef9-9168-9acb3eef2a93 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 1.344444 Mar 29 02:08:23.114304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 25/38] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:21 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:23.119957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Calling method '.version_select at 0x7f8724d6a820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.122883 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.122883 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:23.124506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.125071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.170916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.171645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.183508 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd48d25b-872b-491c-ad56-944b79182cb9 tempest-HypervisorAdminV253TestBase-1078852888 tempest-HypervisorAdminV253TestBase-1078852888-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/a9afa737-3207-4b53-93b4-9e8a1a54ac5f" status: 200 len: 792 microversion: 2.53 time: 0.074490 Mar 29 02:08:23.186506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 26/39] 10.222.0.36 () {60 vars in 1297 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors/a9afa737-3207-4b53-93b4-9e8a1a54ac5f => generated 792 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:23.199580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d6a4c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.200298 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.200298 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:23.201882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.202307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.220440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e25337d8-e7ab-4893-abf3-7c1bc2ac6708 req-1f4d06a7-85fe-4a41-9f71-a227d783dfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46", "tag": "eed05dfd-b7e5-40ab-9d1a-4b77418b47bf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:23.223344 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.223344 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:23.234751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.235778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.247562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e25337d8-e7ab-4893-abf3-7c1bc2ac6708 req-1f4d06a7-85fe-4a41-9f71-a227d783dfa0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.251055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e25337d8-e7ab-4893-abf3-7c1bc2ac6708 req-1f4d06a7-85fe-4a41-9f71-a227d783dfa0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.255053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.255757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.266557 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed19781f-7ac3-4cec-8b87-9384d310aa9f tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.079124 Mar 29 02:08:23.267505 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 27/40] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.279096 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e25337d8-e7ab-4893-abf3-7c1bc2ac6708 req-1f4d06a7-85fe-4a41-9f71-a227d783dfa0 service nova] Creating event network-changed:eed05dfd-b7e5-40ab-9d1a-4b77418b47bf for instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 on n-h2-828148-1 Mar 29 02:08:23.280261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e25337d8-e7ab-4893-abf3-7c1bc2ac6708 req-1f4d06a7-85fe-4a41-9f71-a227d783dfa0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:08:23.282145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.282593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.283381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.283815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.293396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.compute.rpcapi [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Mar 29 02:08:23.295470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] Releasing lock "compute-rpcapi-router" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:08:23.312420 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-04c2bc90-a330-469b-9d0a-43aaf5a670be None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.682166 Mar 29 02:08:23.313241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 14/41] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.321691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d553a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.323121 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.323121 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:23.325194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.326129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.347136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.347943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.373037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7179cdf4-81b7-442e-a4a1-37051753507c tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.057226 Mar 29 02:08:23.373743 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 15/42] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.383375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.389491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:23.407031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.409798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.409798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.409798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.747562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Calling method '.version_select at 0x7f8724d6a790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.754311 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.754311 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:23.757891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.761541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.814750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.815220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.845902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.847254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.856313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c15e6775-1a84-466f-8402-73e2858161fa tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.587611 Mar 29 02:08:23.858878 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 28/43] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.874330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d6a3a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.875651 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.875651 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:23.881141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.882713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.931303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.934303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.953296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:23.963211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-907f41d9-487f-4d52-b6cf-12e952e72333 tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.102517 Mar 29 02:08:23.966031 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 29/44] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:23.970862 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98767c69-b0c8-4a8b-947e-71fa2ad3dabf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.595204 Mar 29 02:08:23.973143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Calling method '.version_select at 0x7f8724d6a310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.973870 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 16/45] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:23.974753 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.974753 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:23.976673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:23.977320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:23.979914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Calling method '.version_select at 0x7f8724d418b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:23.985424 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:23.985424 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:24.001208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.001574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.024692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.029779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.046040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.047019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.086660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.087331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.128758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.131183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.159893 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e5709f6c-3e81-4c3b-a8a1-55d4133cf2b1 tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-828148-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.192008 Mar 29 02:08:24.163654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 30/46] 10.222.0.36 () {58 vars in 1211 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors/n-h2-828148-1/servers => generated 275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:24.176448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:24.178302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:24.194732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a77fb58-05ee-4d29-a6c5-4ec94988d05d tempest-HypervisorAdminTestJSON-1983974580 tempest-HypervisorAdminTestJSON-1983974580-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.217447 Mar 29 02:08:24.198667 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 17/47] 10.222.0.36 () {58 vars in 1172 bytes} [Tue Mar 29 02:08:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:24.205020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.205509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.206325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.206777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.237892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Calling method '.version_select at 0x7f8724d4c9d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:24.238939 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:24.238939 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:24.240622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.241104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.288071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.290050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.330049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.331230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.348630 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad35fa52-e226-4a21-809d-bc94f5514cfe tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.138688 Mar 29 02:08:24.352707 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 18/48] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:24.369036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Calling method '.version_select at 0x7f8724d4c8b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:24.370904 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:24.370904 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:24.372993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.373681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.397670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:24.398607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:24.408173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e17cf950-8044-4134-9ef5-a744ef1248fb tempest-HypervisorAdminUnderV252Test-87570721 tempest-HypervisorAdminUnderV252Test-87570721-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-828148-1/search" status: 200 len: 104 microversion: 2.1 time: 0.043975 Mar 29 02:08:24.409583 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 19/49] 10.222.0.36 () {58 vars in 1208 bytes} [Tue Mar 29 02:08:24 2022] GET /compute/v2.1/os-hypervisors/n-h2-828148-1/search => generated 104 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:25.217176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:25.242061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a846119d-fd6c-4e5d-b9ba-5f96237ee9f8 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 1.076868 Mar 29 02:08:25.247010 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 31/50] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:24 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:25.269780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:25.272283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:25.292335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:25.292788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:25.293613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:25.298661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:25.393651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8ec79265-0508-485c-8cf8-9d6f3cf8f676 req-173eb9b4-4aa4-4a2f-a1b3-12190e3d2a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7edbe663-89cb-45c7-843c-41bf12957d7a", "tag": "e495833e-6afc-4b1f-a1ff-223f2e42210e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:25.396928 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:25.396928 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:25.446977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8ec79265-0508-485c-8cf8-9d6f3cf8f676 req-173eb9b4-4aa4-4a2f-a1b3-12190e3d2a72 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:25.446977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8ec79265-0508-485c-8cf8-9d6f3cf8f676 req-173eb9b4-4aa4-4a2f-a1b3-12190e3d2a72 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:25.528818 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8ec79265-0508-485c-8cf8-9d6f3cf8f676 req-173eb9b4-4aa4-4a2f-a1b3-12190e3d2a72 service nova] Creating event network-changed:e495833e-6afc-4b1f-a1ff-223f2e42210e for instance 7edbe663-89cb-45c7-843c-41bf12957d7a on n-h2-828148-1 Mar 29 02:08:25.528818 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8ec79265-0508-485c-8cf8-9d6f3cf8f676 req-173eb9b4-4aa4-4a2f-a1b3-12190e3d2a72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.825718 Mar 29 02:08:25.528818 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 20/51] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:25.897908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:25.917377 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24302379-8487-4294-abbd-3feb5356ae94 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.668207 Mar 29 02:08:25.919600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 32/52] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:25 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:26.263503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:26.264192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:26.279375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:26.279927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:26.282374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:26.293451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:26.643531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f08e953-659d-4570-b573-328aec7ad39a tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Calling method '.version_select at 0x7f8724d4ddc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:26.738194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:26.754636 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5f8d149-d259-480f-8717-a05032a89c8d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.494991 Mar 29 02:08:26.766119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 33/53] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:26 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:26.936199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:26.937761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:26.951682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:26.959224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:26.959224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:26.959224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:26.993639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6f08e953-659d-4570-b573-328aec7ad39a tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 371 microversion: 2.1 time: 0.970850 Mar 29 02:08:27.001764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 21/54] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:08:26 2022] GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 371 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:27.010839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d6dd30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:27.024142 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:27.024142 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:27.557727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:27.559371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:27.560773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:27.561642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:27.572924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:27.584728 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2284cb3b-d14a-46ec-a731-74d8f8ed4e9a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.651210 Mar 29 02:08:27.585851 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 34/55] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:26 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:27.772635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:27.773307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:27.784811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:27.785450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:27.786301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:27.786799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:27.864216 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50c27c99-7118-4436-9723-0056bb756130 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 328 microversion: 2.1 time: 0.818950 Mar 29 02:08:27.864216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 22/56] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:27 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 328 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:28.151287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:28.163448 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-860bd6fa-df6b-4238-bef0-5ac825bdce74 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.394657 Mar 29 02:08:28.164277 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 35/57] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:27 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:28.604540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:28.605465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:28.613756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:28.614876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:28.615722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:28.616245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:28.855101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:28.865543 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-84a949b0-ae74-4b1f-9080-f6b1f651a1c7 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.264856 Mar 29 02:08:28.866125 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 36/58] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:28 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:28.975251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1603039232", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:29.044058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:29.184234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:29.185877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:29.197530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.199448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.201072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.202975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.317292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:29.317783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:29.318680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:29.319260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:29.319838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:29.329999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.336810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.336810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.336810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.358423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:29.364588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for user 9bd30766dd0546ab83ef556303b5805f and project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:29.374488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.utils [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] cores quota exceeded for 64faa35737bf4adfabec22d9226109dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=103514) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1168}} Mar 29 02:08:29.375617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Mar 29 02:08:29.376150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:29.377221 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a3c2d2e9-88f8-4ce2-8e24-6c616a14ce57 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.987816 Mar 29 02:08:29.377867 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 23/59] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:28 2022] POST /compute/v2.1/servers => generated 111 bytes in 989 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:29.386367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d6d430>, body: {"quota_set": {"cores": 20}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:29.391377 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:29.391377 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:29.560389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:29.568762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65609609-081e-400a-9624-5352334e6632 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.391472 Mar 29 02:08:29.569529 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 37/60] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:29 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:29.794772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.795510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.796334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.796924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.882531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:29.883444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:29.891311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.891736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.892492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:29.892969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:29.959995 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5aeaff9a-549b-4484-92ae-54d92e858a40 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 329 microversion: 2.1 time: 0.577177 Mar 29 02:08:29.960606 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 24/61] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:29 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 329 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:29.974840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19f2427f-bce2-4984-9e29-10f97063c7e5 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Calling method '.version_select at 0x7f8724dbdd30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:30.110819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:30.119121 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbedd78b-90b8-48c5-825a-6fadedbe0bf6 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.240346 Mar 29 02:08:30.119843 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 38/62] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:29 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:30.537745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19f2427f-bce2-4984-9e29-10f97063c7e5 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 371 microversion: 2.1 time: 0.566371 Mar 29 02:08:30.539527 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 25/63] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:08:29 2022] GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:30.549883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d60af0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:30.551579 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:30.551579 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:30.586674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:30.587340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:30.595283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:30.595734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:30.596489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:30.596956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:30.804828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:30.813349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b1805d8-fb34-405a-a49b-6a44827598ab tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.230411 Mar 29 02:08:30.814033 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 26/64] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:30 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:31.138351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:31.139329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:31.147936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.148379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.150920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.150920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.210526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.211024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.211730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.212150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.360224 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-552db9f8-c869-4a47-bfa5-01cd79038950 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 328 microversion: 2.1 time: 0.814409 Mar 29 02:08:31.360973 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 39/65] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:30 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 328 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:31.437674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:31.450742 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9aebc68-080c-4bcb-83ce-1b4228f5faf5 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.317549 Mar 29 02:08:31.461651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 27/66] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:31 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:31.540191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2130038469", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:31.608044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:31.652012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e7ad659-a2ea-4620-aad7-16977c716c3f tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1378679837", "id": 1796472727, "os-flavor-access:is_public": "False"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:31.653738 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:31.653738 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:31.751078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e7ad659-a2ea-4620-aad7-16977c716c3f tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.303869 Mar 29 02:08:31.757571 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 40/67] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:31 2022] POST /compute/v2.1/flavors => generated 431 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:31.763351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df498a3b-4c1e-4abc-8884-d72e28cd9f48 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "59ca1d3a49274f909d7a6e81f0d4cbef"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:31.766004 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:31.766004 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:31.955930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:31.956732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:31.957311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:31.958238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:31.958851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:31.968673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.969650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.970432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:31.971074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:31.991162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:31.995755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for user 9bd30766dd0546ab83ef556303b5805f and project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:32.007680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.utils [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] instances quota exceeded for 64faa35737bf4adfabec22d9226109dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=103514) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1168}} Mar 29 02:08:32.008414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Mar 29 02:08:32.009329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:32.010615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-418826d9-867b-4437-a0de-24733e61f836 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.474181 Mar 29 02:08:32.011440 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 28/68] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:31 2022] POST /compute/v2.1/servers => generated 119 bytes in 476 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:32.017943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:32.018762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:32.043858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.044381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.045252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.045687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.174009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df498a3b-4c1e-4abc-8884-d72e28cd9f48 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1796472727/action" status: 200 len: 97 microversion: 2.1 time: 0.414830 Mar 29 02:08:32.182844 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 41/69] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Mar 29 02:08:31 2022] POST /compute/v2.1/flavors/1796472727/action => generated 97 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:32.189092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d6aa60>, body: {"quota_set": {"instances": 10}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:32.433161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:32.443457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-397690d1-7809-4d8a-b26b-8b2fcfef3895 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.430501 Mar 29 02:08:32.444406 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 29/70] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:32 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:32.650226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.650226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.650226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.650226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.856166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-399a1526-6524-4749-ae65-48bbbfe4a891 tempest-FlavorsAccessTestJSON-1041337408 tempest-FlavorsAccessTestJSON-1041337408-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:32.866211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8a362c6-cf66-44d3-9e2c-6a4888fe44f2 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 329 microversion: 2.1 time: 0.682016 Mar 29 02:08:32.869999 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 42/71] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:32 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 329 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:32.883604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:32.886571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:32.894499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.895300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.896266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:32.896948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:32.900281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-399a1526-6524-4749-ae65-48bbbfe4a891 tempest-FlavorsAccessTestJSON-1041337408 tempest-FlavorsAccessTestJSON-1041337408-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5412 microversion: 2.1 time: 0.454630 Mar 29 02:08:32.909870 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 30/72] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:32 2022] GET /compute/v2.1/flavors/detail => generated 5412 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:32.909870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd385f0f-d2f8-4fd2-8d50-f9fe23634faa tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Calling method '.version_select at 0x7f8724d55310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:33.141121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:33.150604 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e8e4f49d-4c76-41db-8c21-6ac79727abe4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.279125 Mar 29 02:08:33.158513 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 43/73] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:32 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:33.158513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccfb3eeb-ffc5-406e-8a5d-520401f9676d tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "59ca1d3a49274f909d7a6e81f0d4cbef"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:33.165417 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:33.165417 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:33.340339 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd385f0f-d2f8-4fd2-8d50-f9fe23634faa tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 371 microversion: 2.1 time: 0.437600 Mar 29 02:08:33.341919 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 31/74] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:08:32 2022] GET /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 371 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:33.362636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d4dd30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:33.364609 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:33.364609 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:33.795200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:33.795927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:33.797504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:33.798163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:33.909569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c55bea26-1a6a-49c4-a8f2-c995c48ec36f tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 325 microversion: 2.1 time: 0.550383 Mar 29 02:08:33.910270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 32/75] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:33 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 325 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:33.946438 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ccfb3eeb-ffc5-406e-8a5d-520401f9676d tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1796472727/action" status: 200 len: 21 microversion: 2.1 time: 0.791615 Mar 29 02:08:33.947598 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 44/76] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Mar 29 02:08:33 2022] POST /compute/v2.1/flavors/1796472727/action => generated 21 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:33.952131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:33.952950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:33.962549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:33.962983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:33.965130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:33.965572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.170767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:34.179547 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1aa5c37-f8ec-46da-addc-519ca052a2b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.230697 Mar 29 02:08:34.189055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 45/77] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:33 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:34.194517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87705d4e-e265-4bca-8c32-2fd62f15d8b3 tempest-FlavorsAccessTestJSON-1041337408 tempest-FlavorsAccessTestJSON-1041337408-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.199332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd608fd1-b868-4df3-b21f-ea7f5010d93e tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] Calling method '.version_select at 0x7f8724d0bc10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.221782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87705d4e-e265-4bca-8c32-2fd62f15d8b3 tempest-FlavorsAccessTestJSON-1041337408 tempest-FlavorsAccessTestJSON-1041337408-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031433 Mar 29 02:08:34.222369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 46/78] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:34.281434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Calling method '.version_select at 0x7f8724cf6af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.282251 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:34.282251 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:34.284198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.284518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.302072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.302516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.315606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.316051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.322626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5a03b83-73c5-4f43-8c53-510fddab51d5 tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.099074 Mar 29 02:08:34.328146 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 47/79] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:34.328525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.329439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:34.336869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.337419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.338196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.338624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.398557 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd608fd1-b868-4df3-b21f-ea7f5010d93e tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 2629 microversion: 2.1 time: 0.487180 Mar 29 02:08:34.399158 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 33/80] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:08:33 2022] GET /compute/v2.1/os-networks => generated 2629 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:34.404417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1226983959", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:34.476467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:34.541177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:34.549393 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d36fde1-42b9-49b4-aa8d-a9719db1e3cb tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.225066 Mar 29 02:08:34.549954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 48/81] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:34.561860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f526d65e-c672-4e14-8c68-662d06b62897 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.562800 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:34.562800 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:34.658513 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f526d65e-c672-4e14-8c68-662d06b62897 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1796472727" status: 202 len: 0 microversion: 2.1 time: 0.100516 Mar 29 02:08:34.659092 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 49/82] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:08:34 2022] DELETE /compute/v2.1/flavors/1796472727 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:34.664661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Calling method '.version_select at 0x7f8724cf6af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.665619 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:34.665619 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:34.667323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.667826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.684691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.685092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.692012 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e5b45d01-476c-4dd6-b4cf-330bfe9078bd tempest-HypervisorAdminV228Test-901430235 tempest-HypervisorAdminV228Test-901430235-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.031387 Mar 29 02:08:34.692971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 50/83] 10.222.0.36 () {60 vars in 1192 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:08:34.697373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0644a3c-5f57-491e-b401-4787e0c5ec7a tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] Calling method '.version_select at 0x7f8724d17940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.771501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:34.772610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:34.773552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:34.774133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:34.774717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:34.787215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.787888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.788966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:34.789700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:34.820478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:34.827599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Getting quotas for user 9bd30766dd0546ab83ef556303b5805f and project 64faa35737bf4adfabec22d9226109dd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:34.839586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.utils [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] ram quota exceeded for 64faa35737bf4adfabec22d9226109dd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=103514) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1168}} Mar 29 02:08:34.840207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Mar 29 02:08:34.840802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:34.841903 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-359935d8-ab3a-47c1-9ee9-098d207be7ae tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.441279 Mar 29 02:08:34.843427 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 34/84] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:34 2022] POST /compute/v2.1/servers => generated 110 bytes in 443 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:34.848069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee92f771-a4f5-4bc8-b3cb-8af8a2c583ad tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:34.874702 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee92f771-a4f5-4bc8-b3cb-8af8a2c583ad tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029965 Mar 29 02:08:34.875412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 35/85] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:34.880220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Action: 'update', calling method: .version_select at 0x7f8725fb3790>, body: {"quota_set": {"ram": 51200}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:34.882098 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:34.882098 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:34.894774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0644a3c-5f57-491e-b401-4787e0c5ec7a tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks/c0340286-e227-4025-8852-c3316ef08961" status: 200 len: 652 microversion: 2.1 time: 0.200837 Mar 29 02:08:34.899376 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 51/86] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:08:34 2022] GET /compute/v2.1/os-networks/c0340286-e227-4025-8852-c3316ef08961 => generated 652 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:34.901028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db1c89f3-3146-4bb1-9ab3-3381f040755d tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-2043196116", "id": 1885179014, "os-flavor-access:is_public": "False"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:34.902610 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:34.902610 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:35.012414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db1c89f3-3146-4bb1-9ab3-3381f040755d tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.114199 Mar 29 02:08:35.020218 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 52/87] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:34 2022] POST /compute/v2.1/flavors => generated 431 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:35.025477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcd77eef-630b-413f-ac47-19431f6ddb4d tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] Calling method '.version_select at 0x7f8724d6a4c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.092061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.092559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.093842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.094272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.196241 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcd77eef-630b-413f-ac47-19431f6ddb4d tempest-NetworksTest-1570909732 tempest-NetworksTest-1570909732-project-admin] 10.222.0.36 "GET /compute/v2.1/os-networks" status: 200 len: 2629 microversion: 2.1 time: 0.168626 Mar 29 02:08:35.197023 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 53/88] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:08:35 2022] GET /compute/v2.1/os-networks => generated 2629 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:35.202983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d78505aa-e18d-456b-be26-503218a3e0d6 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.204448 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:35.204448 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:35.251921 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d78505aa-e18d-456b-be26-503218a3e0d6 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1885179014/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.053440 Mar 29 02:08:35.257494 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 54/89] 10.222.0.36 () {58 vars in 1208 bytes} [Tue Mar 29 02:08:35 2022] GET /compute/v2.1/flavors/1885179014/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:35.262265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.263054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:35.270746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.271406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.272351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.273027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.281080 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eeda95dc-63b5-4e1d-8a58-a7b876092257 tempest-QuotasAdminNegativeTest-1670783184 tempest-QuotasAdminNegativeTest-1670783184-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 200 len: 329 microversion: 2.1 time: 0.404294 Mar 29 02:08:35.291769 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 36/90] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:34 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 329 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:35.304326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-02b92893-0ade-43e6-9580-e655bcc91a44 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.307623 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:35.307623 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:35.411876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-02b92893-0ade-43e6-9580-e655bcc91a44 tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1885179014" status: 202 len: 0 microversion: 2.1 time: 0.118873 Mar 29 02:08:35.412874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 37/91] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:08:35 2022] DELETE /compute/v2.1/flavors/1885179014 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:35.419433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8860f25d-eb27-440b-9755-cf1dabf7d6e3 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Action: 'update', calling method: .version_select at 0x7f8724d4cb80>, body: {"quota_set": {"ram": 0}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:35.422522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8860f25d-eb27-440b-9755-cf1dabf7d6e3 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '9bd30766dd0546ab83ef556303b5805f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64faa35737bf4adfabec22d9226109dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:35.423161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8860f25d-eb27-440b-9755-cf1dabf7d6e3 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:35.423946 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8860f25d-eb27-440b-9755-cf1dabf7d6e3 tempest-QuotasAdminNegativeTest-525753235 tempest-QuotasAdminNegativeTest-525753235-project] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd" status: 403 len: 116 microversion: 2.1 time: 0.010084 Mar 29 02:08:35.424465 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 38/92] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:08:35 2022] PUT /compute/v2.1/os-quota-sets/64faa35737bf4adfabec22d9226109dd => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:35.434061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae1026a4-473e-4b7c-bb38-6ce2f0e2dd6c tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.459233 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae1026a4-473e-4b7c-bb38-6ce2f0e2dd6c tempest-FlavorsAccessTestJSON-75148540 tempest-FlavorsAccessTestJSON-75148540-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033432 Mar 29 02:08:35.459819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 39/93] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:35.566253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:35.566865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:35.574300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.574744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.575746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:35.576368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:35.679035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:35.691372 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a28efd8e-10b2-4c69-9233-a512307d784d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.432577 Mar 29 02:08:35.691946 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 55/94] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:35 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:35.826552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:35.836291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32cf33f2-4562-481f-ae3a-77100ac20878 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.273566 Mar 29 02:08:35.837080 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 40/95] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:35 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:36.712412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:36.713629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:36.728501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:36.730447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:36.731432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:36.738353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:37.119084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-796181199", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "2a492824-76d3-4dc8-9d37-f81c1b4928a3"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:37.159816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:37.168436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f82a7e2-a4a2-49ad-bb15-9b6e23e8cf6a tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.462294 Mar 29 02:08:37.173179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 56/96] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:36 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:37.179074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:37.179935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:37.195083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:37.195577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:37.197862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:37.198612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:37.217457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] validate_networks() for [('2a492824-76d3-4dc8-9d37-f81c1b4928a3', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:37.466487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:37.474739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8b75390-cec5-4851-aa62-8237990b0955 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.300313 Mar 29 02:08:37.475301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 57/97] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:37 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:38.134835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ba259aea-db17-4de3-bc4b-d367ff121de0 req-beee00ed-08fc-4c86-921a-63782aa722e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46", "name": "network-vif-plugged", "status": "completed", "tag": "eed05dfd-b7e5-40ab-9d1a-4b77418b47bf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:38.136387 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:38.136387 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:38.145407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ba259aea-db17-4de3-bc4b-d367ff121de0 req-beee00ed-08fc-4c86-921a-63782aa722e4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.145843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ba259aea-db17-4de3-bc4b-d367ff121de0 req-beee00ed-08fc-4c86-921a-63782aa722e4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.162666 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ba259aea-db17-4de3-bc4b-d367ff121de0 req-beee00ed-08fc-4c86-921a-63782aa722e4 service nova] Creating event network-vif-plugged:eed05dfd-b7e5-40ab-9d1a-4b77418b47bf for instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 on n-h2-828148-1 Mar 29 02:08:38.163174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ba259aea-db17-4de3-bc4b-d367ff121de0 req-beee00ed-08fc-4c86-921a-63782aa722e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:08:38.164299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.164777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.165531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.165959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.174717 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.rpcapi [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Mar 29 02:08:38.176027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] Releasing lock "compute-rpcapi-router" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:08:38.219981 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b75100f8-d6bd-4ec9-8e3d-6881c837e984 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.735973 Mar 29 02:08:38.220616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 58/98] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:38.225628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:38.226509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:38.234905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.240090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.240090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.240090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.565488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:38.579106 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90f65b24-402a-4926-949d-abdfeafe91b5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.357236 Mar 29 02:08:38.579697 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 59/99] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:38 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:38.583942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:38.589365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:38.603141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.603914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.605858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:38.606686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:38.887212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:38.899517 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee5d919f-0893-407f-b224-9b97c7a45baf tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.318594 Mar 29 02:08:38.909858 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 60/100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:38 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:39.541302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:39.542328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:39.543353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:39.543976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:39.544576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:39.558409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.558928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:39.559790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.560283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:39.580683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:39.584410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for user f540281478cf4d929afbce240e2f4c66 and project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:39.595515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:08:39.595699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:39.596467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:39.598780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:08:39.604098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.609322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:39.609322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.609322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:39.769616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7914e08-585c-4314-a546-2a75b6cdd5c7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.981763 Mar 29 02:08:39.770571 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 41/101] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2986 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:08:39.781270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:39.782148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:39.850740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:39.861135 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-393f3d4c-b8ab-45bc-9201-15fc6a6bc4c5 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.269061 Mar 29 02:08:39.872437 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 61/102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:39 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:08:39.889653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:39.904451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:39.909566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:39.911914 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba6059d3-f5c9-479c-9c4d-764456eff7ad tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1261 microversion: 2.25 time: 0.134163 Mar 29 02:08:39.914383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 42/103] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:39 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:39.917292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:39.918317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:39.928220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.928860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:39.930081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:39.930676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:40.165175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:40.173883 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5fb01806-9a7c-47e8-a308-9388c9259c46 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1342 microversion: 2.1 time: 0.260290 Mar 29 02:08:40.174798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 62/104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:39 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:40.241664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e8a212bd-9a55-4093-a94d-08334b5b5502 req-666c5596-c5e1-4ab5-9374-a37baaadd30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edbe663-89cb-45c7-843c-41bf12957d7a", "name": "network-vif-plugged", "status": "completed", "tag": "e495833e-6afc-4b1f-a1ff-223f2e42210e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:40.250756 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:40.250756 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:40.263654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8a212bd-9a55-4093-a94d-08334b5b5502 req-666c5596-c5e1-4ab5-9374-a37baaadd30c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:40.264095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8a212bd-9a55-4093-a94d-08334b5b5502 req-666c5596-c5e1-4ab5-9374-a37baaadd30c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:40.281785 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e8a212bd-9a55-4093-a94d-08334b5b5502 req-666c5596-c5e1-4ab5-9374-a37baaadd30c service nova] Creating event network-vif-plugged:e495833e-6afc-4b1f-a1ff-223f2e42210e for instance 7edbe663-89cb-45c7-843c-41bf12957d7a on n-h2-828148-1 Mar 29 02:08:40.286761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e8a212bd-9a55-4093-a94d-08334b5b5502 req-666c5596-c5e1-4ab5-9374-a37baaadd30c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049288 Mar 29 02:08:40.289558 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 43/105] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:40.877732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:40.878329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:40.885537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:40.885977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:40.886941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:40.887408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:40.943158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:40.944484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:40.953830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:40.954530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:40.955462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:40.956048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:41.091158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:41.107676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:41.110465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:41.111798 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a2ffa87-fc87-40e5-b3e2-69d5c09542ae tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1265 microversion: 2.25 time: 0.172697 Mar 29 02:08:41.112725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 44/106] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:40 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:08:41.151430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:41.159889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-072846cc-d13d-4414-a453-2ca58b849a33 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1339 microversion: 2.1 time: 0.286396 Mar 29 02:08:41.160481 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 63/107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:40 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:41.191080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:41.191909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:41.205207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:41.205537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:41.206204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:41.206841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:41.433980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:41.444411 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2859708e-40b6-448e-b2bc-c577402140a8 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1492 microversion: 2.1 time: 0.256927 Mar 29 02:08:41.444995 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 45/108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:41 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1492 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:41.947186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:41.947805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:41.970204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:41.970651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:41.971423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:41.971847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.042298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:08:42.135275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:42.135275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:42.140056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.140710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.141657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.142255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.348170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:42.356682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:42.363459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:42.363459 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bed7bd55-d7c8-4c06-9229-4b7ba7bf0997 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1321 microversion: 2.25 time: 0.233312 Mar 29 02:08:42.363459 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 46/109] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:42 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:42.372940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:42.373641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:42.377030 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-45edcef0-96f2-4f6f-a14c-94ddedf28822 tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 204 len: 0 microversion: 2.1 time: 0.918846 Mar 29 02:08:42.378125 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 64/110] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:08:41 2022] DELETE /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:08:42.389836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.390471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.391404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.391976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.660238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f26437e-d5b3-482e-bc9c-8b446fcda5b5 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] Calling method '.version_select at 0x7f8724d178b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:42.661397 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:42.661397 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:42.685018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f26437e-d5b3-482e-bc9c-8b446fcda5b5 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.305416 Mar 29 02:08:42.685789 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 65/111] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:08:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:42.702886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:42.703892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:42.711763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.712246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.713065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:42.713515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:42.880239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:42.893102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d32bcc7-a0d6-4fd8-9fd3-f07c1d33d62e tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1488 microversion: 2.1 time: 0.531598 Mar 29 02:08:42.893693 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 47/112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:42 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1488 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:42.908589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1b56524-a8a6-408a-839b-0244b0af44c1 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] Action: 'update', calling method: .version_select at 0x7f8724464700>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:42.910508 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:42.910508 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:43.032718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:43.043252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5602c89d-3d11-4eb4-b57c-6d73d00d692a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1498 microversion: 2.1 time: 0.356380 Mar 29 02:08:43.044134 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 66/113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:42 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:43.049205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:43.050068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:43.057846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:43.065054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:43.065054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:43.065054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:43.604291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ecedf5d7-1d2f-499d-9a69-08293f59feaf tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1639 microversion: 2.1 time: 0.557993 Mar 29 02:08:43.606131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 67/114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:43 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1639 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:44.150729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d13700>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:44.150729 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:44.150729 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:44.150729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.150729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.162935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.163588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.196530 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] HTTP exception thrown: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. Mar 29 02:08:44.197224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Returning 404 to user: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:44.198077 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1a11dbe8-fc3d-428f-aec3-80bf81db1433 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808" status: 404 len: 110 microversion: 2.53 time: 0.590762 Mar 29 02:08:44.199638 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 68/115] 10.222.0.36 () {62 vars in 1308 bytes} [Tue Mar 29 02:08:43 2022] PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808 => generated 110 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:08:44.210133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:44.212666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:44.230797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.231686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.232926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.234610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.418504 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1b56524-a8a6-408a-839b-0244b0af44c1 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.521953 Mar 29 02:08:44.420275 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 48/116] 10.222.0.36 () {60 vars in 1205 bytes} [Tue Mar 29 02:08:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:44.425668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:44.426472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:44.434701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.435479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.436583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.437250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.559864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:08:44.786370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:44.796931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:44.798468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:44.799948 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39a09fac-6f23-499e-a089-2b8068610805 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.599170 Mar 29 02:08:44.800490 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 69/117] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:44 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:44.804962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:44.805768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:44.815193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.815576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.816371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.816797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.897457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-561929e1-25e6-42ec-96e1-c3855bb2738d tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 204 len: 0 microversion: 2.1 time: 0.475191 Mar 29 02:08:44.898387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 49/118] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:08:44 2022] DELETE /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:08:44.906165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d0b9d0>, body: {"status": "disabled"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:44.908410 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:44.908410 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:44.910753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.911840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.921770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.924226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.931597 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] HTTP exception thrown: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. Mar 29 02:08:44.932523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Returning 404 to user: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:44.933904 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dddc57b-1ebc-4b4d-8160-3cbfc479bff3 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808" status: 404 len: 110 microversion: 2.53 time: 0.033815 Mar 29 02:08:44.934739 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 50/119] 10.222.0.36 () {62 vars in 1308 bytes} [Tue Mar 29 02:08:44 2022] PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808 => generated 110 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:08:44.940481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c330193-552f-4913-865d-13c57c94b9b8 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] Calling method '.version_select at 0x7f8724d5c940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:44.941303 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:44.941303 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:44.954815 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c330193-552f-4913-865d-13c57c94b9b8 tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.018687 Mar 29 02:08:44.955304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 51/120] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:08:44 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:44.960373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:44.961443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:44.970076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.975281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:44.975281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:44.975281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.040759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:45.049937 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c66e389-26cd-4835-9449-e1897df9974c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 200 len: 1456 microversion: 2.1 time: 0.248210 Mar 29 02:08:45.055891 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 70/121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:44 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 1456 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:45.062868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Action: 'update', calling method: .version_select at 0x7f8724d17940>, body: {"status": "enabled"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:45.068408 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.068408 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:45.072478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.073229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.090784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.091475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.105814 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] HTTP exception thrown: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. Mar 29 02:08:45.106716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Returning 404 to user: Service 55d66127-386f-485b-bacc-166b16723808 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:45.109677 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a704c5ab-47c4-4bcd-aeed-9c3610573010 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808" status: 404 len: 110 microversion: 2.53 time: 0.052510 Mar 29 02:08:45.110769 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 71/122] 10.222.0.36 () {62 vars in 1308 bytes} [Tue Mar 29 02:08:45 2022] PUT /compute/v2.1/os-services/55d66127-386f-485b-bacc-166b16723808 => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:08:45.125768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d64095f-18de-49f0-9c1c-8c50a6f863eb tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] Action: 'update', calling method: .version_select at 0x7f872427ff70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:45.127980 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.127980 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:45.375367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:45.380205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ede2c490-eec1-4353-9c5d-ee74ca63226f tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1494 microversion: 2.1 time: 0.423591 Mar 29 02:08:45.381350 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 52/123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:44 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1494 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:45.387398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:45.388973 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.388973 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:45.390989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.392583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.394175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.394879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.446385 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a89f85c-d892-4a7e-b95f-18fa7454f0d9 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.063755 Mar 29 02:08:45.447476 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 53/124] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Mar 29 02:08:45 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:45.458105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e7d5a62c-6a7f-4136-bf6f-6b08427ab5ee req-42ea6037-832f-4a1c-b348-9a64b579c079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46", "name": "network-vif-deleted", "tag": "eed05dfd-b7e5-40ab-9d1a-4b77418b47bf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:45.459460 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.459460 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:45.476664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e7d5a62c-6a7f-4136-bf6f-6b08427ab5ee req-42ea6037-832f-4a1c-b348-9a64b579c079 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.478635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e7d5a62c-6a7f-4136-bf6f-6b08427ab5ee req-42ea6037-832f-4a1c-b348-9a64b579c079 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.497439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e7d5a62c-6a7f-4136-bf6f-6b08427ab5ee req-42ea6037-832f-4a1c-b348-9a64b579c079 service nova] Creating event network-vif-deleted:eed05dfd-b7e5-40ab-9d1a-4b77418b47bf for instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 on n-h2-828148-1 Mar 29 02:08:45.502782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e7d5a62c-6a7f-4136-bf6f-6b08427ab5ee req-42ea6037-832f-4a1c-b348-9a64b579c079 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048250 Mar 29 02:08:45.503485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 54/125] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:45.734743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d381544b-aba8-4857-a709-404982d1b82a tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1236007928", "id": 778682807, "os-flavor-access:is_public": "False"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:45.736071 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.736071 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:45.849124 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d381544b-aba8-4857-a709-404982d1b82a tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.344387 Mar 29 02:08:45.850744 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 55/126] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:45 2022] POST /compute/v2.1/flavors => generated 436 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:45.855691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:45.857313 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:45.857313 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:45.858831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.859363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.860402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.860944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.892735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d3bb91e-479a-4ecb-977b-f6c510195d7e tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.040626 Mar 29 02:08:45.897225 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 56/127] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 02:08:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1261 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:45.904195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:45.907620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:45.919028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.919473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:45.920247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:45.920706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.122424 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d64095f-18de-49f0-9c1c-8c50a6f863eb tempest-QuotaClassesAdminTestJSON-1714255505 tempest-QuotaClassesAdminTestJSON-1714255505-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.009509 Mar 29 02:08:46.123079 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 72/128] 10.222.0.36 () {60 vars in 1205 bytes} [Tue Mar 29 02:08:45 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:46.169778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b7b8eed-48cf-4a14-9c1c-335925f29ae2 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:46.172742 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:46.172742 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:46.426996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b7b8eed-48cf-4a14-9c1c-335925f29ae2 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/778682807/action" status: 200 len: 96 microversion: 2.1 time: 0.280778 Mar 29 02:08:46.428743 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 73/129] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Mar 29 02:08:46 2022] POST /compute/v2.1/flavors/778682807/action => generated 96 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:46.439082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:46.440737 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:46.440737 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:46.442927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.449250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.450577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.451020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.504161 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ed11b5e-3fc6-4af7-a932-59115e8eb557 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.073725 Mar 29 02:08:46.504962 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 74/130] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Mar 29 02:08:46 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:46.534797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:46.535407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:46.546497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.547573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.557949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.558659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.687238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. Mar 29 02:08:46.691412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:46.693809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c7e186f-c826-446c-a917-c592816b958e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 404 len: 111 microversion: 2.1 time: 0.173345 Mar 29 02:08:46.700981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 75/131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:46 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:46.706628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:46.709449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:46.737155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.737838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.738788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:46.741640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:46.861937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:46.877030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:46.885359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:46.895582 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-33c5a337-b373-4699-9769-6d3f867bb4dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.996384 Mar 29 02:08:46.907221 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 57/132] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:45 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:46.912459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98623c9f-635d-49d6-8ad1-b5ba8d8f8a23 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:46.926342 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:46.926342 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.376635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-98623c9f-635d-49d6-8ad1-b5ba8d8f8a23 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project 848f0d5358254e6dae6585d46e06c27d combination. Mar 29 02:08:47.377433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98623c9f-635d-49d6-8ad1-b5ba8d8f8a23 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project 848f0d5358254e6dae6585d46e06c27d combination. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:47.378401 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98623c9f-635d-49d6-8ad1-b5ba8d8f8a23 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/778682807/action" status: 409 len: 152 microversion: 2.1 time: 0.478028 Mar 29 02:08:47.379347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 58/133] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Mar 29 02:08:46 2022] POST /compute/v2.1/flavors/778682807/action => generated 152 bytes in 480 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:08:47.385442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:47.387373 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.387373 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.394779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.395344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.396225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.396751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.403299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:47.419884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d111676e-3f43-4b8e-9840-30b9627c6189 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1494 microversion: 2.1 time: 0.717385 Mar 29 02:08:47.421045 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 76/134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:46 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1494 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:47.430421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1519712173", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:47.441264 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03610db4-7190-4ef7-b102-7da8e9715056 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-828148-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.060830 Mar 29 02:08:47.443700 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 59/135] 10.222.0.36 () {60 vars in 1234 bytes} [Tue Mar 29 02:08:47 2022] GET /compute/v2.1/os-services?host=n-d-828148-1&binary=xxx => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:47.448820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47f965c7-13f2-429a-9f1f-ae2c53314a99 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:47.452640 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.452640 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.527398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:47.626159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47f965c7-13f2-429a-9f1f-ae2c53314a99 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/778682807/action" status: 200 len: 21 microversion: 2.1 time: 0.181948 Mar 29 02:08:47.632651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 60/136] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Mar 29 02:08:47 2022] POST /compute/v2.1/flavors/778682807/action => generated 21 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:47.637756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:47.639096 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.639096 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.640720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.641231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.644204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.644204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.678893 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c8ca2910-ab9b-4ebf-95af-d69651014f42 tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1261 microversion: 2.53 time: 0.048936 Mar 29 02:08:47.686603 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 61/137] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Mar 29 02:08:47 2022] GET /compute/v2.1/os-services => generated 1261 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:47.691729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edf615de-59eb-4933-bfe3-38fdb8cc284a tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:47.692512 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.692512 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.755826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edf615de-59eb-4933-bfe3-38fdb8cc284a tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/778682807" status: 202 len: 0 microversion: 2.1 time: 0.063365 Mar 29 02:08:47.756542 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 62/138] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:08:47 2022] DELETE /compute/v2.1/flavors/778682807 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:47.763219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:47.764926 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.764926 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.766997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.767438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.768293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.769026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.798238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8859af0f-9273-40ab-9c2e-840c456f2f3c tempest-ServicesAdminNegativeV253TestJSON-763337550 tempest-ServicesAdminNegativeV253TestJSON-763337550-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040209 Mar 29 02:08:47.804779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 63/139] 10.222.0.36 () {60 vars in 1238 bytes} [Tue Mar 29 02:08:47 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:47.805932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-971d7868-afc7-44c1-b0cf-ff06ebe7bf6d tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:47.837112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-971d7868-afc7-44c1-b0cf-ff06ebe7bf6d tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036793 Mar 29 02:08:47.839170 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 64/140] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:47.853777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a094bc71-3672-4cf8-aea9-e439c85681e2 req-1974a079-a9ca-4abf-bc07-1d7da9afc4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7edbe663-89cb-45c7-843c-41bf12957d7a", "name": "network-vif-deleted", "tag": "e495833e-6afc-4b1f-a1ff-223f2e42210e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:47.853777 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:47.853777 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:47.857883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a094bc71-3672-4cf8-aea9-e439c85681e2 req-1974a079-a9ca-4abf-bc07-1d7da9afc4e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:47.858931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a094bc71-3672-4cf8-aea9-e439c85681e2 req-1974a079-a9ca-4abf-bc07-1d7da9afc4e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:47.882904 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a094bc71-3672-4cf8-aea9-e439c85681e2 req-1974a079-a9ca-4abf-bc07-1d7da9afc4e7 service nova] Creating event network-vif-deleted:e495833e-6afc-4b1f-a1ff-223f2e42210e for instance 7edbe663-89cb-45c7-843c-41bf12957d7a on n-h2-828148-1 Mar 29 02:08:47.890493 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a094bc71-3672-4cf8-aea9-e439c85681e2 req-1974a079-a9ca-4abf-bc07-1d7da9afc4e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050033 Mar 29 02:08:47.892389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 65/141] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:48.109598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-270a5789-b39f-40da-bf3c-76ce414aee20 tempest-ServicesAdminNegativeV253TestJSON-1937871579 tempest-ServicesAdminNegativeV253TestJSON-1937871579-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.110999 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:48.110999 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:48.112626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-270a5789-b39f-40da-bf3c-76ce414aee20 tempest-ServicesAdminNegativeV253TestJSON-1937871579 tempest-ServicesAdminNegativeV253TestJSON-1937871579-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'bd348c8bad764da9bd5c5edc55fa5e4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ee55d9b428f4b38aa18a8e146d23360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:48.114243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-270a5789-b39f-40da-bf3c-76ce414aee20 tempest-ServicesAdminNegativeV253TestJSON-1937871579 tempest-ServicesAdminNegativeV253TestJSON-1937871579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:48.115297 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-270a5789-b39f-40da-bf3c-76ce414aee20 tempest-ServicesAdminNegativeV253TestJSON-1937871579 tempest-ServicesAdminNegativeV253TestJSON-1937871579-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.221692 Mar 29 02:08:48.116531 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 66/142] 10.222.0.36 () {60 vars in 1177 bytes} [Tue Mar 29 02:08:47 2022] GET /compute/v2.1/os-services => generated 112 bytes in 223 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:08:48.129194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:48.129687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:48.130292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:48.130602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ef7bf5c-ed9b-43d0-a390-557b5e7a6e99 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-34352254", "id": 1958654280, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:48.130739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:48.131148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:48.133000 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:48.133000 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:48.147435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.147873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.150887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.151522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.208518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Getting quotas for project 48d5c6c7d3ff402db72fada2a0083d87. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:48.223162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Getting quotas for user e130c0deae154519887add62142d7cac and project 48d5c6c7d3ff402db72fada2a0083d87. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:48.231296 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ef7bf5c-ed9b-43d0-a390-557b5e7a6e99 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.113425 Mar 29 02:08:48.231996 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 67/143] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:48 2022] POST /compute/v2.1/flavors => generated 436 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:48.238644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.240481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:48.251514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.252520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.253523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.254287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.259541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:08:48.264052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:08:48.432068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b0d7338-81ce-41d4-8e09-b1ba0d6f2d1d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005608 Mar 29 02:08:48.433643 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 77/144] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:08:48.449579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-096ba05b-f4f9-4e0b-a5a5-3e43c1cec820 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.450371 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:48.450371 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:48.476443 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-096ba05b-f4f9-4e0b-a5a5-3e43c1cec820 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] HTTP exception thrown: Access list not available for public flavors. Mar 29 02:08:48.478410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-096ba05b-f4f9-4e0b-a5a5-3e43c1cec820 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:48.479800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-096ba05b-f4f9-4e0b-a5a5-3e43c1cec820 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1958654280/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.033849 Mar 29 02:08:48.481092 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 78/145] 10.222.0.36 () {58 vars in 1208 bytes} [Tue Mar 29 02:08:48 2022] GET /compute/v2.1/flavors/1958654280/os-flavor-access => generated 91 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:08:48.488345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.489332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:48.500138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.500807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.502137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.502714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.648107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:48.648794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:48.649555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lazy-loading 'fault' on Instance uuid 7edbe663-89cb-45c7-843c-41bf12957d7a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:08:48.801499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:48.813429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:48.816180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:48.820094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4641a48-954c-48bb-8549-a06ff46b52f0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.586826 Mar 29 02:08:48.823894 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 68/146] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:48 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:48.836678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-97e395f2-b8bc-46bc-a88c-939625b9f703 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.837640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-97e395f2-b8bc-46bc-a88c-939625b9f703 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:48.883223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '49f10dace9144930b80ee7d0aca09772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e1ab6d9264d4787b326c98d4720cd5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:48.895027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3780be99-4bd3-4104-b185-57b1c89d96cf tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 200 len: 1329 microversion: 2.1 time: 0.410248 Mar 29 02:08:48.910691 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 79/147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:48 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 1329 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:48.915693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b280c957-1565-4df6-ba60-4807e9988004 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:48.922141 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:48.922141 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:49.005550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-97e395f2-b8bc-46bc-a88c-939625b9f703 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:49.018968 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-97e395f2-b8bc-46bc-a88c-939625b9f703 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1220 microversion: 2.1 time: 0.193529 Mar 29 02:08:49.020403 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 69/148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:48 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:49.080812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b280c957-1565-4df6-ba60-4807e9988004 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1958654280" status: 202 len: 0 microversion: 2.1 time: 0.168734 Mar 29 02:08:49.085138 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 80/149] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:08:48 2022] DELETE /compute/v2.1/flavors/1958654280 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:49.115660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b22308bd-59e8-4696-8dbd-67de51bf8288 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:49.185899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b22308bd-59e8-4696-8dbd-67de51bf8288 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087466 Mar 29 02:08:49.187477 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 70/150] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:49.203299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18ab3458-c6cf-4057-aa20-b14a351f96ee tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1602458554", "id": 965971372, "os-flavor-access:is_public": "False"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:49.205054 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:49.205054 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:49.326230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18ab3458-c6cf-4057-aa20-b14a351f96ee tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.127554 Mar 29 02:08:49.335366 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 81/151] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:49.736684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1a299b9-7f9f-4426-8f02-2283b86f86ba tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:49.739116 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:49.739116 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:49.740736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1a299b9-7f9f-4426-8f02-2283b86f86ba tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '3456ad9fc90143e8ad3c6160bdb2c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848f0d5358254e6dae6585d46e06c27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:49.741827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1a299b9-7f9f-4426-8f02-2283b86f86ba tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:49.742976 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1a299b9-7f9f-4426-8f02-2283b86f86ba tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] 10.222.0.36 "POST /compute/v2.1/flavors/965971372/action" status: 403 len: 130 microversion: 2.1 time: 0.408397 Mar 29 02:08:49.748629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 71/152] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Mar 29 02:08:49 2022] POST /compute/v2.1/flavors/965971372/action => generated 130 bytes in 414 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:08:49.754082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-175f1d92-80e3-40d4-bbc2-a2c9d71fd78e tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:49.840606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:49.841199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:49.850806 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-175f1d92-80e3-40d4-bbc2-a2c9d71fd78e tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/965971372" status: 202 len: 0 microversion: 2.1 time: 0.100888 Mar 29 02:08:49.852103 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 82/153] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:08:49 2022] DELETE /compute/v2.1/flavors/965971372 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:08:49.852644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:49.853372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:49.854384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:49.855357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:49.861144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e830a590-eabf-4fc5-9aab-780a1b528c55 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:49.886197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e830a590-eabf-4fc5-9aab-780a1b528c55 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029950 Mar 29 02:08:49.887081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 83/154] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:49.907163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00443c25-eaaf-4976-944b-3a2fc6c247f6 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1217525821", "id": 1097973371, "os-flavor-access:is_public": "False"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:49.985906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00443c25-eaaf-4976-944b-3a2fc6c247f6 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.083036 Mar 29 02:08:49.986800 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 84/155] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:49 2022] POST /compute/v2.1/flavors => generated 439 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:49.991276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:49.992855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:50.001512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:50.002287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:50.003203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:50.003787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:50.062846 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] HTTP exception thrown: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. Mar 29 02:08:50.063466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Returning 404 to user: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:50.064286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6bb0d13-4d4c-4dc9-88d9-30b23c1f8648 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 404 len: 111 microversion: 2.1 time: 0.076445 Mar 29 02:08:50.065178 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 85/156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:49 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:50.071149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-801318c2-5c7a-4266-aa62-39c61e6d0fbe tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:50.073170 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:add_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:50.073170 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:50.542124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-801318c2-5c7a-4266-aa62-39c61e6d0fbe tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1097973371/action" status: 200 len: 97 microversion: 2.1 time: 0.475072 Mar 29 02:08:50.543278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 86/157] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Mar 29 02:08:50 2022] POST /compute/v2.1/flavors/1097973371/action => generated 97 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:08:50.549435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:50.550337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:50.567363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:50.568526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:50.571886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:50.573159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:50.584773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:50.597604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:50.599150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:50.611044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2c7709d-3d90-4eaf-be2e-d32d0b20a176 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.764406 Mar 29 02:08:50.611044 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 72/158] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:49 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:08:50.616071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-935c0454-a44f-4929-98ba-9a9083d94eec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:50.617823 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:50.617823 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:50.629192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935c0454-a44f-4929-98ba-9a9083d94eec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:50.629880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935c0454-a44f-4929-98ba-9a9083d94eec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:50.999543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:51.010507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4285f036-bfb6-494f-b255-2c5bbbf75fee tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1294 microversion: 2.1 time: 0.465670 Mar 29 02:08:51.011083 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 87/159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:50 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1294 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:51.040217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72d8d408-721f-4fd7-9b39-04ca49f12bcc tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:51.045284 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.045284 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:51.049424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-72d8d408-721f-4fd7-9b39-04ca49f12bcc tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '3456ad9fc90143e8ad3c6160bdb2c86f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '848f0d5358254e6dae6585d46e06c27d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:51.050291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72d8d408-721f-4fd7-9b39-04ca49f12bcc tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:51.054957 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72d8d408-721f-4fd7-9b39-04ca49f12bcc tempest-FlavorsAccessNegativeTestJSON-1866815255 tempest-FlavorsAccessNegativeTestJSON-1866815255-project] 10.222.0.36 "POST /compute/v2.1/flavors/1097973371/action" status: 403 len: 133 microversion: 2.1 time: 0.039192 Mar 29 02:08:51.057273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 88/160] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Mar 29 02:08:51 2022] POST /compute/v2.1/flavors/1097973371/action => generated 133 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:51.069560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dab96baf-67b4-401d-9be7-08012ae37787 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "848f0d5358254e6dae6585d46e06c27d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:51.070699 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-935c0454-a44f-4929-98ba-9a9083d94eec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 300 microversion: 2.1 time: 0.468802 Mar 29 02:08:51.074211 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 73/161] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 300 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:51.084181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59f03d53-4a4d-407f-bbaa-4580654bf574 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:51.086144 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.086144 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:51.242262 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59f03d53-4a4d-407f-bbaa-4580654bf574 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.162950 Mar 29 02:08:51.243215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 74/162] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:08:51.259325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a51ac87-965a-4708-8f90-6d552bf248e4 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-507638737"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:51.260889 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.260889 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:51.262089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-7a51ac87-965a-4708-8f90-6d552bf248e4 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid 11a0921f-3a76-4b8b-8371-ffc2a4d481ce for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:51.426438 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a51ac87-965a-4708-8f90-6d552bf248e4 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.170654 Mar 29 02:08:51.431343 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 75/163] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:08:51 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:51.441064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18058d2a-c2fd-408a-8cc8-b56539907a9b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:51.442648 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.442648 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:51.472230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18058d2a-c2fd-408a-8cc8-b56539907a9b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:51.473011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18058d2a-c2fd-408a-8cc8-b56539907a9b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:51.565492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dab96baf-67b4-401d-9be7-08012ae37787 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1097973371/action" status: 200 len: 21 microversion: 2.1 time: 0.500020 Mar 29 02:08:51.573422 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 89/164] 10.222.0.36 () {60 vars in 1199 bytes} [Tue Mar 29 02:08:51 2022] POST /compute/v2.1/flavors/1097973371/action => generated 21 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:08:51.580553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72e09ea1-c4b9-4eed-8849-8fcc4b1ae72d tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:51.582853 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.582853 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:51.658694 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72e09ea1-c4b9-4eed-8849-8fcc4b1ae72d tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1097973371" status: 202 len: 0 microversion: 2.1 time: 0.083270 Mar 29 02:08:51.659681 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 90/165] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:08:51 2022] DELETE /compute/v2.1/flavors/1097973371 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:51.682196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:51.682654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:51.698719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:51.700447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:51.700447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:51.700447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:51.852062 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18058d2a-c2fd-408a-8cc8-b56539907a9b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.418631 Mar 29 02:08:51.852725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 76/166] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:51 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:08:51.858581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82846b3a-a6d6-41ba-bfe2-a47cc53ef214 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:51.912026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82846b3a-a6d6-41ba-bfe2-a47cc53ef214 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058173 Mar 29 02:08:51.913288 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 77/167] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:51.918247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9ab2f2a-28f2-44c4-91aa-997d07fd9a5e tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:51.919914 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.919914 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:51.939966 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9ab2f2a-28f2-44c4-91aa-997d07fd9a5e tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.025107 Mar 29 02:08:51.941400 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 78/168] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:08:51 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:51.948235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b36bdb84-5cb8-4980-ba3f-ede5203d3d27 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1659437306", "id": 288270889, "os-flavor-access:is_public": "False"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:51.950180 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:51.950180 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:52.057187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b36bdb84-5cb8-4980-ba3f-ede5203d3d27 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.114045 Mar 29 02:08:52.057777 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 79/169] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:51 2022] POST /compute/v2.1/flavors => generated 436 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:52.064071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6ba99b4-16c2-4f8c-9450-b4b5d0b6582c tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:52.066074 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:52.066074 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:52.085555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ba99b4-16c2-4f8c-9450-b4b5d0b6582c tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:52.085555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ba99b4-16c2-4f8c-9450-b4b5d0b6582c tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:52.448519 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6ba99b4-16c2-4f8c-9450-b4b5d0b6582c tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.388925 Mar 29 02:08:52.461296 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 80/170] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:52.461296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:52.461296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:52.463762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:52.464206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:52.465023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:52.465485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:52.641618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:52.650561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:52.657174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:52.660828 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-481e5e9f-1a28-4fdf-8bd2-74d2feb243c9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.993581 Mar 29 02:08:52.662214 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 91/171] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:51 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:52.675965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e2cde44-8aa6-488e-83d2-942f1bef02ad tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1ef79b6777a94f4e8212b1ce4f2b008b"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:52.677306 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-access:remove_tenant_access failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:52.677306 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:52.708169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:52.724355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64246478-4142-4f7f-b18c-90e6e934afc3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1278 microversion: 2.1 time: 0.273618 Mar 29 02:08:52.734324 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 81/172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:52 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1278 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:52.738334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-94dd2e95-e91a-44f6-bbea-36a4732b16b9 req-39ba7f12-b119-4e64-80e1-c19a9cdfd26c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e8a0c5-a941-47af-b28c-c046992c73c3", "tag": "41aa3791-d19b-4bc0-ab29-529b6db14c53"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:52.740048 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:52.740048 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:52.754016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-94dd2e95-e91a-44f6-bbea-36a4732b16b9 req-39ba7f12-b119-4e64-80e1-c19a9cdfd26c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:52.754546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-94dd2e95-e91a-44f6-bbea-36a4732b16b9 req-39ba7f12-b119-4e64-80e1-c19a9cdfd26c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:52.790096 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-94dd2e95-e91a-44f6-bbea-36a4732b16b9 req-39ba7f12-b119-4e64-80e1-c19a9cdfd26c service nova] Creating event network-changed:41aa3791-d19b-4bc0-ab29-529b6db14c53 for instance 28e8a0c5-a941-47af-b28c-c046992c73c3 on n-h1-828148-1 Mar 29 02:08:52.810616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-94dd2e95-e91a-44f6-bbea-36a4732b16b9 req-39ba7f12-b119-4e64-80e1-c19a9cdfd26c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084104 Mar 29 02:08:52.811569 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 82/173] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:52.819235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99928457-182f-43f0-8944-21088217c7b7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:52.819235 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:52.819235 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:52.934090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99928457-182f-43f0-8944-21088217c7b7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.121321 Mar 29 02:08:52.939523 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 83/174] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:52 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:08:52.951204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-446e2430-5010-44cc-addf-7730c5d462c1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2056379536"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:52.952568 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:52.952568 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:52.954571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-446e2430-5010-44cc-addf-7730c5d462c1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid a9d90caf-d33f-460b-be11-4d04433ccb20 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:53.083822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-446e2430-5010-44cc-addf-7730c5d462c1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.136405 Mar 29 02:08:53.086005 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 84/175] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:08:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:53.097663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-381d664f-7ddb-4ee0-ad4d-ca0e05e429d1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:53.099858 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:53.099858 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:53.100891 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4e2cde44-8aa6-488e-83d2-942f1bef02ad tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] HTTP exception thrown: Flavor access not found for 21 / 1ef79b6777a94f4e8212b1ce4f2b008b combination. Mar 29 02:08:53.101507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e2cde44-8aa6-488e-83d2-942f1bef02ad tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Returning 404 to user: Flavor access not found for 21 / 1ef79b6777a94f4e8212b1ce4f2b008b combination. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:53.102334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e2cde44-8aa6-488e-83d2-942f1bef02ad tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/288270889/action" status: 404 len: 124 microversion: 2.1 time: 0.438932 Mar 29 02:08:53.102891 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 92/176] 10.222.0.36 () {60 vars in 1196 bytes} [Tue Mar 29 02:08:52 2022] POST /compute/v2.1/flavors/288270889/action => generated 124 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:53.121547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87fbaa3a-d49a-4292-bad7-e3d63615246f tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:53.125069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-381d664f-7ddb-4ee0-ad4d-ca0e05e429d1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:53.125759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-381d664f-7ddb-4ee0-ad4d-ca0e05e429d1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:53.127602 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:53.127602 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:53.246634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87fbaa3a-d49a-4292-bad7-e3d63615246f tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/288270889" status: 202 len: 0 microversion: 2.1 time: 0.133259 Mar 29 02:08:53.247228 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 93/177] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:08:53 2022] DELETE /compute/v2.1/flavors/288270889 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:08:53.255400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52be8efa-6b0a-4c03-ad55-6be912dbbe24 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:53.288751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-52be8efa-6b0a-4c03-ad55-6be912dbbe24 tempest-FlavorsAccessNegativeTestJSON-218597328 tempest-FlavorsAccessNegativeTestJSON-218597328-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036722 Mar 29 02:08:53.289967 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 94/178] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:08:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:53.443930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-381d664f-7ddb-4ee0-ad4d-ca0e05e429d1 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.352138 Mar 29 02:08:53.450291 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 85/179] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:53.456214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-47b549f4-3110-4407-843d-f0b79a5c736d tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:53.457120 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:53.457120 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:53.474686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-47b549f4-3110-4407-843d-f0b79a5c736d tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.023292 Mar 29 02:08:53.477182 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 95/180] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:08:53 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:53.487157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-92ab8377-946b-4113-8e6d-46089bcc63f7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:53.488781 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:53.488781 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:53.514821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92ab8377-946b-4113-8e6d-46089bcc63f7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:53.514821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92ab8377-946b-4113-8e6d-46089bcc63f7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:53.680266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:53.681015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:53.694839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:53.695290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:53.696079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:53.696510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:54.116432 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-92ab8377-946b-4113-8e6d-46089bcc63f7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.634260 Mar 29 02:08:54.121323 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 86/181] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:54.153991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:54.158853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:54.182956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:54.184564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:54.188558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:54.189224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:54.446469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:54.465953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:54.467834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:54.471251 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23e77a0f-308e-4c44-8442-873bed440242 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.794708 Mar 29 02:08:54.481875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 96/182] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:53 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:54.493111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-817c576b-c4e7-4215-ac02-46238360b3a7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:54.500729 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:54.500729 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:54.662894 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-817c576b-c4e7-4215-ac02-46238360b3a7 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.179669 Mar 29 02:08:54.663471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 97/183] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:54 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:08:54.986454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:54.996674 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0ea582b-85a5-4682-a762-58c1c502f02c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.871963 Mar 29 02:08:54.999816 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 87/184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:54 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:55.013570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fa02dbf-74f4-4e3a-94db-64f1f9e2fbc5 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1695804723"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:55.017570 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:55.017570 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:55.018915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-2fa02dbf-74f4-4e3a-94db-64f1f9e2fbc5 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid 0a467113-b591-4143-b5b8-d664a6341d70 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:55.138511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fa02dbf-74f4-4e3a-94db-64f1f9e2fbc5 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.137419 Mar 29 02:08:55.141781 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 88/185] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:08:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:55.152855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53d9e4e6-0d22-42dc-8d7c-1d8086ec6fec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:55.154793 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:55.154793 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:55.169477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d9e4e6-0d22-42dc-8d7c-1d8086ec6fec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:55.170433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d9e4e6-0d22-42dc-8d7c-1d8086ec6fec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:55.227681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1567237069", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:55.306418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:08:55.466214 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53d9e4e6-0d22-42dc-8d7c-1d8086ec6fec tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.317679 Mar 29 02:08:55.467117 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 89/186] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:55.490479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e32a7c6b-b9cb-4c79-b7ef-93ea4ab8a629 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:55.494941 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:55.494941 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:55.513769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32a7c6b-b9cb-4c79-b7ef-93ea4ab8a629 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:55.514159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32a7c6b-b9cb-4c79-b7ef-93ea4ab8a629 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:55.871454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e32a7c6b-b9cb-4c79-b7ef-93ea4ab8a629 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.397330 Mar 29 02:08:55.872807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 90/187] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:55 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:55.881420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:55.882379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:55.891280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:55.892114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:55.893151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:55.893681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:56.134921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:56.145145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:56.146654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:56.147734 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf7295c6-9903-4231-be7e-8b6412c1c891 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.273581 Mar 29 02:08:56.148751 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 91/188] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:55 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:56.151703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:08:56.153307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:08:56.154001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:08:56.155336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:08:56.155985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:08:56.168563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:56.168563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:56.169763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:56.170257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:56.194302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Getting quotas for project 2a2cd5074a3e4fb4a8f929e433838fd5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:08:56.199358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Getting quotas for user ab245fc80a314ce9aec1d926d45da3bc and project 2a2cd5074a3e4fb4a8f929e433838fd5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:08:56.213268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:08:56.215792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:08:56.415678 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80085ab6-c2ff-47a2-9a2b-67ba22ae2f9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750598 Mar 29 02:08:56.421775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 98/189] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:08:56.426886 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aaf76024-bc7a-427c-af6d-5bbb33696205 tempest-TenantUsagesNegativeTestJSON-1454945399 tempest-TenantUsagesNegativeTestJSON-1454945399-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-28T02%3A08%3A55.544103&end=2022-03-30T02%3A08%3A55.544103" status: 404 len: 112 microversion: - time: 0.275484 Mar 29 02:08:56.427262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4f9ef50-4af2-4c78-b369-0bbe55d2ee9f tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:56.428514 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:56.428514 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:56.429374 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 92/190] 10.222.0.36 () {58 vars in 1315 bytes} [Tue Mar 29 02:08:56 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-03-28T02%3A08%3A55.544103&end=2022-03-30T02%3A08%3A55.544103 => generated 112 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 29 02:08:56.435346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:56.436037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:56.456430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:56.456914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:56.457892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:56.458325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:56.599105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4f9ef50-4af2-4c78-b369-0bbe55d2ee9f tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.176181 Mar 29 02:08:56.603133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 99/191] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:08:56.607071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6a60b725-b454-4907-b503-6e76c3d02f30 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:56.609988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6a60b725-b454-4907-b503-6e76c3d02f30 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:56.750060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:56.758909 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82e7e18a-2aa4-426a-8782-b961ea80753a tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.328434 Mar 29 02:08:56.760159 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 93/192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:56 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:56.772430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3ce6361-f869-47b1-b336-a5ad596f2a2a tempest-TenantUsagesNegativeTestJSON-1454945399 tempest-TenantUsagesNegativeTestJSON-1454945399-project-admin] Calling method '.version_select at 0x7f8724464430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:56.777691 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e3ce6361-f869-47b1-b336-a5ad596f2a2a tempest-TenantUsagesNegativeTestJSON-1454945399 tempest-TenantUsagesNegativeTestJSON-1454945399-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Mar 29 02:08:56.778287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3ce6361-f869-47b1-b336-a5ad596f2a2a tempest-TenantUsagesNegativeTestJSON-1454945399 tempest-TenantUsagesNegativeTestJSON-1454945399-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:56.779094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3ce6361-f869-47b1-b336-a5ad596f2a2a tempest-TenantUsagesNegativeTestJSON-1454945399 tempest-TenantUsagesNegativeTestJSON-1454945399-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/3632d083fb90428b9d8c86b375c4b678?start=2022-03-30T02%3A08%3A55.544103&end=2022-03-28T02%3A08%3A55.544103" status: 400 len: 111 microversion: 2.1 time: 0.018729 Mar 29 02:08:56.780650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 94/193] 10.222.0.36 () {58 vars in 1411 bytes} [Tue Mar 29 02:08:56 2022] GET /compute/v2.1/os-simple-tenant-usage/3632d083fb90428b9d8c86b375c4b678?start=2022-03-30T02%3A08%3A55.544103&end=2022-03-28T02%3A08%3A55.544103 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:08:56.789190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44e2e6fd-a88e-4a90-bb5b-4dad1acd15f3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1650274819"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:56.792256 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:56.792256 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:56.792422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-44e2e6fd-a88e-4a90-bb5b-4dad1acd15f3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid f3b63d8c-a907-40c6-a0d9-2e946ff49f91 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:56.894931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44e2e6fd-a88e-4a90-bb5b-4dad1acd15f3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.112932 Mar 29 02:08:56.900784 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 95/194] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:08:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:56.904475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cc67525f-eb98-4931-965e-b4df9432f2c0 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1382414242"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:56.906399 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:56.906399 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:56.907705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-cc67525f-eb98-4931-965e-b4df9432f2c0 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid e6d67b49-bca5-414e-83d8-16faac720c51 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:56.944155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6a60b725-b454-4907-b503-6e76c3d02f30 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:56.953232 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6a60b725-b454-4907-b503-6e76c3d02f30 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1223 microversion: 2.1 time: 0.350933 Mar 29 02:08:56.953981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 100/195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:56 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1223 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:57.003056 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cc67525f-eb98-4931-965e-b4df9432f2c0 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.106495 Mar 29 02:08:57.003992 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 96/196] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:08:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:57.011976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a069f4b2-b55f-4f4e-97ee-cb9156c2d3e6 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:57.013251 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:57.013251 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:57.185584 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a069f4b2-b55f-4f4e-97ee-cb9156c2d3e6 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.180186 Mar 29 02:08:57.192051 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 97/197] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:08:57.194788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b5dab38-620e-428a-9088-f946398d7207 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:57.197933 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:57.197933 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:57.211764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b5dab38-620e-428a-9088-f946398d7207 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:57.217655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b5dab38-620e-428a-9088-f946398d7207 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:57.250283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e5d8eae-2886-4bf1-a2a6-6339206559dd tempest-TenantUsagesNegativeTestJSON-1003681206 tempest-TenantUsagesNegativeTestJSON-1003681206-project] Calling method '.version_select at 0x7f8724d6a670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:57.250812 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:57.250812 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:08:57.252946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e5d8eae-2886-4bf1-a2a6-6339206559dd tempest-TenantUsagesNegativeTestJSON-1003681206 tempest-TenantUsagesNegativeTestJSON-1003681206-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'b5907663d82748bdb0852a68ebe7dcf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3632d083fb90428b9d8c86b375c4b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:57.254427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e5d8eae-2886-4bf1-a2a6-6339206559dd tempest-TenantUsagesNegativeTestJSON-1003681206 tempest-TenantUsagesNegativeTestJSON-1003681206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:57.255489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e5d8eae-2886-4bf1-a2a6-6339206559dd tempest-TenantUsagesNegativeTestJSON-1003681206 tempest-TenantUsagesNegativeTestJSON-1003681206-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-28T02%3A08%3A55.544103&end=2022-03-30T02%3A08%3A55.544103&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.300368 Mar 29 02:08:57.256263 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 101/198] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Mar 29 02:08:56 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-28T02%3A08%3A55.544103&end=2022-03-30T02%3A08%3A55.544103&detailed=1 => generated 123 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:08:57.360695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf15aa50-aaa9-44cb-abd3-de3077121372 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Action: 'create', calling method: .version_select at 0x7f8725655e50>, body: {"pool": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:57.547278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b5dab38-620e-428a-9088-f946398d7207 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.358696 Mar 29 02:08:57.549947 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 98/199] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:57.553872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:57.554627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:57.563137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:57.563587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:57.564359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:57.564786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:57.829506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:57.839172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:57.840740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:57.841861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6aa558c5-d144-4d75-95bc-e9001e2c0d2d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.292663 Mar 29 02:08:57.842427 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 99/200] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:57 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:08:57.847168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70711110-0ad5-40f5-8f73-9bad7016cc43 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:57.848068 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:57.848068 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:57.880344 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-70711110-0ad5-40f5-8f73-9bad7016cc43 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 29 02:08:57.881093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70711110-0ad5-40f5-8f73-9bad7016cc43 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:57.881918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-70711110-0ad5-40f5-8f73-9bad7016cc43 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.038225 Mar 29 02:08:57.882976 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 100/201] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:08:57 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:08:57.888544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:57.890912 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:57.890912 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:57.903132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:57.903802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.023052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Aggregate 7 already has host n-h2-828148-1. Mar 29 02:08:58.030601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 409 to user: Aggregate 7 already has host n-h2-828148-1. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:58.030601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6fe1d82e-da43-47f5-91bf-0f51bcc08db5 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.140665 Mar 29 02:08:58.030601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 101/202] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:57 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Mar 29 02:08:58.031921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:58.033492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:58.052588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.054457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.055560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.059384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.436466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:58.452091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-408dfd3e-ebd4-48a4-92b2-460012026cfe tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.424566 Mar 29 02:08:58.454507 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 102/203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:58 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:58.465110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2848637-e72a-49d5-a54d-a41ddfe34d6a tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:58.465996 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:58.465996 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:58.498531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e2848637-e72a-49d5-a54d-a41ddfe34d6a tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Mar 29 02:08:58.499447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2848637-e72a-49d5-a54d-a41ddfe34d6a tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:08:58.500559 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2848637-e72a-49d5-a54d-a41ddfe34d6a tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.044063 Mar 29 02:08:58.502441 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 103/204] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:08:58 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:08:58.518106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:58.518933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:58.530973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.531955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.536643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.536643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.702758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:58.712462 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f52b1727-1d30-4a4f-b9e0-2f1775acd43a tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1275 microversion: 2.1 time: 0.205834 Mar 29 02:08:58.722680 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 104/205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:08:58 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1275 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:08:58.722680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-10d1d652-5f9b-4df8-b2fc-b337ee4fdaa7 req-1b1da07c-3fa0-42fe-9965-3f1b67f3135f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b011c6-7242-49d3-88cb-f78e2b59a91d", "tag": "e54b18e4-6f12-4292-9b97-415c0e360ef4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:58.722680 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:58.722680 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:58.733008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-10d1d652-5f9b-4df8-b2fc-b337ee4fdaa7 req-1b1da07c-3fa0-42fe-9965-3f1b67f3135f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.733750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-10d1d652-5f9b-4df8-b2fc-b337ee4fdaa7 req-1b1da07c-3fa0-42fe-9965-3f1b67f3135f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:58.762222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-10d1d652-5f9b-4df8-b2fc-b337ee4fdaa7 req-1b1da07c-3fa0-42fe-9965-3f1b67f3135f service nova] Creating event network-changed:e54b18e4-6f12-4292-9b97-415c0e360ef4 for instance 03b011c6-7242-49d3-88cb-f78e2b59a91d on n-h2-828148-1 Mar 29 02:08:58.769661 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-10d1d652-5f9b-4df8-b2fc-b337ee4fdaa7 req-1b1da07c-3fa0-42fe-9965-3f1b67f3135f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054059 Mar 29 02:08:58.770492 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 105/206] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:58.776449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9108532-63b0-4d3b-80d0-af34188ef3e2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:58.778081 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:58.778081 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:58.790887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9108532-63b0-4d3b-80d0-af34188ef3e2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:58.791606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9108532-63b0-4d3b-80d0-af34188ef3e2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:59.112664 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9108532-63b0-4d3b-80d0-af34188ef3e2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.340385 Mar 29 02:08:59.113439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 106/207] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:08:58 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:59.125287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-973cb131-d926-42de-ae5c-ccd97721517f tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1722882968", "name": "tempest-test_aggregate-1128463150"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:08:59.151959 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:08:59.151959 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:08:59.155346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-973cb131-d926-42de-ae5c-ccd97721517f tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid 40cd9712-67a9-41cc-a8cf-e6d3a6492532 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:08:59.272436 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-973cb131-d926-42de-ae5c-ccd97721517f tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.151665 Mar 29 02:08:59.279074 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 107/208] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Mar 29 02:08:59 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:08:59.282264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:08:59.283004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:08:59.290730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:59.291642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:59.293064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:08:59.293650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:08:59.968552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:59.987833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:59.993678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:08:59.995172 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01b57db0-52f5-48c1-acd2-9f15ddfe2cb2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.720509 Mar 29 02:09:00.010675 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 108/209] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:08:59 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:00.010675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fcce7d2-3cda-43a5-a8a2-fa5be4aeb7b3 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:00.010675 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:00.010675 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:00.108560 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6fcce7d2-3cda-43a5-a8a2-fa5be4aeb7b3 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.106593 Mar 29 02:09:00.109500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 109/210] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:00 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:00.119008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3f6f281-9099-4d91-8f54-11ebcfb60c86 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:00.119841 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:00.119841 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:00.203424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3f6f281-9099-4d91-8f54-11ebcfb60c86 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.092733 Mar 29 02:09:00.204779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 110/211] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:00 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:00.209264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:00.211189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:00.229912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:00.232205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:00.234852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:00.236779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:00.782807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:00.792952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71684a01-241c-4da2-8f16-09e9c528e2d4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.586932 Mar 29 02:09:00.793539 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 111/212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:00 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:00.809527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:00.814778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:00.829854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:00.830233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:00.831024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:00.831470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:01.044672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:01.054525 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e28a1b2f-b810-401b-8b13-659d3e6bcc60 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1281 microversion: 2.1 time: 0.250098 Mar 29 02:09:01.055106 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 112/213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:00 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1281 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:01.072702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adc4da05-6a21-4c2c-9da2-bc8aa8026ef7 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1017457595"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:01.074105 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.074105 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:01.084623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-adc4da05-6a21-4c2c-9da2-bc8aa8026ef7 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 7e89f106-0448-45ac-b45d-b6a7a4f13e5a for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:01.164569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adc4da05-6a21-4c2c-9da2-bc8aa8026ef7 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097477 Mar 29 02:09:01.170965 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 113/214] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:01.176353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8103baf2-3e38-49b1-af27-ef5bab026cb2 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:01.181119 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.181119 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:01.207959 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-8103baf2-3e38-49b1-af27-ef5bab026cb2 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Mar 29 02:09:01.214469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8103baf2-3e38-49b1-af27-ef5bab026cb2 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:01.215676 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8103baf2-3e38-49b1-af27-ef5bab026cb2 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.043293 Mar 29 02:09:01.217986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 114/215] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:09:01 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:01.228820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:01.229475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:01.246095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:01.246577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:01.247391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:01.249592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:01.508624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf15aa50-aaa9-44cb-abd3-de3077121372 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.249795 Mar 29 02:09:01.509244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 102/216] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:08:57 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:01.723555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:01.735495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:01.737135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:01.742023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a369437c-ae7e-47d3-97e4-2181cb9b5825 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.514338 Mar 29 02:09:01.742023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 115/217] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:01 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:01.746564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2011827-5f25-48b0-ab4b-b228139696e3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:01.747494 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.747494 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:01.763071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9da02702-e1e7-4051-af62-cf09d21236f5 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:01.765117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d2011827-5f25-48b0-ab4b-b228139696e3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] HTTP exception thrown: Aggregate 8 could not be found. Mar 29 02:09:01.766353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2011827-5f25-48b0-ab4b-b228139696e3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:01.767384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2011827-5f25-48b0-ab4b-b228139696e3 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.026478 Mar 29 02:09:01.768265 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 116/218] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:01 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:01.768731 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.768731 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:01.769792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9da02702-e1e7-4051-af62-cf09d21236f5 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:01.775276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9da02702-e1e7-4051-af62-cf09d21236f5 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:01.775276 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9da02702-e1e7-4051-af62-cf09d21236f5 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.261139 Mar 29 02:09:01.775276 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 103/219] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Mar 29 02:09:01 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 262 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:01.775579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d87e06ee-2fea-4270-8761-9ef4884e66e9 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8724d1ba60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:01.795728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dfd75be7-9d45-46f2-8489-0d7f618f0ead tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-248982428"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:01.797260 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.797260 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:01.798468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-dfd75be7-9d45-46f2-8489-0d7f618f0ead tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid 4d0525d8-01bf-454f-b86c-8a2c3893453c for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:01.912028 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dfd75be7-9d45-46f2-8489-0d7f618f0ead tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.128279 Mar 29 02:09:01.916803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 104/220] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:01.919229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f2e4bf6-658e-4dc8-ae37-5e8f1985af87 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:01.922571 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:01.922571 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:02.042494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f2e4bf6-658e-4dc8-ae37-5e8f1985af87 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.128216 Mar 29 02:09:02.049048 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 105/221] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:01 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:02.058115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:02.061732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:02.078051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:02.078495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:02.079271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:02.079697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:02.246927 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d87e06ee-2fea-4270-8761-9ef4884e66e9 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/4432e653-62c9-4557-aafc-68980b1bfc97" status: 200 len: 142 microversion: 2.1 time: 0.477301 Mar 29 02:09:02.254264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 117/222] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:09:01 2022] GET /compute/v2.1/os-floating-ips/4432e653-62c9-4557-aafc-68980b1bfc97 => generated 142 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:02.258916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-576fc5a0-0fc0-4f6b-ad81-99f2aaef2636 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:02.259671 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:02.259671 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:02.282958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-576fc5a0-0fc0-4f6b-ad81-99f2aaef2636 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.027502 Mar 29 02:09:02.288627 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 118/223] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:02 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:02.299931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-962414bf-95c5-4db8-9fa4-ebe52a4f66b4 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1754921092"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:02.304084 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:02.304084 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:02.309948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-962414bf-95c5-4db8-9fa4-ebe52a4f66b4 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid b736ad4e-b640-4e55-8865-5b30109d9984 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:02.414665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-962414bf-95c5-4db8-9fa4-ebe52a4f66b4 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.124370 Mar 29 02:09:02.423160 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 119/224] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:02.423160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:02.423381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:02.455274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:02.455741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:02.459721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:02.460192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:02.493126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:02.509219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6b6a199-46df-4597-a81c-792460da1d0b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.462364 Mar 29 02:09:02.511396 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 106/225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:02 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:02.524473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0f4ea1d-e114-4437-9045-63b0d335f0fc tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8724d74e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:02.908109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0f4ea1d-e114-4437-9045-63b0d335f0fc tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.395458 Mar 29 02:09:02.908679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 107/226] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:09:02 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:02.916383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-901fade3-7d80-4db7-8a8e-e5235dce3f35 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:02.918033 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:02.918033 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:02.997414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-901fade3-7d80-4db7-8a8e-e5235dce3f35 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.087478 Mar 29 02:09:02.998728 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 108/227] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:02 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:03.009391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-668010144"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:03.010667 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:03.010667 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:03.022562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.023025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.029994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.030444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.045361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-668010144 could not be found. Mar 29 02:09:03.046225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-668010144 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:03.047453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6e445c2-c41b-4a05-837e-8d20ec70e86c tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.047618 Mar 29 02:09:03.049509 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 109/228] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:02 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:03.055873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:03.059902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:03.074835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.075504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.077129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.078121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.237094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:03.245771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-479df8ce-8805-4bff-9d8b-c6818d735108 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.829566 Mar 29 02:09:03.246661 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 120/229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:02 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:03.371571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:03.384157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:03.388141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:03.392128 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2603d17-1392-40cd-916c-23b22b79eb8b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.339209 Mar 29 02:09:03.392934 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 110/230] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:03 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:03.408467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9024a9e8-fef6-4778-be79-bf5ea3e0d209 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8724d17af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:03.630208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fdabcc25-e63f-44f4-a991-a3148c74a75d tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1800275408", "ram": 512, "vcpus": 1, "disk": 10, "id": 150544737, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:03.632717 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:03.632717 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:03.726242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fdabcc25-e63f-44f4-a991-a3148c74a75d tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.475924 Mar 29 02:09:03.726879 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 121/231] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:03 2022] POST /compute/v2.1/flavors => generated 413 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:03.745428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1e568d6-be24-401d-a27f-52c2f74f0c99 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:03.746441 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:03.746441 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:03.778180 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1e568d6-be24-401d-a27f-52c2f74f0c99 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.037120 Mar 29 02:09:03.778770 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 122/232] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:03 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:03.789315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d08d283-13ec-4168-9fcf-d07be59fad34 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:03.789634 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:03.789634 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:03.865495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d08d283-13ec-4168-9fcf-d07be59fad34 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.085343 Mar 29 02:09:03.871019 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 123/233] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:03 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:03.877191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-dfc1e03f-5871-4fc5-a9de-fd9b58d828f5 req-1cc7027f-227f-468e-a519-4bb6653212ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e8a0c5-a941-47af-b28c-c046992c73c3", "name": "network-vif-plugged", "status": "completed", "tag": "41aa3791-d19b-4bc0-ab29-529b6db14c53"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:03.879000 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:03.879000 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:03.888760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dfc1e03f-5871-4fc5-a9de-fd9b58d828f5 req-1cc7027f-227f-468e-a519-4bb6653212ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.889517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dfc1e03f-5871-4fc5-a9de-fd9b58d828f5 req-1cc7027f-227f-468e-a519-4bb6653212ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.907854 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-dfc1e03f-5871-4fc5-a9de-fd9b58d828f5 req-1cc7027f-227f-468e-a519-4bb6653212ae service nova] Creating event network-vif-plugged:41aa3791-d19b-4bc0-ab29-529b6db14c53 for instance 28e8a0c5-a941-47af-b28c-c046992c73c3 on n-h1-828148-1 Mar 29 02:09:03.913519 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-dfc1e03f-5871-4fc5-a9de-fd9b58d828f5 req-1cc7027f-227f-468e-a519-4bb6653212ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040825 Mar 29 02:09:03.916785 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 124/234] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:03.933835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:03.934988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:03.951417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.955811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:03.957884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:03.959228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:04.503070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:04.515541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3eca0374-c88a-471b-9530-258a48872f39 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.597052 Mar 29 02:09:04.516222 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 125/235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:03 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:04.531010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d564cb88-1d1f-4b9f-8175-fb8ec7fd18fa tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:04.532951 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:04.532951 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:04.672503 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d564cb88-1d1f-4b9f-8175-fb8ec7fd18fa tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.147602 Mar 29 02:09:04.678749 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 126/236] 10.222.0.36 () {60 vars in 1220 bytes} [Tue Mar 29 02:09:04 2022] POST /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:04.690007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a4f11bf-cf0e-414a-82be-986af8f487c5 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:04.699063 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:04.699063 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:04.859335 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a4f11bf-cf0e-414a-82be-986af8f487c5 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.179207 Mar 29 02:09:04.860183 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 127/237] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:04 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:04.865381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f65f8cf-a5ef-42b0-9a74-80e303b15f91 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:04.866595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f65f8cf-a5ef-42b0-9a74-80e303b15f91 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:04.867407 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f65f8cf-a5ef-42b0-9a74-80e303b15f91 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.006497 Mar 29 02:09:04.868193 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 128/238] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Mar 29 02:09:04 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:09:04.875849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:04.878035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:04.886727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:04.887173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:04.888161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:04.889319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.150181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9024a9e8-fef6-4778-be79-bf5ea3e0d209 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/4432e653-62c9-4557-aafc-68980b1bfc97" status: 202 len: 0 microversion: 2.1 time: 1.752405 Mar 29 02:09:05.150753 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 111/239] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:03 2022] DELETE /compute/v2.1/os-floating-ips/4432e653-62c9-4557-aafc-68980b1bfc97 => generated 0 bytes in 1755 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:05.155343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-00fa9468-ee99-460b-8f0e-fb927a32cee9 req-2085a682-954d-4812-89c6-262f212d7207 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e51124ce-fc16-4d10-9043-dbbf91490f58", "tag": "99925391-b52c-4b79-a07f-c4bab191c1b2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.157192 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:05.157192 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:05.168380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-00fa9468-ee99-460b-8f0e-fb927a32cee9 req-2085a682-954d-4812-89c6-262f212d7207 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.169071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-00fa9468-ee99-460b-8f0e-fb927a32cee9 req-2085a682-954d-4812-89c6-262f212d7207 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.186127 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-00fa9468-ee99-460b-8f0e-fb927a32cee9 req-2085a682-954d-4812-89c6-262f212d7207 service nova] Creating event network-changed:99925391-b52c-4b79-a07f-c4bab191c1b2 for instance e51124ce-fc16-4d10-9043-dbbf91490f58 on n-h1-828148-1 Mar 29 02:09:05.191183 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-00fa9468-ee99-460b-8f0e-fb927a32cee9 req-2085a682-954d-4812-89c6-262f212d7207 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039219 Mar 29 02:09:05.192520 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 112/240] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:05.197889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:05.198986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:05.208155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.208732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.209662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.210188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.228409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:05.237485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-886dcff6-c157-4314-a451-c99023d9abf8 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.368101 Mar 29 02:09:05.238162 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 129/241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:04 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:05.365209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e06a4aa7-73e3-4b85-8c87-8ed806876c2e tempest-FlavorsExtraSpecsTestJSON-482619733 tempest-FlavorsExtraSpecsTestJSON-482619733-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:05.389078 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e06a4aa7-73e3-4b85-8c87-8ed806876c2e tempest-FlavorsExtraSpecsTestJSON-482619733 tempest-FlavorsExtraSpecsTestJSON-482619733-project] 10.222.0.36 "GET /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.149578 Mar 29 02:09:05.389982 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 130/242] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Mar 29 02:09:05 2022] GET /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:05.394677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a19f768-ddb8-426f-af27-3af529b4c6da tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1366897148", "availability_zone": "tempest-test_az-1608603608"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.396401 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:05.396401 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:05.397940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-2a19f768-ddb8-426f-af27-3af529b4c6da tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid b98b236f-10e7-412a-a865-dce1150ca83b for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:05.488779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a19f768-ddb8-426f-af27-3af529b4c6da tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.097163 Mar 29 02:09:05.494427 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 131/243] 10.222.0.36 () {60 vars in 1164 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:05.499233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5387cc4-faa1-48c6-942d-bca89df7aed2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.500602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5387cc4-faa1-48c6-942d-bca89df7aed2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:05.501579 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5387cc4-faa1-48c6-942d-bca89df7aed2 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.005980 Mar 29 02:09:05.506574 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 132/244] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:09:05.511798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-956b073e-a8da-4aa3-9b07-58769bb83d79 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Action: 'create', calling method: .version_select at 0x7f8724d6d790>, body: {"pool": null} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.561467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:05.571282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:05.572873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:05.573966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a14ad7de-ae40-48ab-a7b9-ba720f98fe7a tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1361 microversion: 2.25 time: 0.380257 Mar 29 02:09:05.574527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 113/245] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:05 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:05.580168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-197e1ab7-b342-43da-af4c-8396c20e8dd9 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.581983 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:05.581983 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:05.621407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-197e1ab7-b342-43da-af4c-8396c20e8dd9 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044582 Mar 29 02:09:05.621827 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 114/246] 10.222.0.36 () {60 vars in 1220 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:05.630431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-665c194b-e13d-4bc5-9cd1-4fd096dd525b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1366897148_new", "availability_zone": "tempest-test_az-1608603608_new"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.632099 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:05.632099 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:05.755974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-665c194b-e13d-4bc5-9cd1-4fd096dd525b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.756590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-665c194b-e13d-4bc5-9cd1-4fd096dd525b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.848992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-665c194b-e13d-4bc5-9cd1-4fd096dd525b tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 337 microversion: 2.1 time: 0.225868 Mar 29 02:09:05.850173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 115/247] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:09:05 2022] PUT /compute/v2.1/os-aggregates/12 => generated 337 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:05.861079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-616131ab-a10b-4739-a3c5-276cf387048e tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1171760101"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:05.862358 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:05.862358 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:05.863276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-616131ab-a10b-4739-a3c5-276cf387048e tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:05.863913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-616131ab-a10b-4739-a3c5-276cf387048e tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:05.864686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-616131ab-a10b-4739-a3c5-276cf387048e tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.008311 Mar 29 02:09:05.865432 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 116/248] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:05.881863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:05.882475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:05.891330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.892147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:05.892946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:05.893510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:06.114347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:06.126996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eab253c8-a59a-4725-83ce-8421f840bd5c tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.249113 Mar 29 02:09:06.128695 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 117/249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:05 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:06.136873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-847fce09-5be0-49cb-8f39-590eb3502fe7 tempest-FlavorsExtraSpecsTestJSON-482619733 tempest-FlavorsExtraSpecsTestJSON-482619733-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.161097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-847fce09-5be0-49cb-8f39-590eb3502fe7 tempest-FlavorsExtraSpecsTestJSON-482619733 tempest-FlavorsExtraSpecsTestJSON-482619733-project] 10.222.0.36 "GET /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.030407 Mar 29 02:09:06.162016 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 118/250] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:09:06 2022] GET /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes => generated 22 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:06.167083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6545c29-5ac5-4fef-8f9c-2260a13c84cb tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.168094 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.168094 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.179042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6545c29-5ac5-4fef-8f9c-2260a13c84cb tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 340 microversion: 2.1 time: 0.015948 Mar 29 02:09:06.185273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 119/251] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:09:06 2022] GET /compute/v2.1/os-aggregates => generated 340 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:06.186614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78f12cee-0893-4f38-a61e-9aaffa83428b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-900837409"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:06.188357 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.188357 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.189611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-78f12cee-0893-4f38-a61e-9aaffa83428b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 19826733-79e0-4774-9d55-94021c3d047a for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:06.281542 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78f12cee-0893-4f38-a61e-9aaffa83428b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100004 Mar 29 02:09:06.282605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 120/252] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:06.287434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f387dd6a-b163-4082-ae1f-36a49145674b req-29bc3b19-b857-48ce-879f-47eca601056f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b011c6-7242-49d3-88cb-f78e2b59a91d", "name": "network-vif-plugged", "status": "completed", "tag": "e54b18e4-6f12-4292-9b97-415c0e360ef4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:06.289227 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.289227 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.300898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f387dd6a-b163-4082-ae1f-36a49145674b req-29bc3b19-b857-48ce-879f-47eca601056f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:06.301682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f387dd6a-b163-4082-ae1f-36a49145674b req-29bc3b19-b857-48ce-879f-47eca601056f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:06.319574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f387dd6a-b163-4082-ae1f-36a49145674b req-29bc3b19-b857-48ce-879f-47eca601056f service nova] Creating event network-vif-plugged:e54b18e4-6f12-4292-9b97-415c0e360ef4 for instance 03b011c6-7242-49d3-88cb-f78e2b59a91d on n-h2-828148-1 Mar 29 02:09:06.325058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f387dd6a-b163-4082-ae1f-36a49145674b req-29bc3b19-b857-48ce-879f-47eca601056f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040906 Mar 29 02:09:06.326368 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 121/253] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:06.332170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4975f8ec-916c-433d-93f3-56a400077727 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:06.333650 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.333650 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.369781 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4975f8ec-916c-433d-93f3-56a400077727 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042585 Mar 29 02:09:06.374777 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 122/254] 10.222.0.36 () {60 vars in 1220 bytes} [Tue Mar 29 02:09:06 2022] POST /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:06.379773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5c8044ad-a10e-4fae-a01e-8918daf6c934 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.380590 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.380590 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.475349 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5c8044ad-a10e-4fae-a01e-8918daf6c934 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.099409 Mar 29 02:09:06.477114 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 123/255] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:06 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:06.483763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.485013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:06.495188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:06.495959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:06.496905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:06.497333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:06.745150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:06.754915 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-028c5a64-d061-49f0-ae54-135b02aed2c2 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.276500 Mar 29 02:09:06.764977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 124/256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:06 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:06.769503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4bbe6a2-f34e-451a-889e-cf4a745e5511 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-900837409"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:06.771153 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.771153 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.772892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-f4bbe6a2-f34e-451a-889e-cf4a745e5511 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 14f00b78-2468-491c-ad8c-1ee5fbf3ea8a for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:06.784149 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f4bbe6a2-f34e-451a-889e-cf4a745e5511 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-900837409 already exists. Mar 29 02:09:06.785063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4bbe6a2-f34e-451a-889e-cf4a745e5511 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-900837409 already exists. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:06.785891 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4bbe6a2-f34e-451a-889e-cf4a745e5511 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.028875 Mar 29 02:09:06.786607 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 125/257] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:06 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 30 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:06.792973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5844836a-7846-48d1-9b2f-9ebc36e0becd tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.809155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5844836a-7846-48d1-9b2f-9ebc36e0becd tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021387 Mar 29 02:09:06.809869 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 126/258] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Mar 29 02:09:06 2022] GET /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:06.814334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d1acf33-1d20-4d4d-ac79-f2c0562cb8ba tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1494603954"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:06.815720 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:06.815720 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:06.817323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-1d1acf33-1d20-4d4d-ac79-f2c0562cb8ba tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Generated uuid 2d3d1c0f-dcef-42dd-8993-9475a883fe1b for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:06.909324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d1acf33-1d20-4d4d-ac79-f2c0562cb8ba tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.098532 Mar 29 02:09:06.909998 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 127/259] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:06.914431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:06.915436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:06.922959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:06.923471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:06.924301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:06.924793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:07.163821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:07.173426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:07.175022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:07.176193 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9382a978-d6ba-42ec-8ea2-ba98bf5292d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1556 microversion: 2.25 time: 0.265181 Mar 29 02:09:07.176919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 128/260] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:06 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1556 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:07.183756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38c0a3cf-96b5-4aed-b01f-2609aa9c8b05 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:07.183756 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:07.183756 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:07.259991 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38c0a3cf-96b5-4aed-b01f-2609aa9c8b05 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.081995 Mar 29 02:09:07.260794 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 129/261] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:07 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:07.270149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df753e6b-21e6-4f46-9e00-35e47d2f04e7 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:07.271621 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:07.271621 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:07.361343 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df753e6b-21e6-4f46-9e00-35e47d2f04e7 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.094809 Mar 29 02:09:07.362147 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 130/262] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:09:07 2022] PUT /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes => generated 22 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:07.366919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90154dcc-2665-41e5-a1b8-d1ea8eef96f6 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:07.374967 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:07.374967 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:07.378752 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90154dcc-2665-41e5-a1b8-d1ea8eef96f6 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.015364 Mar 29 02:09:07.379327 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 131/263] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:09:07 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:07.389566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:07.390390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:07.398062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:07.398636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:07.399554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:07.400088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:07.623142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:07.632481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8b24c5c3-0afa-4a9e-b6b7-954a8369758f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1320 microversion: 2.1 time: 0.251993 Mar 29 02:09:07.634981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 132/264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:07 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1320 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:07.809908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:07.811042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:07.820890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:07.821333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:07.822105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:07.822527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.042985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 28e8a0c5-a941-47af-b28c-c046992c73c3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:08.103874 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b264b38-53c4-4e4c-85e8-83123fd6107c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 2048 microversion: 2.25 time: 0.456991 Mar 29 02:09:08.116350 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 133/265] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:07 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 2048 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:08.116350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96663989-4902-4078-831c-ff5fd80f1bee tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-583949126"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:08.116350 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:08.116350 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:08.116350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-96663989-4902-4078-831c-ff5fd80f1bee tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid e4a687ad-6fc4-465f-8b9d-8e8e819dcfee for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:08.177305 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96663989-4902-4078-831c-ff5fd80f1bee tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070795 Mar 29 02:09:08.182919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 134/266] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:08.188141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae2510f0-950f-43b7-9538-426eaac62e3e tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.203816 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae2510f0-950f-43b7-9538-426eaac62e3e tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019672 Mar 29 02:09:08.204382 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 135/267] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Mar 29 02:09:08 2022] GET /compute/v2.1/flavors/150544737/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:08.209226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b07a01c0-ed50-4f69-9a94-c1a1fe8a09c0 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.209960 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:08.209960 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:08.265130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b07a01c0-ed50-4f69-9a94-c1a1fe8a09c0 tempest-AggregatesAdminTestJSON-1180740384 tempest-AggregatesAdminTestJSON-1180740384-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.059361 Mar 29 02:09:08.266079 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 136/268] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:08.271952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.272755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:08.282727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.283519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.284499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.285109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.534232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:08.542422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-317ebd2b-29bb-495f-a542-9162a809cbbe tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.275070 Mar 29 02:09:08.543002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 137/269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:08 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:08.548096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.548690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:08.555759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.556275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.557128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.557504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.777876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 28e8a0c5-a941-47af-b28c-c046992c73c3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:08.842433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f1e83ec-c260-4b14-94ef-341f493f9308 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 2048 microversion: 2.25 time: 0.297858 Mar 29 02:09:08.847855 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 138/270] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:08 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 2048 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:08.847855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75d07fc7-857b-4f94-a97f-210431b0cf99 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.848068 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:08.848068 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:08.848986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75d07fc7-857b-4f94-a97f-210431b0cf99 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:08.849739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75d07fc7-857b-4f94-a97f-210431b0cf99 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:08.850502 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75d07fc7-857b-4f94-a97f-210431b0cf99 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.006603 Mar 29 02:09:08.850977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 139/271] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:08 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 7 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:08.856209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6549a5d8-c325-4d29-8a4b-aa63186d9ff2 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.856986 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:08.856986 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:08.964567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6549a5d8-c325-4d29-8a4b-aa63186d9ff2 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.112535 Mar 29 02:09:08.965585 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 140/272] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:09:08 2022] DELETE /compute/v2.1/flavors/150544737/os-extra_specs/hw:numa_nodes => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:08.970864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:08.971606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:08.980697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.981396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:08.982247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:08.982776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.035076 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] HTTP exception thrown: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. Mar 29 02:09:09.035679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Returning 404 to user: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:09.036555 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8e68bca4-6549-4a99-b40a-d9cdadc15897 tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 404 len: 111 microversion: 2.1 time: 0.069990 Mar 29 02:09:09.037137 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 141/273] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:09:08 2022] DELETE /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:09.043691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.044304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:09.051500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.051939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.052696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.053157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.261060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:09.269696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5ddf010-db05-4276-9edf-1ae276e8af8e tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1470 microversion: 2.1 time: 0.231377 Mar 29 02:09:09.270244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 142/274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:09 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:09.275035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1c599520-edd2-4d37-b5ab-9371da911698 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.275767 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:09.275767 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:09.384614 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1c599520-edd2-4d37-b5ab-9371da911698 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.113309 Mar 29 02:09:09.389696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 143/275] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:09 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:09.393780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.395096 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:09.395096 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:09.396718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.397190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.397985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.398413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.424801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-662f8b18-20e8-4e56-b2d2-c90ed56989c3 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.038257 Mar 29 02:09:09.425408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 144/276] 10.222.0.36 () {60 vars in 1216 bytes} [Tue Mar 29 02:09:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:09.429768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b16fde7-3338-4e5a-8315-959c12820418 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.430619 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:09.430619 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:09.512425 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8b16fde7-3338-4e5a-8315-959c12820418 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/150544737/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.085886 Mar 29 02:09:09.512947 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 145/277] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:09:09 2022] DELETE /compute/v2.1/flavors/150544737/os-extra_specs/hw:cpu_policy => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:09.518125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.518733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] [instance: 7edbe663-89cb-45c7-843c-41bf12957d7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:09.526046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.526496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.527262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.527717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.578786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] HTTP exception thrown: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. Mar 29 02:09:09.578990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] Returning 404 to user: Instance 7edbe663-89cb-45c7-843c-41bf12957d7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:09.579772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c58f9b5-69c9-4183-b93f-bf1b70c029bd tempest-AggregatesAdminTestJSON-1740288831 tempest-AggregatesAdminTestJSON-1740288831-project] 10.222.0.36 "GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a" status: 404 len: 111 microversion: 2.1 time: 0.065176 Mar 29 02:09:09.583824 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 146/278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:09 2022] GET /compute/v2.1/servers/7edbe663-89cb-45c7-843c-41bf12957d7a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:09.587182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:09.588182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:09.595555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.596004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.596903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.597271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.704308 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-956b073e-a8da-4aa3-9b07-58769bb83d79 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.196452 Mar 29 02:09:09.704920 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 133/279] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:09:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:09.710394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60d673a7-8c26-4b22-bf5a-ef15ca4eb2ab tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.711463 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:09.711463 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:09.726386 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-60d673a7-8c26-4b22-bf5a-ef15ca4eb2ab tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 29 02:09:09.726966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60d673a7-8c26-4b22-bf5a-ef15ca4eb2ab tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:09.727829 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60d673a7-8c26-4b22-bf5a-ef15ca4eb2ab tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021779 Mar 29 02:09:09.728527 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 134/280] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:09 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:09.737298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-828148-1", "block_migration": "auto"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:09.738449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:09.746512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.746955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.747762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:09.748879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:09.813918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'flavor' on Instance uuid 28e8a0c5-a941-47af-b28c-c046992c73c3 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:09.865611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Going to try to live migrate instance to n-h2-828148-1 {{(pid=103514) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:09:09.947603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f8a737fe-945e-4541-9a1e-b193880cf14e tempest-DeleteServersAdminTestJSON-999940646 tempest-DeleteServersAdminTestJSON-999940646-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d/action" status: 202 len: 0 microversion: 2.1 time: 0.365766 Mar 29 02:09:09.954240 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 147/281] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:09:09 2022] POST /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:09.959197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2be5e11-16b2-45d9-9ad6-4d7eaacf0c86 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.980528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2be5e11-16b2-45d9-9ad6-4d7eaacf0c86 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/150544737/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024963 Mar 29 02:09:09.983973 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 148/282] 10.222.0.36 () {58 vars in 1199 bytes} [Tue Mar 29 02:09:09 2022] GET /compute/v2.1/flavors/150544737/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:09.992477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:09.993111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:10.000510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:10.001171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:10.002252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:10.002855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:10.309454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:10.322107 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbdd562c-6c4b-4074-90a5-a67af7647436 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.337002 Mar 29 02:09:10.325302 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 149/283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:09 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:10.333376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f47987c2-3891-4d06-a463-4649ea161690 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8724b2b430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:11.923562 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f47987c2-3891-4d06-a463-4649ea161690 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb" status: 202 len: 0 microversion: 2.1 time: 1.596973 Mar 29 02:09:11.927268 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 150/284] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:10 2022] DELETE /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb => generated 0 bytes in 1601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:11.931991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-930b8fc8-b227-4681-9dac-b04dcf9ae728 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1586205836"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:11.933331 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:11.933331 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:11.934514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.aggregate [None req-930b8fc8-b227-4681-9dac-b04dcf9ae728 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 9cab2dc0-d82c-4a0b-9629-9f7412010d8b for aggregate {{(pid=103513) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:12.063104 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-930b8fc8-b227-4681-9dac-b04dcf9ae728 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.133935 Mar 29 02:09:12.064728 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 151/285] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:12.070678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:12.071596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:12.082071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:12.084106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:12.085140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:12.085740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:12.174225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:12.174678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:12.175826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lazy-loading 'fault' on Instance uuid 03b011c6-7242-49d3-88cb-f78e2b59a91d {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:12.472368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:12.490278 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-190086d9-bc7c-4c6c-b60c-92956b2a8f9f tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1453 microversion: 2.1 time: 0.411612 Mar 29 02:09:12.501753 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 152/286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:12 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1453 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:12.501753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bea3f608-e72b-4c68-937e-8a036965fb32 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:12.501753 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:12.501753 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:12.597605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bea3f608-e72b-4c68-937e-8a036965fb32 tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/150544737" status: 202 len: 0 microversion: 2.1 time: 0.096579 Mar 29 02:09:12.597605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 153/287] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:09:12 2022] DELETE /compute/v2.1/flavors/150544737 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:12.598353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:12.599194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:12.608429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:12.609128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:12.624521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:12.625541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:12.988147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:12.998480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-421e23ee-2aaf-4847-b102-eafae2e76dc1 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.403387 Mar 29 02:09:13.007658 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 154/288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:12 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:13.018622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-629ea053-4479-40d2-9ca4-09d752046a2d tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8726001e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.129629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-629ea053-4479-40d2-9ca4-09d752046a2d tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fac00d6e-a9fc-4bfa-83b0-f1860a0528eb could not be found", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:09:13.130569 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-629ea053-4479-40d2-9ca4-09d752046a2d tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] HTTP exception thrown: Floating IP not found for ID fac00d6e-a9fc-4bfa-83b0-f1860a0528eb Mar 29 02:09:13.131380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-629ea053-4479-40d2-9ca4-09d752046a2d tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Returning 404 to user: Floating IP not found for ID fac00d6e-a9fc-4bfa-83b0-f1860a0528eb {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:13.132407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-629ea053-4479-40d2-9ca4-09d752046a2d tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb" status: 404 len: 111 microversion: 2.1 time: 0.124947 Mar 29 02:09:13.134097 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 155/289] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:09:13 2022] GET /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:13.141135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca26968c-5fbb-4e07-9aa1-d1307dcf5f91 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.142183 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:13.142183 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:13.144026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca26968c-5fbb-4e07-9aa1-d1307dcf5f91 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:13.145216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca26968c-5fbb-4e07-9aa1-d1307dcf5f91 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:13.146327 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca26968c-5fbb-4e07-9aa1-d1307dcf5f91 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.010976 Mar 29 02:09:13.147612 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 156/290] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:13 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:13.158388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.158388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:13.170393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:13.171070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:13.172179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:13.172712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:13.237730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:09:13.667352 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36d7b82b-e9ad-4669-b369-e6367f506d68 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 204 len: 0 microversion: 2.1 time: 0.518200 Mar 29 02:09:13.676729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 157/291] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:09:13 2022] DELETE /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:09:13.678228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b07ff2f4-d436-404a-9f49-08dbab0473bd tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.722486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b07ff2f4-d436-404a-9f49-08dbab0473bd tempest-FlavorsExtraSpecsTestJSON-1777977145 tempest-FlavorsExtraSpecsTestJSON-1777977145-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048592 Mar 29 02:09:13.726033 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 158/292] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:13.740712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-45610c63-f458-4eec-978a-899e52102c93 req-29502d78-7394-438e-86e0-7025b164ef3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51124ce-fc16-4d10-9043-dbbf91490f58", "name": "network-vif-plugged", "status": "completed", "tag": "99925391-b52c-4b79-a07f-c4bab191c1b2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:13.741071 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:13.741071 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:13.754541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-45610c63-f458-4eec-978a-899e52102c93 req-29502d78-7394-438e-86e0-7025b164ef3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:13.754975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-45610c63-f458-4eec-978a-899e52102c93 req-29502d78-7394-438e-86e0-7025b164ef3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:13.780209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-45610c63-f458-4eec-978a-899e52102c93 req-29502d78-7394-438e-86e0-7025b164ef3b service nova] Creating event network-vif-plugged:99925391-b52c-4b79-a07f-c4bab191c1b2 for instance e51124ce-fc16-4d10-9043-dbbf91490f58 on n-h1-828148-1 Mar 29 02:09:13.786451 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-45610c63-f458-4eec-978a-899e52102c93 req-29502d78-7394-438e-86e0-7025b164ef3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058041 Mar 29 02:09:13.787463 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 159/293] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:13.795725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e275e1d1-0ab8-48f4-8bd8-1ede12a98008 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Calling method '.version_select at 0x7f8724d21040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.954082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-e275e1d1-0ab8-48f4-8bd8-1ede12a98008 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP fac00d6e-a9fc-4bfa-83b0-f1860a0528eb could not be found", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:09:13.955166 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e275e1d1-0ab8-48f4-8bd8-1ede12a98008 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] HTTP exception thrown: Floating IP not found for ID fac00d6e-a9fc-4bfa-83b0-f1860a0528eb Mar 29 02:09:13.959729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e275e1d1-0ab8-48f4-8bd8-1ede12a98008 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] Returning 404 to user: Floating IP not found for ID fac00d6e-a9fc-4bfa-83b0-f1860a0528eb {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:13.961078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e275e1d1-0ab8-48f4-8bd8-1ede12a98008 tempest-FloatingIPsTestJSON-862482109 tempest-FloatingIPsTestJSON-862482109-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb" status: 404 len: 111 microversion: 2.1 time: 0.170251 Mar 29 02:09:13.961200 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf24c6b0-b36d-46de-b46d-bb8e8376be5d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3/action" status: 202 len: 0 microversion: 2.25 time: 4.227230 Mar 29 02:09:13.964966 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 135/294] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:09:09 2022] POST /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3/action => generated 0 bytes in 4233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:09:13.971417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 160/295] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:13 2022] DELETE /compute/v2.1/os-floating-ips/fac00d6e-a9fc-4bfa-83b0-f1860a0528eb => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:13.971647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-630ff280-0061-45e1-92a0-c465ec8d092e tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.971647 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:13.971647 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:13.971887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:13.972879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:13.992602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:13.993763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:13.994835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:13.995428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.107698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:14.110992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-630ff280-0061-45e1-92a0-c465ec8d092e tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.148211 Mar 29 02:09:14.111570 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 136/296] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:13 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:14.114446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.115357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lazy-loading 'fault' on Instance uuid 03b011c6-7242-49d3-88cb-f78e2b59a91d {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:14.119413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:14.121288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:14.149711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:14.149711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.149711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:14.149711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.816805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:14.826662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:14.828425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:14.829599 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b60467e2-6e0c-449d-8bce-ad5f7b9f4f55 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.716988 Mar 29 02:09:14.830138 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 137/297] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:14 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:14.841712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:14.848201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:14.873556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:14.874004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.876423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:14.880704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:14.923905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:14.938024 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd7532b9-69e6-4fe4-bacb-bf0c2af29d2b tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1459 microversion: 2.1 time: 0.970161 Mar 29 02:09:14.938819 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 161/298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:13 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1459 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:14.944573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51f65d8c-91f1-45ac-8b27-4e8fc8f3c5a1 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:14.944573 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:14.944573 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:14.986087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-51f65d8c-91f1-45ac-8b27-4e8fc8f3c5a1 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Mar 29 02:09:14.986087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51f65d8c-91f1-45ac-8b27-4e8fc8f3c5a1 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:14.986087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51f65d8c-91f1-45ac-8b27-4e8fc8f3c5a1 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040182 Mar 29 02:09:14.988993 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 162/299] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:14 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:15.167056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b643d91-0f39-40db-b4fd-1b16db5e6425 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Action: 'create', calling method: .version_select at 0x7f8724d179d0>, body: {"pool": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:15.414256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:15.428734 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22164c16-de89-4016-ae4f-3164e483f623 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1323 microversion: 2.1 time: 0.592208 Mar 29 02:09:15.430703 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 138/300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:14 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:15.436146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-606124d9-a6cf-42c9-a352-4f448e70d4b6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:15.437372 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:15.437372 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:15.438861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-606124d9-a6cf-42c9-a352-4f448e70d4b6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:15.439891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-606124d9-a6cf-42c9-a352-4f448e70d4b6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:15.441399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-606124d9-a6cf-42c9-a352-4f448e70d4b6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009074 Mar 29 02:09:15.442081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 139/301] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:09:15 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:15.455389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dc12b1d-8fe0-47d6-a094-60d989e9dd5d tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-524798129"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:15.458561 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:15.458561 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:15.463227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-2dc12b1d-8fe0-47d6-a094-60d989e9dd5d tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 3ca63423-2ae1-4c8d-89e3-675908189f7f for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:15.535706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dc12b1d-8fe0-47d6-a094-60d989e9dd5d tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084745 Mar 29 02:09:15.542986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 140/302] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:15.548552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-891476fa-e07d-4f42-94fb-04e1d91e8575 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:15.549849 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:15.549849 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:15.559822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-891476fa-e07d-4f42-94fb-04e1d91e8575 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:15.560532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-891476fa-e07d-4f42-94fb-04e1d91e8575 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:15.855850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-891476fa-e07d-4f42-94fb-04e1d91e8575 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.311581 Mar 29 02:09:15.862325 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 141/303] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:15.862325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:15.862325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:15.880518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:15.881348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:15.884625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:15.886981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:16.376213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:16.390697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:16.392231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:16.399696 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b20006a3-0221-47ce-8e2f-618f4a885cf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.541544 Mar 29 02:09:16.401360 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 142/304] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:15 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:16.414723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-466a8796-2394-42e3-953b-38b2109303f6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:16.417467 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:16.417467 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:16.418908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-466a8796-2394-42e3-953b-38b2109303f6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '24f0bc068de047fa9ad899ffcc432175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f01f6dec73e4561bb6724685a0c489f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:16.420345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-466a8796-2394-42e3-953b-38b2109303f6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:16.421437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-466a8796-2394-42e3-953b-38b2109303f6 tempest-AggregatesAdminNegativeTestJSON-197111448 tempest-AggregatesAdminNegativeTestJSON-197111448-project] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.018924 Mar 29 02:09:16.426731 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 143/305] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:16.432701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:16.441623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:16.454730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:16.455814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:16.458567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:16.459722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:16.607714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:16.608174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:16.608642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lazy-loading 'fault' on Instance uuid 03b011c6-7242-49d3-88cb-f78e2b59a91d {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:16.749304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e130c0deae154519887add62142d7cac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5c6c7d3ff402db72fada2a0083d87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:16.763911 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06e2db9d-5fcb-4720-8aef-1a419c7abd49 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 200 len: 1417 microversion: 2.1 time: 0.334645 Mar 29 02:09:16.766416 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 144/306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:16 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 1417 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:16.782043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b51ae12e-fdf2-4716-9d99-86548395266b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:16.784488 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:16.784488 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:16.797398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b51ae12e-fdf2-4716-9d99-86548395266b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:16.798074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b51ae12e-fdf2-4716-9d99-86548395266b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:17.184902 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b51ae12e-fdf2-4716-9d99-86548395266b tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.406520 Mar 29 02:09:17.186720 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 145/307] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:16 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:17.204292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:17.205103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:17.215953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:17.217283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:17.218241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:17.219469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:17.507317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:17.546152 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b430a82-b5e2-4384-a2b6-2c7bc522de47 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1473 microversion: 2.1 time: 0.349336 Mar 29 02:09:17.557838 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 146/308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:17 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1473 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:17.557838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-01b81c0f-fbe8-456f-9fbb-53920446bbb1 req-2c22b512-d549-4f5d-8ad0-fa9e49a5fb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b011c6-7242-49d3-88cb-f78e2b59a91d", "name": "network-vif-deleted", "tag": "e54b18e4-6f12-4292-9b97-415c0e360ef4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:17.560955 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:17.560955 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:17.575767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-01b81c0f-fbe8-456f-9fbb-53920446bbb1 req-2c22b512-d549-4f5d-8ad0-fa9e49a5fb53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:17.576214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-01b81c0f-fbe8-456f-9fbb-53920446bbb1 req-2c22b512-d549-4f5d-8ad0-fa9e49a5fb53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:17.594447 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-01b81c0f-fbe8-456f-9fbb-53920446bbb1 req-2c22b512-d549-4f5d-8ad0-fa9e49a5fb53 service nova] Creating event network-vif-deleted:e54b18e4-6f12-4292-9b97-415c0e360ef4 for instance 03b011c6-7242-49d3-88cb-f78e2b59a91d on n-h2-828148-1 Mar 29 02:09:17.599852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-01b81c0f-fbe8-456f-9fbb-53920446bbb1 req-2c22b512-d549-4f5d-8ad0-fa9e49a5fb53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048015 Mar 29 02:09:17.600711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 147/309] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:17.606035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f8a4de71-9053-4ca8-8442-961fc148a702 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:17.607513 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:17.607513 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:17.677780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f8a4de71-9053-4ca8-8442-961fc148a702 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.075618 Mar 29 02:09:17.685753 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 148/310] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:17 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:17.699651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:17.700409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:17.709555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:17.710002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:17.710787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:17.713675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.213878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:18.231241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:18.233943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:18.235353 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f3af7d9-a7d1-445d-a338-24eea651b690 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.555427 Mar 29 02:09:18.236641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 149/311] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:17 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:18.242531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:18.243177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:18.259635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.260690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.264029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.264866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.396634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:18.398671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:18.404954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80c1fa01-3dfe-4fea-9328-dcee9d8eae9f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.161475 Mar 29 02:09:18.404954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 150/312] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:09:18 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58/diagnostics => generated 117 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:18.407093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf534d86-aacd-4ca6-80d4-60f07e5da291 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-71486983"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:18.409539 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:18.409539 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:18.411087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-cf534d86-aacd-4ca6-80d4-60f07e5da291 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Generated uuid 4e8bc1ce-efc7-40d9-8f7e-ce5d0f65343d for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:09:18.519631 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf534d86-aacd-4ca6-80d4-60f07e5da291 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.115037 Mar 29 02:09:18.521653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 151/313] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:09:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:18.534825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:18.535742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:18.549183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.555052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.556051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.556613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.637282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. Mar 29 02:09:18.637975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:18.638898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-501d1aac-0e99-4d1b-b6b2-1cf310c17a25 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 404 len: 111 microversion: 2.1 time: 0.114913 Mar 29 02:09:18.639999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 152/314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:18 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:18.657502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:18.659226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:18.679752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.681950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.686430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:18.688179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:18.813902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:09:19.245847 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59be3301-3518-450e-9746-4f0e6e712b27 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 204 len: 0 microversion: 2.1 time: 0.604300 Mar 29 02:09:19.246417 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 153/315] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:09:18 2022] DELETE /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:09:19.252319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:19.253701 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:19.253701 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:19.276543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.277265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.296865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.297330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.325684 n-d-828148-1 devstack@n-api.service[103514]: ERROR nova.api.openstack.compute.aggregates [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Mar 29 02:09:19.326264 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Mar 29 02:09:19.327120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:19.327953 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62f11558-8c71-4564-b1fb-d56131e74195 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.080188 Mar 29 02:09:19.328867 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 154/316] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:09:19 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:09:19.338666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:19.344909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:19.351312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.351757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.352537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.352987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.429683 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. Mar 29 02:09:19.430302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:19.431131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d3786904-fb07-498b-a49c-669c4e2eb849 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 404 len: 111 microversion: 2.1 time: 0.101295 Mar 29 02:09:19.432010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 155/317] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:09:19 2022] DELETE /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:19.439742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d981927b-0f76-4035-9119-6345e5bf63da req-7f2cf5d6-e43b-4a1a-82e3-c098280ca518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e8a0c5-a941-47af-b28c-c046992c73c3", "name": "network-vif-unplugged", "status": "completed", "tag": "41aa3791-d19b-4bc0-ab29-529b6db14c53"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:19.442281 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:19.442281 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:19.454068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d981927b-0f76-4035-9119-6345e5bf63da req-7f2cf5d6-e43b-4a1a-82e3-c098280ca518 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.454728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d981927b-0f76-4035-9119-6345e5bf63da req-7f2cf5d6-e43b-4a1a-82e3-c098280ca518 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.477230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d981927b-0f76-4035-9119-6345e5bf63da req-7f2cf5d6-e43b-4a1a-82e3-c098280ca518 service nova] Creating event network-vif-unplugged:41aa3791-d19b-4bc0-ab29-529b6db14c53 for instance 28e8a0c5-a941-47af-b28c-c046992c73c3 on n-h1-828148-1 Mar 29 02:09:19.484189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d981927b-0f76-4035-9119-6345e5bf63da req-7f2cf5d6-e43b-4a1a-82e3-c098280ca518 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047743 Mar 29 02:09:19.485380 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 156/318] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:19.491057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:19.492350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:19.507631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.508311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:19.509291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:19.509868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:20.179014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:20.188792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83714f76-1b81-4a9e-8c03-472e1bfbf52d tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1479 microversion: 2.1 time: 0.701878 Mar 29 02:09:20.189902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 157/319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:19 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1479 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:20.197455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:20.198141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:20.206692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:20.207136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:20.207912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:20.208908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:20.784507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:20.796514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:20.800969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:20.802149 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-065d397f-8c61-4c35-ae60-c89c575b9967 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.611112 Mar 29 02:09:20.802902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 158/320] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:20 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:20.810747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b989b87-dca8-49c1-8c7f-546d78fa7b70 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:20.813371 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:20.813371 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:20.935004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b989b87-dca8-49c1-8c7f-546d78fa7b70 tempest-AggregatesAdminNegativeTestJSON-1354788527 tempest-AggregatesAdminNegativeTestJSON-1354788527-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.131224 Mar 29 02:09:20.935604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 159/321] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:09:20 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:09:20.949762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:20.950973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 03b011c6-7242-49d3-88cb-f78e2b59a91d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:20.969028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:20.969676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:20.970553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:20.973184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:21.084889 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. Mar 29 02:09:21.086289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 03b011c6-7242-49d3-88cb-f78e2b59a91d could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:21.089490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eaef8fef-881d-4670-9f44-d8dcc671644d tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d" status: 404 len: 111 microversion: 2.1 time: 0.145403 Mar 29 02:09:21.095098 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 160/322] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:20 2022] GET /compute/v2.1/servers/03b011c6-7242-49d3-88cb-f78e2b59a91d => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:21.103291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:21.104010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:21.121913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:21.123363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:21.123718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:21.124294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:21.324659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. Mar 29 02:09:21.326224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:21.327448 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e0faa4e-fe3c-4729-8bb3-16ad390c8de3 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 404 len: 111 microversion: 2.1 time: 0.228274 Mar 29 02:09:21.330117 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 161/323] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:09:21 2022] DELETE /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:09:21.338637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:21.338637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:21.357478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:21.357478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:21.357478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:21.357478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.275622 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b643d91-0f39-40db-b4fd-1b16db5e6425 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.285342 Mar 29 02:09:22.279905 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 163/324] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:09:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:22.285338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:22.286133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] [instance: 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:22.298064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:22.298505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.301367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:22.301367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.356455 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] HTTP exception thrown: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. Mar 29 02:09:22.358201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] Returning 404 to user: Instance 8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:22.359177 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f17c7455-c296-41f7-8bf2-4f138b8dcfd4 tempest-DeleteServersAdminTestJSON-958089177 tempest-DeleteServersAdminTestJSON-958089177-project] 10.222.0.36 "GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46" status: 404 len: 111 microversion: 2.1 time: 0.078058 Mar 29 02:09:22.360069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 164/325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:22 2022] GET /compute/v2.1/servers/8f6ade7a-d31b-4b46-9ab4-b6d3e8cc3e46 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:22.385585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-097c8f7e-2fa2-4ad5-858b-f0cee6175f88 req-9d8082dd-6dd6-4757-9345-eea4da958566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e8a0c5-a941-47af-b28c-c046992c73c3", "tag": "41aa3791-d19b-4bc0-ab29-529b6db14c53"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:22.390493 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:22.390493 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:22.408635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-097c8f7e-2fa2-4ad5-858b-f0cee6175f88 req-9d8082dd-6dd6-4757-9345-eea4da958566 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:22.409102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-097c8f7e-2fa2-4ad5-858b-f0cee6175f88 req-9d8082dd-6dd6-4757-9345-eea4da958566 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.438398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-097c8f7e-2fa2-4ad5-858b-f0cee6175f88 req-9d8082dd-6dd6-4757-9345-eea4da958566 service nova] Creating event network-changed:41aa3791-d19b-4bc0-ab29-529b6db14c53 for instance 28e8a0c5-a941-47af-b28c-c046992c73c3 on n-h1-828148-1 Mar 29 02:09:22.443682 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-097c8f7e-2fa2-4ad5-858b-f0cee6175f88 req-9d8082dd-6dd6-4757-9345-eea4da958566 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081949 Mar 29 02:09:22.445876 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 165/326] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:22.454015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:22.454990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:22.463063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:22.463839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.464915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:22.465548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:22.606577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:22.620431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4516a106-62f1-4201-881d-a9ee8d5d5772 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1479 microversion: 2.1 time: 1.288283 Mar 29 02:09:22.621046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 162/327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:21 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1479 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:22.657520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5651e092-cec8-4c51-8f59-4478f7fec463 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Action: 'create', calling method: .version_select at 0x7f8724059310>, body: {"pool": null} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:23.601295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:23.617034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:23.619332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:23.621043 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f56448a-f766-4d88-adc6-324d8abb37ac tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 1.173620 Mar 29 02:09:23.622801 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 166/328] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:22 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:23.792143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-79cde331-ba38-459a-85fd-fc2f3cfb216d tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1805885801", "id": 1600687127, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:23.793919 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:23.793919 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:23.892351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-79cde331-ba38-459a-85fd-fc2f3cfb216d tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.267707 Mar 29 02:09:23.899827 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 167/329] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:09:23 2022] POST /compute/v2.1/flavors => generated 449 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:23.908295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:23.908958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:23.916684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:23.917404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:23.918371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:23.919024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:24.085437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:24.099643 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-122c59bf-767e-4c11-8b7c-d294a8cc5088 tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1437 microversion: 2.1 time: 0.198437 Mar 29 02:09:24.100676 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 168/330] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:23 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1437 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:24.293052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b908e76-6010-4209-ab9b-868313f54168 tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:24.319225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b908e76-6010-4209-ab9b-868313f54168 tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] 10.222.0.36 "GET /compute/v2.1/flavors/1600687127" status: 200 len: 449 microversion: 2.55 time: 0.217052 Mar 29 02:09:24.319818 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 169/331] 10.222.0.36 () {60 vars in 1198 bytes} [Tue Mar 29 02:09:24 2022] GET /compute/v2.1/flavors/1600687127 => generated 449 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:24.338731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-dff7cbfc-44c3-48cc-9505-39a647b0b724 req-4ec79440-d016-4122-93f0-b1a12e76bd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e51124ce-fc16-4d10-9043-dbbf91490f58", "name": "network-vif-deleted", "tag": "99925391-b52c-4b79-a07f-c4bab191c1b2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:24.340271 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:24.340271 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:24.362639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dff7cbfc-44c3-48cc-9505-39a647b0b724 req-4ec79440-d016-4122-93f0-b1a12e76bd3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:24.363101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dff7cbfc-44c3-48cc-9505-39a647b0b724 req-4ec79440-d016-4122-93f0-b1a12e76bd3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:24.393961 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dff7cbfc-44c3-48cc-9505-39a647b0b724 req-4ec79440-d016-4122-93f0-b1a12e76bd3f service nova] Creating event network-vif-deleted:99925391-b52c-4b79-a07f-c4bab191c1b2 for instance e51124ce-fc16-4d10-9043-dbbf91490f58 on n-h1-828148-1 Mar 29 02:09:24.399936 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-dff7cbfc-44c3-48cc-9505-39a647b0b724 req-4ec79440-d016-4122-93f0-b1a12e76bd3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066630 Mar 29 02:09:24.402164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 170/332] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:24.412265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9befab4f-6574-413a-90c0-873be5d83b09 tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] Action: 'update', calling method: .version_select at 0x7f87263c7280>, body: {"flavor": {"description": "new"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:24.424944 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:24.424944 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:24.688174 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9befab4f-6574-413a-90c0-873be5d83b09 tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1600687127" status: 200 len: 450 microversion: 2.55 time: 0.283908 Mar 29 02:09:24.689178 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 171/333] 10.222.0.36 () {62 vars in 1218 bytes} [Tue Mar 29 02:09:24 2022] PUT /compute/v2.1/flavors/1600687127 => generated 450 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:24.700340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:24.702035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:24.728642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:24.729504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:24.730648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:24.731293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:25.047421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:25.058697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:25.067397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:25.076073 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-910e6cee-f7cc-4e57-be5a-44410b4998c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.385701 Mar 29 02:09:25.080358 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 172/334] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:24 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:25.093027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f2b46c38-f5df-4248-8011-bb5b314f3fc3 tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:25.138656 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f2b46c38-f5df-4248-8011-bb5b314f3fc3 tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5725 microversion: 2.55 time: 0.056538 Mar 29 02:09:25.150521 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 173/335] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:09:25 2022] GET /compute/v2.1/flavors/detail => generated 5725 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:25.156957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:25.158826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:25.174474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:25.175337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:25.177294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:25.178117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:25.317958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:25.318962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:25.319667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lazy-loading 'fault' on Instance uuid e51124ce-fc16-4d10-9043-dbbf91490f58 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:25.506276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab245fc80a314ce9aec1d926d45da3bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a2cd5074a3e4fb4a8f929e433838fd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:25.521301 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91f7758b-d232-44fc-8ece-22e10449968f tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 200 len: 1313 microversion: 2.1 time: 0.367324 Mar 29 02:09:25.524044 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 174/336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:25 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:25.529390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cd93730c-eaa0-4594-aacd-7c839bf8739f tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:25.564493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cd93730c-eaa0-4594-aacd-7c839bf8739f tempest-FlavorsV255TestJSON-406641342 tempest-FlavorsV255TestJSON-406641342-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.55 time: 0.038980 Mar 29 02:09:25.565917 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 175/337] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Mar 29 02:09:25 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:25.581014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-657b78b4-9167-45d5-a2f2-92adad6af8bf tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:25.582176 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:25.582176 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:25.686484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-657b78b4-9167-45d5-a2f2-92adad6af8bf tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1600687127" status: 202 len: 0 microversion: 2.55 time: 0.110022 Mar 29 02:09:25.688217 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 176/338] 10.222.0.36 () {60 vars in 1201 bytes} [Tue Mar 29 02:09:25 2022] DELETE /compute/v2.1/flavors/1600687127 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:09:25.699870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d708ab82-414f-4b0a-b596-fbf8dbf9cfa0 tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:25.775262 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d708ab82-414f-4b0a-b596-fbf8dbf9cfa0 tempest-FlavorsV255TestJSON-1734146054 tempest-FlavorsV255TestJSON-1734146054-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.081975 Mar 29 02:09:25.778813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 177/339] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:09:25 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:26.098403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:26.099797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:26.109265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:26.110629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:26.111683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:26.112124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:26.753332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:26.763534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:26.765966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:26.767490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-403fe2cb-7ed2-4d93-9af1-d642ec705567 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.673099 Mar 29 02:09:26.768717 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 178/340] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:26 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:09:26.773882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:26.775987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] [instance: e51124ce-fc16-4d10-9043-dbbf91490f58] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:26.783275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:26.783929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:26.784883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:26.785469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:26.930545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] HTTP exception thrown: Instance e51124ce-fc16-4d10-9043-dbbf91490f58 could not be found. Mar 29 02:09:26.930545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] Returning 404 to user: Instance e51124ce-fc16-4d10-9043-dbbf91490f58 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:26.930545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5352640d-f53c-43ac-a6eb-89aafb88c06b tempest-ServerDiagnosticsNegativeTest-999923048 tempest-ServerDiagnosticsNegativeTest-999923048-project] 10.222.0.36 "GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58" status: 404 len: 111 microversion: 2.1 time: 0.160108 Mar 29 02:09:26.931318 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 179/341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:26 2022] GET /compute/v2.1/servers/e51124ce-fc16-4d10-9043-dbbf91490f58 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:27.792631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:27.793286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:27.802038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:27.802687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:27.803642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:27.804223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:28.182858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:28.191946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:28.193826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:28.195195 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-37c2307b-83d7-44ea-a3c6-6c2956f420a3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.406309 Mar 29 02:09:28.206378 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 180/342] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:27 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:29.154830 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5651e092-cec8-4c51-8f59-4478f7fec463 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.529165 Mar 29 02:09:29.161166 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 163/343] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:09:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:29.166615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6a64d9b-5995-40f6-a308-63166e931ae9 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Action: 'create', calling method: .version_select at 0x7f8724295d30>, body: {"pool": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:29.213750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:29.214043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:29.223762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:29.224214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:29.225030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:29.225471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:29.804562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:29.815463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:29.816984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:29.818334 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-474b0673-ea00-4f40-8b60-40342e771a0c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.608727 Mar 29 02:09:29.818997 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 164/344] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:29 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:09:30.837621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:30.838446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:30.853780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:30.854675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:30.856727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:30.858399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:31.191844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:31.204710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:31.206963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:31.209884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e778ba88-7980-4a71-b8cb-2e50471e0d03 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.375490 Mar 29 02:09:31.210622 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 165/345] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:30 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:32.236070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:32.237842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:32.256622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:32.256622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:32.256622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:32.256622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:32.684090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:32.697330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:32.699726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:32.702040 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13d458f6-c35f-458b-a075-2d65512b24ba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.477285 Mar 29 02:09:32.703392 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 166/346] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:32 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:33.006166 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6a64d9b-5995-40f6-a308-63166e931ae9 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.843780 Mar 29 02:09:33.007129 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 181/347] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:09:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:33.019168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c74458f3-f676-4030-8618-e6a3b805ccf0 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Action: 'create', calling method: .version_select at 0x7f872405d550>, body: {"pool": null} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:33.722446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:33.722786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:33.733140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:33.733579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:33.734350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:33.734774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:34.424120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:34.445714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:34.453299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:34.456333 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e25a274-91e7-4273-91b3-5904efcb95c2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1566 microversion: 2.25 time: 0.737388 Mar 29 02:09:34.459724 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 182/348] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:33 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1566 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:35.479514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:35.483092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:35.512253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:35.512253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:35.512253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:35.512253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:36.034948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:36.044281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:36.046171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:36.047528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8ab8e47-e3c6-4075-847d-b31e0c41d0cf tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1556 microversion: 2.25 time: 0.572111 Mar 29 02:09:36.048381 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 183/349] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:35 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1556 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:36.411572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Calling method '.version_select at 0x7f8724295670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:36.412476 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:36.412476 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:36.414535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:36.415076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:36.446268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:36.446838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:36.464284 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c74458f3-f676-4030-8618-e6a3b805ccf0 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.448960 Mar 29 02:09:36.465447 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 167/350] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:09:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:36.484724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:36.486071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:36.495359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4a9ee82-1adc-4c45-bb81-c8715bd92244 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.445727 Mar 29 02:09:36.502039 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 184/351] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:36.507275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2e53ae8-cc79-4e1c-ae36-75a6fa18ddd9 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '.version_select at 0x7f8724295940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:36.508614 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:36.508614 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:36.510360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e53ae8-cc79-4e1c-ae36-75a6fa18ddd9 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:36.510839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e53ae8-cc79-4e1c-ae36-75a6fa18ddd9 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:36.525456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2e53ae8-cc79-4e1c-ae36-75a6fa18ddd9 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 436 microversion: 2.25 time: 0.021871 Mar 29 02:09:36.526438 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 185/352] 10.222.0.36 () {60 vars in 1183 bytes} [Tue Mar 29 02:09:36 2022] GET /compute/v2.1/os-migrations => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:36.531094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bdfb4904-04ee-4d05-a877-97a1bb03be46 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f8724cf6550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:36.835531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-192b6a2e-8350-4bbd-a36a-c288e6d9e467 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1300059344", "ram": 512, "vcpus": 1, "disk": 10, "id": 1523637214, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:36.837206 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:36.837206 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:36.907493 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-192b6a2e-8350-4bbd-a36a-c288e6d9e467 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.440836 Mar 29 02:09:36.908075 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 168/353] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:36 2022] POST /compute/v2.1/flavors => generated 416 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:36.973871 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bdfb4904-04ee-4d05-a877-97a1bb03be46 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/472c1103-dd4e-47de-a13a-d9146fb05e83" status: 200 len: 142 microversion: 2.1 time: 0.445793 Mar 29 02:09:36.974631 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 186/354] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:09:36 2022] GET /compute/v2.1/os-floating-ips/472c1103-dd4e-47de-a13a-d9146fb05e83 => generated 142 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:36.979360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:36.980165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:36.999357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.001916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.001916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.002382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.347907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f903c224-d664-4181-9d12-1e3ee9d2f902 tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Calling method '.version_select at 0x7f872405d790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.348825 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.348825 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:37.350171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f903c224-d664-4181-9d12-1e3ee9d2f902 tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'a6f2d18004f54c77b59a086d24ed59ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91924c07ba104b20a3348d9d7c00adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:37.350813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f903c224-d664-4181-9d12-1e3ee9d2f902 tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:37.351607 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f903c224-d664-4181-9d12-1e3ee9d2f902 tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/n-h2-828148-1/search" status: 403 len: 117 microversion: 2.1 time: 0.431683 Mar 29 02:09:37.353066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 169/355] 10.222.0.36 () {58 vars in 1208 bytes} [Tue Mar 29 02:09:36 2022] GET /compute/v2.1/os-hypervisors/n-h2-828148-1/search => generated 117 bytes in 444 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:37.486809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b3bd250-56b1-4e75-974b-03535c2866d1 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.506529 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0b3bd250-56b1-4e75-974b-03535c2866d1 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] HTTP exception thrown: Flavor 1523637214 has no extra specs with key hw:cpu_thread_policy. Mar 29 02:09:37.507344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b3bd250-56b1-4e75-974b-03535c2866d1 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Returning 404 to user: Flavor 1523637214 has no extra specs with key hw:cpu_thread_policy. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:37.507730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 28e8a0c5-a941-47af-b28c-c046992c73c3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:09:37.509068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b3bd250-56b1-4e75-974b-03535c2866d1 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] 10.222.0.36 "GET /compute/v2.1/flavors/1523637214/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.154906 Mar 29 02:09:37.514807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 170/356] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:09:37 2022] GET /compute/v2.1/flavors/1523637214/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:37.522310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7cb34ec4-d516-46b4-839d-2fd7c7bf1583 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f872405d430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.575841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbb54735-5695-4eee-8948-58d7d9a25e0c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 2048 microversion: 2.25 time: 0.599065 Mar 29 02:09:37.577079 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 187/357] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:36 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 2048 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:37.655850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.658279 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.658279 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:37.660367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.661159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.663495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.664677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.731858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17b10dda-e638-4058-b7e0-3d281cea7d61 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.152638 Mar 29 02:09:37.732437 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 188/358] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:37.748340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Calling method '.version_select at 0x7f8724295e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.749291 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:search failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.749291 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:37.750766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.751285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.765258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Mar 29 02:09:37.765954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:37.767013 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-128cdfec-d1d6-4432-9598-90e19d1aa6e8 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.033618 Mar 29 02:09:37.770478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 189/359] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:09:37 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:37.917177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-320526e9-a178-4b6b-85ae-7fc8606ed206 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Calling method '.version_select at 0x7f87242e85e0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.919633 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list-detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.919633 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:37.921638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-320526e9-a178-4b6b-85ae-7fc8606ed206 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e908decacbd140188d6c67beea33691c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c152d5fd9d4f919fe5143ac0742e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:37.922575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-320526e9-a178-4b6b-85ae-7fc8606ed206 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:37.923528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-320526e9-a178-4b6b-85ae-7fc8606ed206 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.154378 Mar 29 02:09:37.925476 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 190/360] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:09:37 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 157 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:37.940670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96da71dd-20d5-40c5-becd-58de97091c1a tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:37.940670 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.940670 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:37.941370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96da71dd-20d5-40c5-becd-58de97091c1a tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '05a51aadfb3a47e8b8472a945be2a53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1da94ec1c4bc9ae6b8199131046cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:37.942172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96da71dd-20d5-40c5-becd-58de97091c1a tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:37.943772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96da71dd-20d5-40c5-becd-58de97091c1a tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] 10.222.0.36 "POST /compute/v2.1/flavors/1523637214/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.016453 Mar 29 02:09:37.950736 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 191/361] 10.222.0.36 () {60 vars in 1223 bytes} [Tue Mar 29 02:09:37 2022] POST /compute/v2.1/flavors/1523637214/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:37.956508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:37.959890 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:37.959890 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:37.961958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.962563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:37.964140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:37.964733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:38.004017 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd32d0eb-a1c3-4f6f-8c82-313e1d63c05c tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.051709 Mar 29 02:09:38.006490 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 192/362] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:09:37 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:38.012988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2132221207", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "2a492824-76d3-4dc8-9d37-f81c1b4928a3"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:38.133722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] validate_networks() for [('2a492824-76d3-4dc8-9d37-f81c1b4928a3', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:09:39.719936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:09:39.721114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:09:39.721765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:09:39.722344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:09:39.725360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:09:39.734693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:39.735642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:39.737110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:39.737725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:39.757440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:39.764165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for user f540281478cf4d929afbce240e2f4c66 and project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:39.778520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:09:39.781705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:09:39.919119 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5caf778c-7aad-4e42-9cc4-c9ae6adf02cc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.908881 Mar 29 02:09:39.920054 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 193/363] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:09:39.927748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Calling method '.version_select at 0x7f87242e8c10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:39.928932 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:39.928932 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:39.937179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:39.938087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:39.995515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:39.998993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.028160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.028391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.036441 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-852dfc80-ae00-4bb6-9065-401a99ef8e72 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.114986 Mar 29 02:09:40.041988 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 194/364] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:40.047027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66963eb4-036f-4d00-8d4c-26b14d60bb00 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Calling method '.version_select at 0x7f87242e8430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.052006 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.052006 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:40.055731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-66963eb4-036f-4d00-8d4c-26b14d60bb00 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e908decacbd140188d6c67beea33691c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c152d5fd9d4f919fe5143ac0742e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.056656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66963eb4-036f-4d00-8d4c-26b14d60bb00 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:40.057769 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66963eb4-036f-4d00-8d4c-26b14d60bb00 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014675 Mar 29 02:09:40.062764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 195/365] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:40.065634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b2ace66-c871-4d27-85c8-c53ab48a1039 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:40.067069 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.067069 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:40.220071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7cb34ec4-d516-46b4-839d-2fd7c7bf1583 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/472c1103-dd4e-47de-a13a-d9146fb05e83" status: 202 len: 0 microversion: 2.1 time: 2.702403 Mar 29 02:09:40.225205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 171/366] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:37 2022] DELETE /compute/v2.1/os-floating-ips/472c1103-dd4e-47de-a13a-d9146fb05e83 => generated 0 bytes in 2706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:40.227939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.229342 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.229342 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.231094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.237548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.238536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.239173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.250196 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b2ace66-c871-4d27-85c8-c53ab48a1039 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1523637214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.189880 Mar 29 02:09:40.250778 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 196/367] 10.222.0.36 () {60 vars in 1223 bytes} [Tue Mar 29 02:09:40 2022] POST /compute/v2.1/flavors/1523637214/os-extra_specs => generated 66 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:40.269385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.270659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:40.272486 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1058f2d4-67ce-4966-ac59-1d0f511ec956 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.048530 Mar 29 02:09:40.273832 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 172/368] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-services => generated 944 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:40.279623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1b03825-e32e-401b-8e36-d3f8dd420fde tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Calling method '.version_select at 0x7f872405d160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.280656 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.280656 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.286421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1b03825-e32e-401b-8e36-d3f8dd420fde tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'a6f2d18004f54c77b59a086d24ed59ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91924c07ba104b20a3348d9d7c00adce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.287183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1b03825-e32e-401b-8e36-d3f8dd420fde tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:40.288880 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1b03825-e32e-401b-8e36-d3f8dd420fde tempest-HypervisorAdminNegativeUnderV252Test-630093148 tempest-HypervisorAdminNegativeUnderV252Test-630093148-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.013586 Mar 29 02:09:40.294241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 173/369] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:40.300193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5aa402a9-ce51-4096-ae1a-a551cf286f4d tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Calling method '.version_select at 0x7f87240590d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.301246 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:statistics failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.301246 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.302779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5aa402a9-ce51-4096-ae1a-a551cf286f4d tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e908decacbd140188d6c67beea33691c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c152d5fd9d4f919fe5143ac0742e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.303597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5aa402a9-ce51-4096-ae1a-a551cf286f4d tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:40.323624 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5aa402a9-ce51-4096-ae1a-a551cf286f4d tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.019874 Mar 29 02:09:40.323624 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 174/370] 10.222.0.36 () {58 vars in 1178 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:40.330092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb679efa-2c57-425b-a51b-6cb4bf9549e5 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f872405daf0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.588380 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb679efa-2c57-425b-a51b-6cb4bf9549e5 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.267576 Mar 29 02:09:40.589242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 175/371] 10.222.0.36 () {58 vars in 1163 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:40.598425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddd7ff3e-ca78-4685-9413-cfadd4cec750 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.601244 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.601244 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.602906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ddd7ff3e-ca78-4685-9413-cfadd4cec750 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '05a51aadfb3a47e8b8472a945be2a53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1da94ec1c4bc9ae6b8199131046cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.603724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddd7ff3e-ca78-4685-9413-cfadd4cec750 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:40.604944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddd7ff3e-ca78-4685-9413-cfadd4cec750 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] 10.222.0.36 "DELETE /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014611 Mar 29 02:09:40.606509 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 176/372] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:09:40 2022] DELETE /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:40.623088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.630118 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.630118 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.633499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.636869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.637852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.641138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.663488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.676232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.678307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:40.693646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2aa731da-097f-415a-b908-7f12dd07f8a7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1262 microversion: 2.25 time: 0.431448 Mar 29 02:09:40.703364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 197/373] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1262 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:40.718231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Calling method '.version_select at 0x7f87242e88b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.724104 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:servers failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.724104 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:40.742855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.743489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:40.758982 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86c80b86-910d-48df-b2e3-99fe82cc4340 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-828148-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.151113 Mar 29 02:09:40.760794 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 177/374] 10.222.0.36 () {58 vars in 1193 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-services?host=n-d-828148-1&binary=xxx => generated 16 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:40.771806 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] HTTP exception thrown: No hypervisor matching '9b9f317d-9f83-4bd6-bf3d-07e559acc7a1' could be found. Mar 29 02:09:40.772992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] Returning 404 to user: No hypervisor matching '9b9f317d-9f83-4bd6-bf3d-07e559acc7a1' could be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:40.776492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bff529d8-5ff5-4546-9c74-5df2cb55c9d9 tempest-HypervisorAdminNegativeUnderV252Test-906564158 tempest-HypervisorAdminNegativeUnderV252Test-906564158-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/9b9f317d-9f83-4bd6-bf3d-07e559acc7a1/servers" status: 404 len: 123 microversion: 2.1 time: 0.071219 Mar 29 02:09:40.805398 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 198/375] 10.222.0.36 () {58 vars in 1280 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-hypervisors/9b9f317d-9f83-4bd6-bf3d-07e559acc7a1/servers => generated 123 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:40.838202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dbd387f0-5aee-449c-abe2-14bddd0d5f3f tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f87242e8dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.948298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Calling method '.version_select at 0x7f8724059430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:40.949622 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:40.949622 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:40.952073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:40.953113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.012488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.014255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.035642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.037896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.051023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0df80946-a625-4150-aa0f-512be17cfca6 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.279059 Mar 29 02:09:41.051889 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 178/376] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:41.061538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bb6bb411-465e-429f-b093-64db6595bee7 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:41.063855 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.063855 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:41.107652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bb6bb411-465e-429f-b093-64db6595bee7 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/1523637214/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.054440 Mar 29 02:09:41.121024 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 179/377] 10.222.0.36 () {60 vars in 1223 bytes} [Tue Mar 29 02:09:41 2022] POST /compute/v2.1/flavors/1523637214/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:41.131342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.134253 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.134253 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:41.138869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.139621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.141341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.141781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.176375 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0db9d61-a50c-4874-8bb2-2ddc37e6f02d tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.050385 Mar 29 02:09:41.184343 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 180/378] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-services => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:41.189562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33c92b41-f820-4fc9-aa70-136d9b9febfe tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Calling method '.version_select at 0x7f8724115b80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.190545 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.190545 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:41.194298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-33c92b41-f820-4fc9-aa70-136d9b9febfe tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e908decacbd140188d6c67beea33691c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c152d5fd9d4f919fe5143ac0742e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:41.194298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33c92b41-f820-4fc9-aa70-136d9b9febfe tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.194298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-33c92b41-f820-4fc9-aa70-136d9b9febfe tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.007746 Mar 29 02:09:41.194298 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 181/379] 10.222.0.36 () {58 vars in 1172 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.203399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ec78936-f328-4c80-a577-af72a6ea73f8 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:41.204810 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.204810 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:41.206023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ec78936-f328-4c80-a577-af72a6ea73f8 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '05a51aadfb3a47e8b8472a945be2a53e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1da94ec1c4bc9ae6b8199131046cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:41.206837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ec78936-f328-4c80-a577-af72a6ea73f8 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.207789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ec78936-f328-4c80-a577-af72a6ea73f8 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616 tempest-FlavorsExtraSpecsNegativeTestJSON-563996616-project] 10.222.0.36 "PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.012148 Mar 29 02:09:41.209477 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 182/380] 10.222.0.36 () {60 vars in 1264 bytes} [Tue Mar 29 02:09:41 2022] PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.234023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.239323 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.239323 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:41.243676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.246412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.248515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.251625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.268339 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dbd387f0-5aee-449c-abe2-14bddd0d5f3f tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.458600 Mar 29 02:09:41.269361 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 199/381] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:09:40 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:41.273965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc02d212-3a31-4035-a702-248c9e0cd1ff tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Calling method '.version_select at 0x7f8724cf6550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.276530 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:uptime failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.276530 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.278583 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-cc02d212-3a31-4035-a702-248c9e0cd1ff tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] HTTP exception thrown: Hypervisor with ID 'd35f346a-7c09-4528-a6fd-277901487fe4' could not be found. Mar 29 02:09:41.281484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc02d212-3a31-4035-a702-248c9e0cd1ff tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Returning 404 to user: Hypervisor with ID 'd35f346a-7c09-4528-a6fd-277901487fe4' could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.284091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc02d212-3a31-4035-a702-248c9e0cd1ff tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/d35f346a-7c09-4528-a6fd-277901487fe4/uptime" status: 404 len: 123 microversion: 2.1 time: 0.013789 Mar 29 02:09:41.286742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 200/382] 10.222.0.36 () {58 vars in 1277 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-hypervisors/d35f346a-7c09-4528-a6fd-277901487fe4/uptime => generated 123 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.295046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f338c14a-e674-450a-9ce9-262bce9fe5c3 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.301308 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.301308 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.322738 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee7f7293-75f5-4180-8b6c-358e47904cd8 tempest-ServicesAdminNegativeTestJSON-1161153681 tempest-ServicesAdminNegativeTestJSON-1161153681-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.100352 Mar 29 02:09:41.322738 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 183/383] 10.222.0.36 () {58 vars in 1197 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:41.323436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cacedfa7-15ea-4ae6-96ed-009aad9b5907 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f872405de50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.343266 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f338c14a-e674-450a-9ce9-262bce9fe5c3 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] HTTP exception thrown: Flavor 1523637214 has no extra specs with key hw:cpu_thread_policy. Mar 29 02:09:41.345433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f338c14a-e674-450a-9ce9-262bce9fe5c3 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Returning 404 to user: Flavor 1523637214 has no extra specs with key hw:cpu_thread_policy. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.346725 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f338c14a-e674-450a-9ce9-262bce9fe5c3 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1523637214/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.057585 Mar 29 02:09:41.347864 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 201/384] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:09:41 2022] DELETE /compute/v2.1/flavors/1523637214/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.355447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Calling method '.version_select at 0x7f8724d13d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.357879 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.357879 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.359917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.364002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.406139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.406850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.424340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.425787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.435842 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-564d9961-af0f-421e-859c-5039a401878e tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086419 Mar 29 02:09:41.437286 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 202/385] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:41.699099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f09d570-f958-4f47-9fd5-cc01f09fa4b7 tempest-ServicesAdminNegativeTestJSON-1636123051 tempest-ServicesAdminNegativeTestJSON-1636123051-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.700570 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.700570 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.702354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f09d570-f958-4f47-9fd5-cc01f09fa4b7 tempest-ServicesAdminNegativeTestJSON-1636123051 tempest-ServicesAdminNegativeTestJSON-1636123051-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'bd5d22da3b0146e1b9995b99b73a9be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60941df98afb4b1d9a97a7289efcb450', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:41.703159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f09d570-f958-4f47-9fd5-cc01f09fa4b7 tempest-ServicesAdminNegativeTestJSON-1636123051 tempest-ServicesAdminNegativeTestJSON-1636123051-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.704124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f09d570-f958-4f47-9fd5-cc01f09fa4b7 tempest-ServicesAdminNegativeTestJSON-1636123051 tempest-ServicesAdminNegativeTestJSON-1636123051-project] 10.222.0.36 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.265717 Mar 29 02:09:41.709279 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 203/386] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-services => generated 112 bytes in 271 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.714956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8309af45-db93-45e5-937a-039eeb5d0b4b tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:41.716903 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.716903 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.718632 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8309af45-db93-45e5-937a-039eeb5d0b4b tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] HTTP exception thrown: Request body and URI mismatch Mar 29 02:09:41.720485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8309af45-db93-45e5-937a-039eeb5d0b4b tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.721517 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8309af45-db93-45e5-937a-039eeb5d0b4b tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010909 Mar 29 02:09:41.725108 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 204/387] 10.222.0.36 () {60 vars in 1264 bytes} [Tue Mar 29 02:09:41 2022] PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes => generated 73 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:09:41.728266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43d7bf91-c204-4bdf-8757-aedf657720b2 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Calling method '.version_select at 0x7f87242e8310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.729395 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:41.729395 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:41.731673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43d7bf91-c204-4bdf-8757-aedf657720b2 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e908decacbd140188d6c67beea33691c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9c152d5fd9d4f919fe5143ac0742e1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:41.732485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43d7bf91-c204-4bdf-8757-aedf657720b2 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:41.733507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43d7bf91-c204-4bdf-8757-aedf657720b2 tempest-HypervisorAdminNegativeTestJSON-779973579 tempest-HypervisorAdminNegativeTestJSON-779973579-project] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.010152 Mar 29 02:09:41.734457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 205/388] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:41.739288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:41.740116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:41.767279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.775126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:41.778311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:41.780064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:42.021545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:42.033984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:42.035638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:42.036922 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b779011-1a6d-4ec9-8720-e776e3cec831 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1258 microversion: 2.25 time: 0.301402 Mar 29 02:09:42.037996 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 206/389] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:41 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1258 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:42.049144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5e82688-5c0d-4b98-a9fa-8e278e41a901 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:42.050760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5e82688-5c0d-4b98-a9fa-8e278e41a901 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:42.051792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5e82688-5c0d-4b98-a9fa-8e278e41a901 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.012462 Mar 29 02:09:42.053659 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 207/390] 10.222.0.36 () {60 vars in 1264 bytes} [Tue Mar 29 02:09:42 2022] PUT /compute/v2.1/flavors/1523637214/os-extra_specs/hw:numa_nodes => generated 117 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:09:42.058354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e83b333b-ac1a-47c0-9e81-5d9d9a4e1bb1 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Calling method '.version_select at 0x7f87242e8310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:42.060982 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:42.060982 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:42.061784 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e83b333b-ac1a-47c0-9e81-5d9d9a4e1bb1 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] HTTP exception thrown: Hypervisor with ID 'bd555a7b-a55d-43e5-87ad-5ccc766cfe77' could not be found. Mar 29 02:09:42.062422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e83b333b-ac1a-47c0-9e81-5d9d9a4e1bb1 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] Returning 404 to user: Hypervisor with ID 'bd555a7b-a55d-43e5-87ad-5ccc766cfe77' could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:42.063214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e83b333b-ac1a-47c0-9e81-5d9d9a4e1bb1 tempest-HypervisorAdminNegativeTestJSON-1827122224 tempest-HypervisorAdminNegativeTestJSON-1827122224-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors/bd555a7b-a55d-43e5-87ad-5ccc766cfe77" status: 404 len: 123 microversion: 2.1 time: 0.009089 Mar 29 02:09:42.064192 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 208/391] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:09:42 2022] GET /compute/v2.1/os-hypervisors/bd555a7b-a55d-43e5-87ad-5ccc766cfe77 => generated 123 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:09:42.069448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3ca6cc68-becc-4a4c-98b6-91d04478407a tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:42.077370 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:42.077370 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:42.158560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3ca6cc68-becc-4a4c-98b6-91d04478407a tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1523637214" status: 202 len: 0 microversion: 2.1 time: 0.093197 Mar 29 02:09:42.159998 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 209/392] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:09:42 2022] DELETE /compute/v2.1/flavors/1523637214 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:42.178261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da8c0070-7657-489b-81bd-f9cec37a64b4 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:42.228558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da8c0070-7657-489b-81bd-f9cec37a64b4 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659 tempest-FlavorsExtraSpecsNegativeTestJSON-467661659-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064482 Mar 29 02:09:42.229461 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 210/393] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:09:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:09:43.058023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:43.058978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:43.073930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:43.075636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:43.080306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:43.080306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:43.470257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:43.489550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:43.491304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:43.492822 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b274903d-7064-4a05-9931-55b1f33dcdd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1332 microversion: 2.25 time: 0.440340 Mar 29 02:09:43.497110 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 211/394] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:43 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1332 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:44.513985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:44.515454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:44.530895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:44.531441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:44.533995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:44.534704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:45.045784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:45.065463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:45.067530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:45.068655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74cc30fc-0010-401b-b61b-46f92e63e3d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1320 microversion: 2.25 time: 0.558660 Mar 29 02:09:45.069574 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 212/395] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:44 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:45.719135 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cacedfa7-15ea-4ae6-96ed-009aad9b5907 tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/94923aaa-ae9d-4710-b045-26da9d83fa87" status: 202 len: 0 microversion: 2.1 time: 4.404713 Mar 29 02:09:45.719701 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 184/396] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:41 2022] DELETE /compute/v2.1/os-floating-ips/94923aaa-ae9d-4710-b045-26da9d83fa87 => generated 0 bytes in 4406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:45.735402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b210f40c-0699-49b3-990a-7fcf2e1ec5ab tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f8724295ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:46.093034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:46.093964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:46.101914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:46.102661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:46.103603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:46.104125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:47.250103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:47.262531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:47.264531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:47.273114 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e6eef48-b5dd-403a-ac04-3c408fd10d37 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 1.181762 Mar 29 02:09:47.273806 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 185/397] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:46 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:48.283948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:48.284756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:48.292780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:48.293885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:48.294868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:48.295396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:48.985100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:49.000210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:49.001925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:49.005561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8e9dee9-cbab-4b73-bef2-35765f2d5ef4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.725277 Mar 29 02:09:49.007796 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 186/398] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:48 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:09:49.283277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-04d3693b-33ad-42a2-a062-edf6653a21f2 req-a41124fc-6687-419a-a68b-04dcbdf3f0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b90c86-71ca-4d35-9054-c7ecd9b1378e", "tag": "e139874d-b1f4-4d8a-8c23-436287526c98"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:49.284760 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:49.284760 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:49.302636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-04d3693b-33ad-42a2-a062-edf6653a21f2 req-a41124fc-6687-419a-a68b-04dcbdf3f0b8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:49.303078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-04d3693b-33ad-42a2-a062-edf6653a21f2 req-a41124fc-6687-419a-a68b-04dcbdf3f0b8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:49.356922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-04d3693b-33ad-42a2-a062-edf6653a21f2 req-a41124fc-6687-419a-a68b-04dcbdf3f0b8 service nova] Creating event network-changed:e139874d-b1f4-4d8a-8c23-436287526c98 for instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e on n-h1-828148-1 Mar 29 02:09:49.377246 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-04d3693b-33ad-42a2-a062-edf6653a21f2 req-a41124fc-6687-419a-a68b-04dcbdf3f0b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096973 Mar 29 02:09:49.378999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 187/399] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:49.987484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b210f40c-0699-49b3-990a-7fcf2e1ec5ab tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/95a65d3c-0b2e-435e-b364-02597dcc83c3" status: 202 len: 0 microversion: 2.1 time: 4.263203 Mar 29 02:09:49.988046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 213/400] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:45 2022] DELETE /compute/v2.1/os-floating-ips/95a65d3c-0b2e-435e-b364-02597dcc83c3 => generated 0 bytes in 4264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:49.998186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dc5129e4-5394-4b26-a338-a65cce711f0e tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] Calling method '.version_select at 0x7f87240d5700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:50.025726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:50.028072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:50.043911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:50.044899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:50.046685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:50.049373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:51.122800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:51.139512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:51.141077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:51.142189 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ba3cb744-897f-4158-96f2-492b4451c868 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 1.121016 Mar 29 02:09:51.143942 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 214/401] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:50 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:09:52.168552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:52.169903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:52.183581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:52.184031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:52.184939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:52.209242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:52.561334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:52.572619 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dc5129e4-5394-4b26-a338-a65cce711f0e tempest-FloatingIPDetailsTestJSON-947167849 tempest-FloatingIPDetailsTestJSON-947167849-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/4b437825-b93a-4665-b65c-65b24693af35" status: 202 len: 0 microversion: 2.1 time: 2.579923 Mar 29 02:09:52.573262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:52.573428 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 188/402] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:09:49 2022] DELETE /compute/v2.1/os-floating-ips/4b437825-b93a-4665-b65c-65b24693af35 => generated 0 bytes in 2582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:09:52.579540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:52.581320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95cd845f-f6dc-42e1-9208-9ffc67dc6522 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.417863 Mar 29 02:09:52.586572 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 215/403] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:52 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:53.224625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-763485866", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "336eaade-a886-4593-b3c5-291b209e342c"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:53.279258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f059fcd-480b-4553-b68a-a8230bf526d0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:53.309907 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f059fcd-480b-4553-b68a-a8230bf526d0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.734516 Mar 29 02:09:53.311588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 189/404] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:53.351592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] validate_networks() for [('336eaade-a886-4593-b3c5-291b209e342c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:09:53.879931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5bc0276e-d271-4c65-b0fa-270d656ff1f2 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-702074920", "id": 1181097416, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:53.881648 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:53.881648 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:54.056729 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5bc0276e-d271-4c65-b0fa-270d656ff1f2 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.738307 Mar 29 02:09:54.064656 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 190/405] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:53 2022] POST /compute/v2.1/flavors => generated 424 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:09:54.454511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca28bf7f-5e80-4283-af10-e0d3f3d0b71e tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:54.478850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca28bf7f-5e80-4283-af10-e0d3f3d0b71e tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.417039 Mar 29 02:09:54.502044 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 191/406] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:09:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:54.522916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:54.524256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:54.544781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:54.547080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:54.550293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:54.550293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:54.787207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:09:54.788312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:09:54.789023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:09:54.789695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:09:54.790600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:09:54.809615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:54.811224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:54.815498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:54.816206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:54.878216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Getting quotas for project 18bfb660f51f43dda11271fa73f58cd2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:54.887919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Getting quotas for user aac8878650d744f3a12ebbad01fac90c and project 18bfb660f51f43dda11271fa73f58cd2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:54.914785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:09:54.922007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:09:55.107130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c02f84f-9166-4fea-a409-bd883872480b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.516802 Mar 29 02:09:55.113094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 216/407] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:09:55.125138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f8fbcc6-4ba0-4fd1-8268-0b001b04d23e tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:55.166289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f8fbcc6-4ba0-4fd1-8268-0b001b04d23e tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.051885 Mar 29 02:09:55.167489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 217/408] 10.222.0.36 () {58 vars in 1181 bytes} [Tue Mar 29 02:09:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:55.587882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7f15aa4-fd5f-49d5-b406-77b9e5a0f727 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-745230795", "id": 2065234804, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:55.587882 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:55.587882 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:55.753332 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7f15aa4-fd5f-49d5-b406-77b9e5a0f727 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.584137 Mar 29 02:09:55.761393 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 218/409] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:09:55 2022] POST /compute/v2.1/flavors => generated 467 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:55.848004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:55.882229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:55.883725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:55.885023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74b744f7-7748-45c8-8566-e7fe83b778b3 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 1.373506 Mar 29 02:09:55.885535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 192/410] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:54 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:55.903072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9a7bb05-ce7d-487c-89bf-63be5e7300dc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:55.904144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9a7bb05-ce7d-487c-89bf-63be5e7300dc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:56.012005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e9a7bb05-ce7d-487c-89bf-63be5e7300dc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:56.022337 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9a7bb05-ce7d-487c-89bf-63be5e7300dc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1231 microversion: 2.1 time: 0.124105 Mar 29 02:09:56.032791 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 193/411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:55 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1231 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:56.036614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5646c578-1008-4d9e-b0af-ed06b2d8add4 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1943690135", "id": 1731229315, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:56.038273 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:56.038273 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:56.048045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-351573731", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:56.180378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:09:56.186934 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5646c578-1008-4d9e-b0af-ed06b2d8add4 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.162931 Mar 29 02:09:56.188126 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 194/412] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:56 2022] POST /compute/v2.1/flavors => generated 425 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:09:56.261902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Action: 'create', calling method: .version_select at 0x7f872405db80>, body: {"keypair": {"name": "tempest-keypair-1508149722", "type": "ssh", "user_id": "4370dc27c78142ffa88910160f8a9e81"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:56.367796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:56.382265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:56.716366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:09:56.716868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:09:56.717411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:09:56.717824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:09:56.718543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:09:56.740504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:56.741616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:56.742656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:56.743251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:56.774224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Getting quotas for project f52345b4968b43c084e21a9c840affaf. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:56.779831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Getting quotas for user bc3e059f77854460b855e0dd15bb2be5 and project f52345b4968b43c084e21a9c840affaf. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:56.800797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:09:56.803869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:09:56.959863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:56.975448 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2136cc76-b0c5-452b-b3cc-11286ac5f5cf tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.207156 Mar 29 02:09:56.982321 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 219/413] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:09:56.995349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:57.028690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-019433f0-fea4-4e7c-b1bf-8fecce22d057 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.839114 Mar 29 02:09:57.030957 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 195/414] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Mar 29 02:09:56 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 842 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:09:57.037906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43550d1b-e6b9-4ea7-949c-f405f6a043c3 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:57.074112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43550d1b-e6b9-4ea7-949c-f405f6a043c3 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040138 Mar 29 02:09:57.084379 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 196/415] 10.222.0.36 () {58 vars in 1181 bytes} [Tue Mar 29 02:09:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:09:57.093368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2526b6a2-15fe-496a-b82e-37e04a1d8dfe tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1271615549", "imageRef": "6bbc56f2-df71-4583-a4e4-4dc22315ed84", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:57.109091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed680622-9a18-4014-b8f2-612557ecf92c tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:57.130459 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed680622-9a18-4014-b8f2-612557ecf92c tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] 10.222.0.36 "GET /compute/v2.1/flavors/2065234804" status: 200 len: 467 microversion: 2.61 time: 0.146219 Mar 29 02:09:57.131006 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 220/416] 10.222.0.36 () {60 vars in 1198 bytes} [Tue Mar 29 02:09:56 2022] GET /compute/v2.1/flavors/2065234804 => generated 467 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:57.149859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:57.153097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:57.162036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:57.162496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:57.163605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:57.164033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:57.193862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-2526b6a2-15fe-496a-b82e-37e04a1d8dfe tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:09:57.419686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:57.431801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:57.435140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:57.436454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-217eb52b-38b3-4fd1-bf73-28968b31baee tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.304538 Mar 29 02:09:57.451002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 221/417] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:57 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:57.452269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c61cb42-cd2e-4d6a-9812-ccbdf09352f7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:57.452920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c61cb42-cd2e-4d6a-9812-ccbdf09352f7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:57.545061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c61cb42-cd2e-4d6a-9812-ccbdf09352f7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:57.553460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c61cb42-cd2e-4d6a-9812-ccbdf09352f7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1218 microversion: 2.1 time: 0.105026 Mar 29 02:09:57.554212 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 222/418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:57 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:57.559644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:57.560442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:57.570065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:57.570514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:57.571473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:57.571962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:57.709583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:57.722406 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1f15de1-b701-4d12-8827-98479f9686e8 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1283 microversion: 2.1 time: 0.166982 Mar 29 02:09:57.723891 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 223/419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:57 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1283 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:57.729196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Action: 'create', calling method: .version_select at 0x7f8724cf60d0>, body: {"keypair": {"name": "tempest-keypair-606163478", "type": "ssh", "user_id": "4370dc27c78142ffa88910160f8a9e81"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:57.765500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:57.776176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:57.839765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2526b6a2-15fe-496a-b82e-37e04a1d8dfe tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] HTTP exception thrown: Flavor's memory is too small for requested image. Mar 29 02:09:57.840477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2526b6a2-15fe-496a-b82e-37e04a1d8dfe tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:09:57.841610 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2526b6a2-15fe-496a-b82e-37e04a1d8dfe tempest-FlavorsV2NegativeTest-328475995 tempest-FlavorsV2NegativeTest-328475995-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.755959 Mar 29 02:09:57.846276 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 197/420] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:09:57 2022] POST /compute/v2.1/servers => generated 93 bytes in 761 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:09:57.852467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Action: 'create', calling method: .version_select at 0x7f87240d5820>, body: {"keypair": {"name": "tempest-keypair-1380048371"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:57.878142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:57.889199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for user da55b089ffbf4fe383c220193a34341c and project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:57.985891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:57.997959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:58.018226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c025cd3-32dd-4dbb-8c29-1a846bca628f tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.10 time: 0.292723 Mar 29 02:09:58.019688 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 224/421] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Mar 29 02:09:57 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 295 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:09:58.026029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a44a3e1-1658-4059-a6d5-0523ef4c9259 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:58.027784 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:58.027784 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:09:58.187199 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a44a3e1-1658-4059-a6d5-0523ef4c9259 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] 10.222.0.36 "PUT /compute/v2.1/flavors/2065234804" status: 200 len: 468 microversion: 2.61 time: 0.165914 Mar 29 02:09:58.195799 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 225/422] 10.222.0.36 () {62 vars in 1218 bytes} [Tue Mar 29 02:09:58 2022] PUT /compute/v2.1/flavors/2065234804 => generated 468 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:58.215373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5cd5167-1fd5-4197-89f5-e4ed4bcf4a5c tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Calling method '.version_select at 0x7f87242953a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:58.225881 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5cd5167-1fd5-4197-89f5-e4ed4bcf4a5c tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1508149722?user_id=4370dc27c78142ffa88910160f8a9e81" status: 200 len: 706 microversion: 2.10 time: 0.028268 Mar 29 02:09:58.227143 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 226/423] 10.222.0.36 () {60 vars in 1339 bytes} [Tue Mar 29 02:09:58 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1508149722?user_id=4370dc27c78142ffa88910160f8a9e81 => generated 706 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:09:58.232555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5c12bc09-111a-46b7-8df5-1507ec20e39f tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:58.271893 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5c12bc09-111a-46b7-8df5-1507ec20e39f tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 7158 microversion: 2.61 time: 0.043552 Mar 29 02:09:58.272755 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 227/424] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:09:58 2022] GET /compute/v2.1/flavors/detail => generated 7158 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:58.287638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Action: 'create', calling method: .version_select at 0x7f87242959d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2059774114", "type": "ssh"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:09:58.314343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:58.319893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:58.445324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:58.462010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for user da55b089ffbf4fe383c220193a34341c and project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:58.493644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-366bb907-3e2f-4b5b-a869-3baee0ba25c9 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.645994 Mar 29 02:09:58.494977 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 198/425] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:09:57 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:58.505353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-28747ecd-a0ac-4aec-91c6-13098e8bb4cb tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:58.565727 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-28747ecd-a0ac-4aec-91c6-13098e8bb4cb tempest-FlavorsV261TestJSON-1265942804 tempest-FlavorsV261TestJSON-1265942804-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 3685 microversion: 2.61 time: 0.068629 Mar 29 02:09:58.573104 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 199/426] 10.222.0.36 () {60 vars in 1165 bytes} [Tue Mar 29 02:09:58 2022] GET /compute/v2.1/flavors => generated 3685 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:58.579352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:58.581397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:58.602767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:58.602767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:58.602767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:58.602767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:58.994375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:09:59.002235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Getting quotas for user 56de3c37658740ee9aef7a9a083a500d and project 55256812341445f2bbdb3906dd50554b. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:09:59.029427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d6c080d-3672-4bbb-a061-cc26c47e5835 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2341 microversion: 2.10 time: 0.751003 Mar 29 02:09:59.030385 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 228/427] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:09:58 2022] POST /compute/v2.1/os-keypairs => generated 2341 bytes in 757 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:09:59.035614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.037219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:59.056384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:59.060304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:59.060304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:59.061078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:59.269807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:59.285173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:59.289531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:59.290746 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5733884a-3e8f-4f2f-891c-86526c0f3332 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.715503 Mar 29 02:09:59.293283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 200/428] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:09:58 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:59.297699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7e64145c-27fa-4a75-b660-e5b44607480c tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.302472 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:09:59.302472 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:09:59.368880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:59.383857 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cda34622-b67e-41f7-a380-1b983ca93ff6 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1214 microversion: 2.1 time: 0.352246 Mar 29 02:09:59.397910 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 229/429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:59 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1214 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:59.403801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.404548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:09:59.414739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:59.415419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:59.416301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:09:59.416878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:09:59.425925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7e64145c-27fa-4a75-b660-e5b44607480c tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2065234804" status: 202 len: 0 microversion: 2.61 time: 0.131430 Mar 29 02:09:59.426586 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 201/430] 10.222.0.36 () {60 vars in 1201 bytes} [Tue Mar 29 02:09:59 2022] DELETE /compute/v2.1/flavors/2065234804 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:09:59.433956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51913c12-fbb6-42e2-be66-8f402e6142aa tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Calling method '.version_select at 0x7f87242e9c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.440952 n-d-828148-1 devstack@n-api.service[103514]: WARNING oslo_db.sqlalchemy.utils [None req-51913c12-fbb6-42e2-be66-8f402e6142aa tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:09:59.455113 n-d-828148-1 devstack@n-api.service[103514]: WARNING oslo_db.sqlalchemy.utils [None req-51913c12-fbb6-42e2-be66-8f402e6142aa tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:09:59.469230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51913c12-fbb6-42e2-be66-8f402e6142aa tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "GET /compute/v2.1/os-keypairs?user_id=4370dc27c78142ffa88910160f8a9e81" status: 200 len: 1113 microversion: 2.10 time: 0.041437 Mar 29 02:09:59.471161 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 202/431] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Mar 29 02:09:59 2022] GET /compute/v2.1/os-keypairs?user_id=4370dc27c78142ffa88910160f8a9e81 => generated 1113 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:59.494879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d88f202a-038d-4cdc-b50d-c7b67c9a8944 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.546187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d88f202a-038d-4cdc-b50d-c7b67c9a8944 tempest-FlavorsV261TestJSON-1434878005 tempest-FlavorsV261TestJSON-1434878005-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.072675 Mar 29 02:09:59.559598 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 203/432] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:09:59 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:09:59.567671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2cbd162-3677-4bad-a02f-a5957acf0767 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Calling method '.version_select at 0x7f872405d5e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.668514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2cbd162-3677-4bad-a02f-a5957acf0767 tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2059774114" status: 204 len: 0 microversion: 2.10 time: 0.106934 Mar 29 02:09:59.669180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 204/433] 10.222.0.36 () {60 vars in 1324 bytes} [Tue Mar 29 02:09:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2059774114 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:09:59.679104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-68e1ebcb-dd71-4aa9-a644-72a4d05413cf tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Calling method '.version_select at 0x7f8724059040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.836902 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-68e1ebcb-dd71-4aa9-a644-72a4d05413cf tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606163478?user_id=4370dc27c78142ffa88910160f8a9e81" status: 204 len: 0 microversion: 2.10 time: 0.162195 Mar 29 02:09:59.840940 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 205/434] 10.222.0.36 () {60 vars in 1339 bytes} [Tue Mar 29 02:09:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606163478?user_id=4370dc27c78142ffa88910160f8a9e81 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:09:59.848914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ceba5f63-ece9-4349-9c0c-1a00a574f62d tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] Calling method '.version_select at 0x7f8724344dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:09:59.897998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:09:59.907518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5118da6-d1a9-41ad-bb17-69c7b5eea0d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1289 microversion: 2.1 time: 0.508357 Mar 29 02:09:59.908091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 230/435] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:09:59 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1289 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:09:59.953370 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ceba5f63-ece9-4349-9c0c-1a00a574f62d tempest-KeyPairsV210TestJSON-1573058367 tempest-KeyPairsV210TestJSON-1573058367-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508149722?user_id=4370dc27c78142ffa88910160f8a9e81" status: 204 len: 0 microversion: 2.10 time: 0.110394 Mar 29 02:09:59.954550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 206/436] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:09:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508149722?user_id=4370dc27c78142ffa88910160f8a9e81 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:10:00.159322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5dc28baa-0e4c-4a2e-bcd6-585d1b0cb50f req-c7b92ca8-8836-4309-90f8-68a6250cbf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b90c86-71ca-4d35-9054-c7ecd9b1378e", "name": "network-vif-plugged", "status": "completed", "tag": "e139874d-b1f4-4d8a-8c23-436287526c98"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:00.161829 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:00.161829 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:00.193773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5dc28baa-0e4c-4a2e-bcd6-585d1b0cb50f req-c7b92ca8-8836-4309-90f8-68a6250cbf85 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.195582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5dc28baa-0e4c-4a2e-bcd6-585d1b0cb50f req-c7b92ca8-8836-4309-90f8-68a6250cbf85 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.253842 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5dc28baa-0e4c-4a2e-bcd6-585d1b0cb50f req-c7b92ca8-8836-4309-90f8-68a6250cbf85 service nova] Creating event network-vif-plugged:e139874d-b1f4-4d8a-8c23-436287526c98 for instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e on n-h1-828148-1 Mar 29 02:10:00.266681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5dc28baa-0e4c-4a2e-bcd6-585d1b0cb50f req-c7b92ca8-8836-4309-90f8-68a6250cbf85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112873 Mar 29 02:10:00.272718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 231/437] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:00.310295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:00.310957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:00.322381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.323590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.325226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.326227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.404159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:00.405357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:00.421894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.422374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.427549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.427549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.639524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:00.657720 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e6691f0-4e5f-49d3-9e31-f135abeb1c7d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1288 microversion: 2.1 time: 0.257288 Mar 29 02:10:00.658541 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 232/438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:00 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1288 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:00.925876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:00.927126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:00.934706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.935152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:00.936084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:00.936543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:01.128528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:01.137459 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4da70e44-72db-42fa-a8fc-f351f244c46b tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1289 microversion: 2.1 time: 0.215830 Mar 29 02:10:01.146951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 233/439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:00 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1289 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:01.184252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:01.195130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:01.197002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:01.198296 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39b0a3a7-5c09-450b-95b4-00091caf9685 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.892525 Mar 29 02:10:01.199776 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 207/440] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:00 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:01.674798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:01.675550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:01.698163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:01.698637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:01.699425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:01.704025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:01.937164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:01.948433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68dbf51f-82e3-4432-bea2-27fa4f006f4d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1276 microversion: 2.1 time: 0.277200 Mar 29 02:10:01.953570 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 234/441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:01 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1276 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:02.156729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:02.157600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:02.174191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:02.176557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:02.179733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:02.180369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:02.225535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:02.226528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:02.251763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:02.255907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:02.258414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:02.260349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:03.101491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:03.114608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:03.116382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:03.130217 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-644ed093-fe9a-4a5c-a26d-6070102ebcb1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1362 microversion: 2.25 time: 0.916348 Mar 29 02:10:03.131391 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 235/442] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:02 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1362 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:03.135788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:03.137067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:03.154386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:03.154825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:03.155797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:03.156221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:03.222278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:03.238271 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f9f9451-c374-420e-afc5-4bed8967b5d4 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 1.086092 Mar 29 02:10:03.239324 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 208/443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:02 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:03.352442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:03.360688 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bb8f9f5-7d03-4f16-9994-2a27fdaacb9e tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1276 microversion: 2.1 time: 0.228228 Mar 29 02:10:03.361358 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 236/444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:03 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:04.149023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:04.149961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:04.161384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:04.161384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:04.161384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:04.161384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:04.256918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:04.258141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:04.284988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:04.285726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:04.288307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:04.291442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.218100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:05.227503 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78db1f15-04de-49cf-902f-3176e18d8dbe tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 0.975719 Mar 29 02:10:05.237361 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 237/445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:04 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:05.250687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:05.251589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:05.260983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:05.262122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.263174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:05.264214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.304489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:05.318883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:05.323829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:05.329894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a1bce28-c65c-4f1d-a1c8-ff271e871978 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1557 microversion: 2.25 time: 1.181134 Mar 29 02:10:05.332007 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 209/446] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:04 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1557 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:10:05.343622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2f1e1f7b-076a-4edd-9c8a-62d6385acb79 req-61f97709-9caa-49ee-8b93-f7407448df44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b03c7bf-7933-4632-b749-2b1a4bf40f80", "tag": "aeaecd63-85d0-4c09-8997-74064a224621"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:05.345684 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:05.345684 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:05.356022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2f1e1f7b-076a-4edd-9c8a-62d6385acb79 req-61f97709-9caa-49ee-8b93-f7407448df44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:05.356922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2f1e1f7b-076a-4edd-9c8a-62d6385acb79 req-61f97709-9caa-49ee-8b93-f7407448df44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.379844 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2f1e1f7b-076a-4edd-9c8a-62d6385acb79 req-61f97709-9caa-49ee-8b93-f7407448df44 service nova] Creating event network-changed:aeaecd63-85d0-4c09-8997-74064a224621 for instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 on n-h2-828148-1 Mar 29 02:10:05.385858 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2f1e1f7b-076a-4edd-9c8a-62d6385acb79 req-61f97709-9caa-49ee-8b93-f7407448df44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052154 Mar 29 02:10:05.387576 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 210/447] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:05.393122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:05.401115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:05.403375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:05.403530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.404322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:05.404759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:05.664676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:05.696553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1cc2257-4fd6-489a-9172-2f381ef07cba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.459074 Mar 29 02:10:05.699647 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 238/448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:05 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:06.245594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:06.246475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:06.261121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.262361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:06.263389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.264287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:06.607855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:06.617331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3da6bce4-54c6-46d3-ae48-e0b19c9c5b82 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 0.376182 Mar 29 02:10:06.617908 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 239/449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:06 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:10:06.716635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:06.717556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:06.730927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.731359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:06.732174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.733825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:06.835291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:06.932298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5772fc35-f7da-46c3-8fb0-ca13ac3f5a1b tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 2050 microversion: 2.25 time: 1.541972 Mar 29 02:10:06.941322 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 211/450] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:05 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 2050 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:06.956610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:06.956610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:06.968565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.969093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:06.973576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:06.974329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:07.138752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:07.155514 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcb3d890-7cb8-4037-b677-bc5d0aef0449 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.442405 Mar 29 02:10:07.156107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 240/451] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:06 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:10:07.439392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Calling method '.version_select at 0x7f87242e8e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:07.440779 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:07.440779 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:07.442442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:07.442943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:07.443751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:07.444187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:07.477100 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d12e0b5-1cfd-4749-877a-0916fa799f9b tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.318751 Mar 29 02:10:07.478716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 241/452] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:10:07 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:07.485151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1493550333", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "1731229315", "adminPass": "***", "networks": [{"uuid": "8f44b1e6-4d31-4a23-b9f3-7a33c5ab24a3"}], "security_groups": [{"name": "tempest-securitygroup--2064310644"}], "key_name": "tempest-keypair-1380048371", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:07.509659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:07.627344 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e44e37fc-70a8-461f-8580-8018f37f3899 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 2050 microversion: 2.25 time: 0.680463 Mar 29 02:10:07.645017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 212/453] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:06 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 2050 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:07.697359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] validate_networks() for [('8f44b1e6-4d31-4a23-b9f3-7a33c5ab24a3', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:10:08.143630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ef9623f-4b1d-4aaf-b754-816d1ff84657 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Calling method '.version_select at 0x7f872405d3a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:08.144989 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:08.144989 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:08.146821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0ef9623f-4b1d-4aaf-b754-816d1ff84657 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:08.147482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ef9623f-4b1d-4aaf-b754-816d1ff84657 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:08.148454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ef9623f-4b1d-4aaf-b754-816d1ff84657 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.512743 Mar 29 02:10:08.155103 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 213/454] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:10:07 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 520 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:08.165399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:08.166253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:08.176267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.176978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.177959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.178730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.612101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:08.624996 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71e0879a-57ff-4fe6-b910-a38c26225df7 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 0.468720 Mar 29 02:10:08.637385 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 214/455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:08 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:08.649383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:08.670088 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:08.670088 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:08.672739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.675276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.676284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.678201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.768004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9664dff7-e21f-48cf-a50c-148b47387128 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.129126 Mar 29 02:10:08.768809 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 215/456] 10.222.0.36 () {60 vars in 1216 bytes} [Tue Mar 29 02:10:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:08.774726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-69bd7ad6-0e95-4fce-90e2-b2f8d8847855 req-340d103f-7479-4b97-8bfc-b31ffdb33113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "616855f6-bf60-4249-bf70-07c170c10325", "tag": "ba99a210-149c-4283-9d12-ca4b219a5274"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:08.777423 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:08.777423 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:08.787112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69bd7ad6-0e95-4fce-90e2-b2f8d8847855 req-340d103f-7479-4b97-8bfc-b31ffdb33113 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.787797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69bd7ad6-0e95-4fce-90e2-b2f8d8847855 req-340d103f-7479-4b97-8bfc-b31ffdb33113 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.806847 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-69bd7ad6-0e95-4fce-90e2-b2f8d8847855 req-340d103f-7479-4b97-8bfc-b31ffdb33113 service nova] Creating event network-changed:ba99a210-149c-4283-9d12-ca4b219a5274 for instance 616855f6-bf60-4249-bf70-07c170c10325 on n-h2-828148-1 Mar 29 02:10:08.816873 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-69bd7ad6-0e95-4fce-90e2-b2f8d8847855 req-340d103f-7479-4b97-8bfc-b31ffdb33113 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046695 Mar 29 02:10:08.817589 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 216/457] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:08.822949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ad561ab-a75a-4616-b689-46c987aac846 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Calling method '.version_select at 0x7f8724d1bc10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:08.824635 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:08.824635 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:08.830686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ad561ab-a75a-4616-b689-46c987aac846 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:08.830686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ad561ab-a75a-4616-b689-46c987aac846 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:08.830686 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ad561ab-a75a-4616-b689-46c987aac846 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-828148-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009971 Mar 29 02:10:08.830686 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 217/458] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Mar 29 02:10:08 2022] GET /compute/v2.1/os-hosts/n-d-828148-1/reboot => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:08.839736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:08.840638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:08.849301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.850006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:08.851067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:08.851652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.326305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:10:09.327478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:10:09.328269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:10:09.328830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:10:09.329432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:10:09.353038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.353555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.358404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.359331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.412278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:10:09.424764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for user da55b089ffbf4fe383c220193a34341c and project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:10:09.463472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:10:09.473268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:10:09.629601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93e12afe-30e1-4c36-b3b7-f113a919975d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.149514 Mar 29 02:10:09.644732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 242/459] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:10:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:10:09.649821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:09.663591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:09.696858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.697448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.698860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.700752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.799356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:09.811319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c3e7979b-7615-4413-b99c-6382ae7d1a16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.981019 Mar 29 02:10:09.814950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 218/460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:08 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:09.826911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86089d85-f523-4e24-97de-bb117f312ce3 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Calling method '.version_select at 0x7f8724115c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:09.827935 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:reboot failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:09.827935 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:09.853622 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-86089d85-f523-4e24-97de-bb117f312ce3 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 29 02:10:09.854487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86089d85-f523-4e24-97de-bb117f312ce3 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:09.855464 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86089d85-f523-4e24-97de-bb117f312ce3 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.039435 Mar 29 02:10:09.857881 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 219/461] 10.222.0.36 () {58 vars in 1211 bytes} [Tue Mar 29 02:10:09 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:09.865752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:09.870852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:09.892583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.893070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:09.897610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:09.897610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:10.336639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:10.363241 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07dd4b4c-a266-44f8-a67f-5711543fac2c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e/action" status: 202 len: 0 microversion: 2.25 time: 0.705536 Mar 29 02:10:10.363241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 243/462] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:10:09 2022] POST /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:10:10.368205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb22a55e-3e4d-4716-8fa4-e6940b37b201 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 0.504194 Mar 29 02:10:10.371038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 220/463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:09 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:10.384408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f08ceb53-9c47-41a9-b86d-125e9a8c3f54 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:10.388333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f08ceb53-9c47-41a9-b86d-125e9a8c3f54 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:10.409136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2366a1d3-dbef-4a60-8b63-ddd9d716c40d tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Calling method '.version_select at 0x7f87242e9ca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:10.410293 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:10.410293 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:10.415131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2366a1d3-dbef-4a60-8b63-ddd9d716c40d tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:10.416853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2366a1d3-dbef-4a60-8b63-ddd9d716c40d tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:10.419363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2366a1d3-dbef-4a60-8b63-ddd9d716c40d tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-828148-1" status: 403 len: 109 microversion: 2.1 time: 0.027250 Mar 29 02:10:10.425139 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 221/464] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:10:10 2022] GET /compute/v2.1/os-hosts/n-d-828148-1 => generated 109 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:10.435281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:10.436438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:10.467312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:10.468342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:10.470754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:10.471317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:10.835376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f08ceb53-9c47-41a9-b86d-125e9a8c3f54 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:10.844593 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f08ceb53-9c47-41a9-b86d-125e9a8c3f54 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1265 microversion: 2.1 time: 0.483743 Mar 29 02:10:10.846532 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 244/465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:10 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1265 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:10.859589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3f05684-a29a-4b07-96d4-928556cfe88d tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Calling method '.version_select at 0x7f87242459d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:10.860583 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:10.860583 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:10.882387 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c3f05684-a29a-4b07-96d4-928556cfe88d tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 29 02:10:10.883140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3f05684-a29a-4b07-96d4-928556cfe88d tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:10.884210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3f05684-a29a-4b07-96d4-928556cfe88d tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035870 Mar 29 02:10:10.886895 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 245/466] 10.222.0.36 () {58 vars in 1190 bytes} [Tue Mar 29 02:10:10 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:11.060455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:11.082174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc1c5d55-cf1a-4db0-9f3b-9e61555fce93 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f8724295dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.153388 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-de013b5d-2b6b-4759-8c01-7ef7b81ccd30 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 2055 microversion: 2.25 time: 0.726763 Mar 29 02:10:11.155985 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 222/467] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:10 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 2055 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:11.169312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.174133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:11.179218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.180216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.181217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.181653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.187188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc1c5d55-cf1a-4db0-9f3b-9e61555fce93 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65" status: 200 len: 371 microversion: 2.1 time: 0.298334 Mar 29 02:10:11.188141 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 246/468] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:10:10 2022] GET /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65 => generated 371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:11.207555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0f18d1f-c18c-4631-812b-1ea7bf4c7701 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Calling method '.version_select at 0x7f8724245d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.208904 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:shutdown failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:11.208904 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:11.211114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d0f18d1f-c18c-4631-812b-1ea7bf4c7701 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:11.213099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0f18d1f-c18c-4631-812b-1ea7bf4c7701 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:11.214981 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0f18d1f-c18c-4631-812b-1ea7bf4c7701 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-828148-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.016601 Mar 29 02:10:11.223749 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 247/469] 10.222.0.36 () {58 vars in 1193 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/os-hosts/n-d-828148-1/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:11.232304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Action: 'update', calling method: .version_select at 0x7f8724063310>, body: {"quota_set": {"ram": "5120"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:11.235682 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:11.235682 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:11.326872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.327570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.328621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.329309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.476275 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48c18c80-dc82-48a4-9161-6674a406baff tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65" status: 200 len: 328 microversion: 2.1 time: 0.250219 Mar 29 02:10:11.490223 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 248/470] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:10:11 2022] PUT /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65 => generated 328 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:11.492936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7da0d5f-5d1d-4b32-beaa-0e0969ccc71a tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Calling method '.version_select at 0x7f87242e8670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.505827 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c7da0d5f-5d1d-4b32-beaa-0e0969ccc71a tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 29 02:10:11.506734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7da0d5f-5d1d-4b32-beaa-0e0969ccc71a tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:11.507772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7da0d5f-5d1d-4b32-beaa-0e0969ccc71a tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.019327 Mar 29 02:10:11.508586 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 249/471] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:11.518802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.519800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:11.529638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.530393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.531677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.532352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.537103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:11.552650 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbe410c8-7113-477f-a6f6-4c5f165a73dc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.386783 Mar 29 02:10:11.553265 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 223/472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:11.565365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0db6c56e-bed5-4e45-b8cf-6cb94c4967f7 req-9ffabaa5-72df-49a8-b2a6-bd515774486b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b03c7bf-7933-4632-b749-2b1a4bf40f80", "name": "network-vif-plugged", "status": "completed", "tag": "aeaecd63-85d0-4c09-8997-74064a224621"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:11.566920 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:11.566920 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:11.599384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0db6c56e-bed5-4e45-b8cf-6cb94c4967f7 req-9ffabaa5-72df-49a8-b2a6-bd515774486b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.599826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0db6c56e-bed5-4e45-b8cf-6cb94c4967f7 req-9ffabaa5-72df-49a8-b2a6-bd515774486b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.644601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0db6c56e-bed5-4e45-b8cf-6cb94c4967f7 req-9ffabaa5-72df-49a8-b2a6-bd515774486b service nova] Creating event network-vif-plugged:aeaecd63-85d0-4c09-8997-74064a224621 for instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 on n-h2-828148-1 Mar 29 02:10:11.654865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0db6c56e-bed5-4e45-b8cf-6cb94c4967f7 req-9ffabaa5-72df-49a8-b2a6-bd515774486b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090240 Mar 29 02:10:11.655910 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 224/473] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:11.668870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb11404b-3aa3-41ea-b8cc-a2e2157b4136 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.670318 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:11.670318 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:11.762230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb11404b-3aa3-41ea-b8cc-a2e2157b4136 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65" status: 202 len: 0 microversion: 2.1 time: 0.104967 Mar 29 02:10:11.764536 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 225/474] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:10:11 2022] DELETE /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:10:11.770868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be147d5d-7897-4670-8a2f-75c8b53274ac tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Calling method '.version_select at 0x7f8724350f70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.773376 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:start failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:11.773376 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:11.774493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be147d5d-7897-4670-8a2f-75c8b53274ac tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:11.775805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be147d5d-7897-4670-8a2f-75c8b53274ac tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:11.777878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be147d5d-7897-4670-8a2f-75c8b53274ac tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-d-828148-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.012158 Mar 29 02:10:11.778604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 226/475] 10.222.0.36 () {58 vars in 1190 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/os-hosts/n-d-828148-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:11.784594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ea4b87b6-18c4-4f6a-860a-cfaabbfdd98b tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f8724344160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.886967 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ea4b87b6-18c4-4f6a-860a-cfaabbfdd98b tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65" status: 200 len: 371 microversion: 2.1 time: 0.107075 Mar 29 02:10:11.890496 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 227/476] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/os-quota-sets/4bdcf43804694e3a9710c040b1e40e65 => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:11.902481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9706bc0-9c4f-4b69-b604-5df51e164a54 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Calling method '.version_select at 0x7f872405db80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.916669 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c9706bc0-9c4f-4b69-b604-5df51e164a54 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 29 02:10:11.918087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9706bc0-9c4f-4b69-b604-5df51e164a54 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:11.919272 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c9706bc0-9c4f-4b69-b604-5df51e164a54 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025507 Mar 29 02:10:11.924910 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 228/477] 10.222.0.36 () {58 vars in 1214 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:11.930405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:11.942545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:11.954041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.954704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:11.955647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:11.956236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:12.137801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:12.149506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d84c5716-dc0e-4749-a462-5fb0a5280dbc tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1331 microversion: 2.1 time: 0.637248 Mar 29 02:10:12.153145 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 250/478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1331 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:12.162959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbec6aea-288a-4d57-aea9-16de68576869 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Action: 'update', calling method: .version_select at 0x7f8724295e50>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:12.166242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbec6aea-288a-4d57-aea9-16de68576869 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:12.170568 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbec6aea-288a-4d57-aea9-16de68576869 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-828148-1" status: 400 len: 199 microversion: 2.1 time: 0.016131 Mar 29 02:10:12.171260 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 251/479] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:10:12 2022] PUT /compute/v2.1/os-hosts/n-d-828148-1 => generated 199 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:10:12.180438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:12.182071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:12.191428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:12.191983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:12.192777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:12.193281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:12.378698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:12.387826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-937fb0f6-eab8-457b-a521-93c15dd6e41e tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1261 microversion: 2.1 time: 0.461481 Mar 29 02:10:12.397482 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 229/480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:11 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1261 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:12.397482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b3a1ada-f0fb-4283-b6b5-5dc6c209ac30 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Action: 'update', calling method: .version_select at 0x7f87243444c0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:12.397482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b3a1ada-f0fb-4283-b6b5-5dc6c209ac30 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:12.397482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b3a1ada-f0fb-4283-b6b5-5dc6c209ac30 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-828148-1" status: 400 len: 189 microversion: 2.1 time: 0.005308 Mar 29 02:10:12.397482 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 230/481] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:10:12 2022] PUT /compute/v2.1/os-hosts/n-d-828148-1 => generated 189 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:10:12.405753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f896a74-52cf-4526-98a6-0c70ec7b2eb8 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f872405db80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:12.634721 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f896a74-52cf-4526-98a6-0c70ec7b2eb8 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.232356 Mar 29 02:10:12.648294 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 231/482] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:10:12 2022] GET /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a/defaults => generated 371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:12.648294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ab8191c-99f0-4033-bcf8-9edce0db4e50 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Action: 'update', calling method: .version_select at 0x7f87243c1f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:12.649845 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:12.649845 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:12.659366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ab8191c-99f0-4033-bcf8-9edce0db4e50 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'c74072845f384b21b1837d73e00eade2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d6b1a14ae0f4bdfb364539375e704f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:12.661867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ab8191c-99f0-4033-bcf8-9edce0db4e50 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:12.663950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ab8191c-99f0-4033-bcf8-9edce0db4e50 tempest-HostsAdminNegativeTestJSON-110267769 tempest-HostsAdminNegativeTestJSON-110267769-project] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-828148-1" status: 403 len: 111 microversion: 2.1 time: 0.023436 Mar 29 02:10:12.665946 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 232/483] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:10:12 2022] PUT /compute/v2.1/os-hosts/n-d-828148-1 => generated 111 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:12.673914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:12.675117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:12.692293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:12.697193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:12.700212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:12.700817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:12.891062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:13.003759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ed4cc3e-1356-4ab5-927a-8c140c2a4212 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 2035 microversion: 2.25 time: 0.830941 Mar 29 02:10:13.018346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 252/484] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:12 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 2035 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:13.018346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-666e5753-794b-44f8-ad71-8749b56a2a03 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Action: 'update', calling method: .version_select at 0x7f8724295dc0>, body: {"status": null, "maintenance_mode": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:13.018346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-666e5753-794b-44f8-ad71-8749b56a2a03 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:13.018346 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-666e5753-794b-44f8-ad71-8749b56a2a03 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/n-d-828148-1" status: 400 len: 127 microversion: 2.1 time: 0.006587 Mar 29 02:10:13.018346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 253/485] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:10:13 2022] PUT /compute/v2.1/os-hosts/n-d-828148-1 => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:10:13.022596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-828148-1", "block_migration": "auto"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:13.024063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:13.032821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.033848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:13.034573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.035052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:13.100185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'flavor' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:13.169472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Going to try to live migrate instance to n-h2-828148-1 {{(pid=103513) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:10:13.328013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:13.341041 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a957665c-6218-4f5b-b4d6-863b9d66938c tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.672642 Mar 29 02:10:13.345798 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 233/486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:12 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:13.356620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dccabeed-3940-409d-868f-853b97fbaae1 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Action: 'update', calling method: .version_select at 0x7f87243444c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:13.362231 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:13.362231 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:13.364196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.hosts [None req-dccabeed-3940-409d-868f-853b97fbaae1 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Enabling host nonexistent_hostname. Mar 29 02:10:13.386214 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-dccabeed-3940-409d-868f-853b97fbaae1 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Mar 29 02:10:13.386214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dccabeed-3940-409d-868f-853b97fbaae1 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:13.387216 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dccabeed-3940-409d-868f-853b97fbaae1 tempest-HostsAdminNegativeTestJSON-1668157600 tempest-HostsAdminNegativeTestJSON-1668157600-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038657 Mar 29 02:10:13.389350 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 234/487] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Mar 29 02:10:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:13.404713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Action: 'update', calling method: .version_select at 0x7f8724115ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:13.411213 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:13.411213 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:13.633417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.640646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:13.645006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.645604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:13.845530 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a97e10cc-61a4-40e7-b3b4-ec9a171d8017 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9" status: 200 len: 328 microversion: 2.1 time: 0.450345 Mar 29 02:10:13.856885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 235/488] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:10:13 2022] PUT /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9 => generated 328 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:13.858493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:13.859178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:13.868570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.869908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:13.870874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:13.871473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:14.345289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:14.359304 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee26a668-6267-48f8-8917-ea876ec17e14 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1536 microversion: 2.1 time: 0.505285 Mar 29 02:10:14.360453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 236/489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:13 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1536 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:14.374061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:14.375703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:14.394595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:14.396255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:14.397242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:14.398135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:14.616342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:14.634646 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8955ab7e-ba12-4106-b70f-4d85c2a36adc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1323 microversion: 2.1 time: 0.272810 Mar 29 02:10:14.637693 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 237/490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:14 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:14.644719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f8724d5cb80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:14.975887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:14.977293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:14.979678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:14.979678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:15.009401 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08f32399-cf04-4be8-a56c-23da138ba68f tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9/detail" status: 200 len: 916 microversion: 2.1 time: 0.370089 Mar 29 02:10:15.013129 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 238/491] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:10:14 2022] GET /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9/detail => generated 916 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:15.019180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:15.020282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:15.031864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:15.032888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:15.034094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:15.034908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:15.480848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:15.493769 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0a3bc8f-1ba1-4602-9817-4a3a223ae430 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.479346 Mar 29 02:10:15.496547 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 239/492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:15 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:15.505601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-10d03ee3-cbd0-41b0-a9c9-7237ff57fff9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'create', calling method: .version_select at 0x7f87240d5dc0>, body: {"pool": "c0340286-e227-4025-8852-c3316ef08961"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:17.677378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1595562-7692-4cbc-9252-0adc64bee0ea tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e/action" status: 202 len: 0 microversion: 2.25 time: 4.656737 Mar 29 02:10:17.678313 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 254/493] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:10:13 2022] POST /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e/action => generated 0 bytes in 4660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:10:17.685281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Action: 'update', calling method: .version_select at 0x7f8717fbd0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:17.690042 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:17.690042 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:18.030731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.031568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.032979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.033980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.082673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.083431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.084644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.085366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.235508 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88a22c19-bd0a-4780-b895-c3197f627022 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9?user_id=ae8c5333b1544c08907efd862ac51f64" status: 200 len: 328 microversion: 2.1 time: 0.555754 Mar 29 02:10:18.236976 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 255/494] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:10:17 2022] PUT /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9?user_id=ae8c5333b1544c08907efd862ac51f64 => generated 328 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:18.248246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c544382e-6e79-4015-be35-383f6466f0a2 req-0f80258c-2efb-4ebe-a34f-2924168ecf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616855f6-bf60-4249-bf70-07c170c10325", "name": "network-vif-plugged", "status": "completed", "tag": "ba99a210-149c-4283-9d12-ca4b219a5274"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:18.256591 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:18.256591 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:18.275693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c544382e-6e79-4015-be35-383f6466f0a2 req-0f80258c-2efb-4ebe-a34f-2924168ecf1f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.277113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c544382e-6e79-4015-be35-383f6466f0a2 req-0f80258c-2efb-4ebe-a34f-2924168ecf1f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.300531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c544382e-6e79-4015-be35-383f6466f0a2 req-0f80258c-2efb-4ebe-a34f-2924168ecf1f service nova] Creating event network-vif-plugged:ba99a210-149c-4283-9d12-ca4b219a5274 for instance 616855f6-bf60-4249-bf70-07c170c10325 on n-h2-828148-1 Mar 29 02:10:18.315419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c544382e-6e79-4015-be35-383f6466f0a2 req-0f80258c-2efb-4ebe-a34f-2924168ecf1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076927 Mar 29 02:10:18.316342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 256/495] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:18.321635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:18.323562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:18.347459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.347777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:18.348572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:18.349035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:19.224224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:19.234695 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f3a10c3-95cc-43e6-bf2b-d935f874f264 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.917073 Mar 29 02:10:19.243534 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 257/496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:18 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:19.243534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:19.243534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:19.252110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:19.252802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:19.253703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:19.254361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:19.927115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:19.936261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95ca9869-ccaa-48d3-ae28-3e304adee8ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1318 microversion: 2.1 time: 0.699218 Mar 29 02:10:19.955512 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 258/497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:19 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:19.964670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:19.972295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:19.982111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:19.982558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:19.983341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:19.983774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:20.384794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:20.397319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:20.399100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:20.400699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21cb8797-a747-4442-8c8b-84079dc3027f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1567 microversion: 2.25 time: 0.444061 Mar 29 02:10:20.412561 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 259/498] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:19 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1567 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:20.417567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f9b7dcb-7f05-460e-b8ff-506020018a1d tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f87241371f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:20.870764 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f9b7dcb-7f05-460e-b8ff-506020018a1d tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9?user_id=ae8c5333b1544c08907efd862ac51f64" status: 200 len: 370 microversion: 2.1 time: 0.456847 Mar 29 02:10:20.876883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 260/499] 10.222.0.36 () {58 vars in 1322 bytes} [Tue Mar 29 02:10:20 2022] GET /compute/v2.1/os-quota-sets/2105706429fe4ff899d5a020f7bf88f9?user_id=ae8c5333b1544c08907efd862ac51f64 => generated 370 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:20.883117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d37c37e3-f92a-4d01-8b8f-230f8c6acb3b req-47c4b7de-106e-4d83-894a-12a5312d8d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e975f936-623a-42eb-ba11-283950a60665", "tag": "dedf8652-5f62-4aea-a913-fd78cf041543"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:20.884664 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:20.884664 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:20.910217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d37c37e3-f92a-4d01-8b8f-230f8c6acb3b req-47c4b7de-106e-4d83-894a-12a5312d8d64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:20.910662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d37c37e3-f92a-4d01-8b8f-230f8c6acb3b req-47c4b7de-106e-4d83-894a-12a5312d8d64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:20.956924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d37c37e3-f92a-4d01-8b8f-230f8c6acb3b req-47c4b7de-106e-4d83-894a-12a5312d8d64 service nova] Creating event network-changed:dedf8652-5f62-4aea-a913-fd78cf041543 for instance e975f936-623a-42eb-ba11-283950a60665 on n-h1-828148-1 Mar 29 02:10:20.964563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d37c37e3-f92a-4d01-8b8f-230f8c6acb3b req-47c4b7de-106e-4d83-894a-12a5312d8d64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085733 Mar 29 02:10:20.973766 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 261/500] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:21.300264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5af0279c-870b-4948-b037-e96b254be56d tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Calling method '.version_select at 0x7f87241cb8b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:21.530677 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5af0279c-870b-4948-b037-e96b254be56d tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.555410 Mar 29 02:10:21.537767 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 262/501] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:10:20 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:10:21.542965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:21.543607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:21.558722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:21.559170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:21.559958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:21.560391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:22.277114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:22.284369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-98963ae2-ce48-4444-aa70-dd79bfe2f6e4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.745166 Mar 29 02:10:22.289321 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 263/502] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:21 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:22.298464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:22.299251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:22.311986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:22.317457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:22.318283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:22.318751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:22.883084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:22.897334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60bd1bb6-3cfe-49d8-bc95-116d1b779efb tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1468 microversion: 2.1 time: 0.606460 Mar 29 02:10:22.898417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 264/503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:22 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1468 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:22.903733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:22.905661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:22.923453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:22.926853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:22.938392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:22.938392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:23.414962 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-10d03ee3-cbd0-41b0-a9c9-7237ff57fff9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.917123 Mar 29 02:10:23.420062 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 240/504] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:10:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:23.429030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e0e447fe-490e-426e-8ff5-cb3e93dbda2f tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Action: 'create', calling method: .version_select at 0x7f87240d5940>, body: {"pool": "non_exist_pool"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:23.603445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e0e447fe-490e-426e-8ff5-cb3e93dbda2f tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] HTTP exception thrown: Floating IP pool not found. Mar 29 02:10:23.604992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e0e447fe-490e-426e-8ff5-cb3e93dbda2f tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Returning 404 to user: Floating IP pool not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:23.605957 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e0e447fe-490e-426e-8ff5-cb3e93dbda2f tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.184718 Mar 29 02:10:23.607176 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 241/505] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:10:23 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:23.611815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e527aacf-a56a-49da-ba81-fc96315d5503 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Calling method '.version_select at 0x7f8724464dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:23.648216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:23.661680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:23.667247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:23.674453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6608256b-31ce-495c-9529-9803d43862c1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1567 microversion: 2.25 time: 0.774067 Mar 29 02:10:23.678527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 265/506] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:22 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1567 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:24.143876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-696312026", "block_migration": true, "disk_over_commit": false}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:24.145369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:24.163428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.163873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.164656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.165115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.192400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e527aacf-a56a-49da-ba81-fc96315d5503 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.583949 Mar 29 02:10:24.192986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 242/507] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:10:23 2022] GET /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a/defaults => generated 371 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:24.299688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83a50e67-682d-44d9-9ee1-14346c61ebb0 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:24.300697 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:24.300697 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:24.301470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lazy-loading 'flavor' on Instance uuid 616855f6-bf60-4249-bf70-07c170c10325 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:24.303667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-83a50e67-682d-44d9-9ee1-14346c61ebb0 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Mar 29 02:10:24.304418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83a50e67-682d-44d9-9ee1-14346c61ebb0 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:24.306642 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83a50e67-682d-44d9-9ee1-14346c61ebb0 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540 tempest-InstanceUsageAuditLogNegativeTestJSON-1999533540-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.112524 Mar 29 02:10:24.311493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 243/508] 10.222.0.36 () {58 vars in 1223 bytes} [Tue Mar 29 02:10:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:10:24.319242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-000ec341-9502-46f7-9598-3bdbcc3e6d39 req-5b745908-531e-459d-a0f4-70201e9bf920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b90c86-71ca-4d35-9054-c7ecd9b1378e", "name": "network-vif-unplugged", "status": "completed", "tag": "e139874d-b1f4-4d8a-8c23-436287526c98"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:24.321038 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:24.321038 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:24.332525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-000ec341-9502-46f7-9598-3bdbcc3e6d39 req-5b745908-531e-459d-a0f4-70201e9bf920 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.337899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-000ec341-9502-46f7-9598-3bdbcc3e6d39 req-5b745908-531e-459d-a0f4-70201e9bf920 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.366443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-000ec341-9502-46f7-9598-3bdbcc3e6d39 req-5b745908-531e-459d-a0f4-70201e9bf920 service nova] Creating event network-vif-unplugged:e139874d-b1f4-4d8a-8c23-436287526c98 for instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e on n-h1-828148-1 Mar 29 02:10:24.379224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Going to try to live migrate instance to tempest-host-696312026 {{(pid=103513) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:10:24.384150 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-000ec341-9502-46f7-9598-3bdbcc3e6d39 req-5b745908-531e-459d-a0f4-70201e9bf920 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071089 Mar 29 02:10:24.386280 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 244/509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:24.389407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] HTTP exception thrown: Compute host tempest-host-696312026 could not be found. Mar 29 02:10:24.390038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Returning 400 to user: Compute host tempest-host-696312026 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:24.390942 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a386a274-8734-4e30-8bab-6ae610f16b56 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325/action" status: 400 len: 99 microversion: 2.1 time: 0.711240 Mar 29 02:10:24.391912 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 266/510] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Mar 29 02:10:23 2022] POST /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325/action => generated 99 bytes in 712 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:10:24.394159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:24.395178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:24.397588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: .version_select at 0x7f87262508b0>, body: {"addFloatingIp": {"address": "172.25.5.228"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:24.399059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:24.417464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.418186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.422281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.422725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.423505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.423934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.444270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:24.445379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:24.841997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Acquired lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:10:25.084670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:25.097595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c12b51d1-818b-453a-9b49-a675454609c0 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.708925 Mar 29 02:10:25.099584 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 245/511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:24 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:25.112298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa2895bd-420e-4b67-a920-82579487f1dc tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Calling method '.version_select at 0x7f87242e9e50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:25.195918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-fa2895bd-420e-4b67-a920-82579487f1dc tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 04224b8b-3a7f-4691-86c1-20d598c6e8ea could not be found", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:10:25.196925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fa2895bd-420e-4b67-a920-82579487f1dc tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] HTTP exception thrown: Floating IP not found for ID 04224b8b-3a7f-4691-86c1-20d598c6e8ea Mar 29 02:10:25.197799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa2895bd-420e-4b67-a920-82579487f1dc tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] Returning 404 to user: Floating IP not found for ID 04224b8b-3a7f-4691-86c1-20d598c6e8ea {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:25.198836 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa2895bd-420e-4b67-a920-82579487f1dc tempest-FloatingIPsNegativeTestJSON-746760808 tempest-FloatingIPsNegativeTestJSON-746760808-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/04224b8b-3a7f-4691-86c1-20d598c6e8ea" status: 404 len: 111 microversion: 2.1 time: 0.096559 Mar 29 02:10:25.205744 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 246/512] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:10:25 2022] DELETE /compute/v2.1/os-floating-ips/04224b8b-3a7f-4691-86c1-20d598c6e8ea => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:25.211625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Action: 'update', calling method: .version_select at 0x7f8724464550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:25.215581 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:25.215581 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:25.296725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:25.297444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:25.299134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:25.299679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:26.331527 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-696237a5-589d-4da2-ada9-285d29a0a0aa tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a" status: 200 len: 329 microversion: 2.1 time: 1.123848 Mar 29 02:10:26.337902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 247/513] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Mar 29 02:10:25 2022] PUT /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a => generated 329 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:26.455900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12f573a7-a7ed-4397-a48f-5708477d5357 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:26.456639 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:26.456639 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:26.458585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12f573a7-a7ed-4397-a48f-5708477d5357 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '170b7f20db27468598998e59138af139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30803560cec4190983ea9e2f86c2417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:26.459643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12f573a7-a7ed-4397-a48f-5708477d5357 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:26.460456 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12f573a7-a7ed-4397-a48f-5708477d5357 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.126819 Mar 29 02:10:26.460984 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 248/514] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:10:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 128 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:26.466067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:26.466675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:26.474570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:26.475015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:26.475785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:26.476386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:26.869212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:26.869212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60cc6d00-c43e-418a-bc8d-667d0fd92464 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1468 microversion: 2.1 time: 0.307939 Mar 29 02:10:26.869212 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 249/515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:26 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1468 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:26.869212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:26.871376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:26.871376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:26.871376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:26.871376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:26.871916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:27.084576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:27.095333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:27.096955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:27.098621 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ce626e2-7782-4876-98da-1f4ea8935b3e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1567 microversion: 2.25 time: 0.326465 Mar 29 02:10:27.099756 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 250/516] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:26 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1567 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:27.104656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:27.105385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:27.114260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:27.114804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:27.115665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:27.116419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:27.344741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:27.354541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fce0941d-fc0e-4677-a07c-ee1cb51b20f2 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.253618 Mar 29 02:10:27.355913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 251/517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:27 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:27.360233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Action: 'update', calling method: .version_select at 0x7f8724464d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:27.362418 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:27.362418 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:27.426862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:27.427286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:27.428080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:27.428506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:29.156012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03fbdcab-6a90-407c-ab35-e39385fadd86 tempest-QuotasAdminTestJSON-1591263135 tempest-QuotasAdminTestJSON-1591263135-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a" status: 200 len: 329 microversion: 2.1 time: 1.799563 Mar 29 02:10:29.157277 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 252/518] 10.222.0.36 () {60 vars in 1262 bytes} [Tue Mar 29 02:10:27 2022] PUT /compute/v2.1/os-quota-sets/777f797e60054d45a23e7688d9401b7a => generated 329 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:29.176799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ec4fcaa9-93a8-499b-8bd7-50d430290972 req-723a49aa-a71b-41af-9e43-03f177b244b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7b90c86-71ca-4d35-9054-c7ecd9b1378e", "tag": "e139874d-b1f4-4d8a-8c23-436287526c98"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:29.179184 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:29.179184 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:29.214480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ec4fcaa9-93a8-499b-8bd7-50d430290972 req-723a49aa-a71b-41af-9e43-03f177b244b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:29.214480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ec4fcaa9-93a8-499b-8bd7-50d430290972 req-723a49aa-a71b-41af-9e43-03f177b244b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:29.227327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:10:29.244351 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ec4fcaa9-93a8-499b-8bd7-50d430290972 req-723a49aa-a71b-41af-9e43-03f177b244b0 service nova] Creating event network-changed:e139874d-b1f4-4d8a-8c23-436287526c98 for instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e on n-h1-828148-1 Mar 29 02:10:29.261531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ec4fcaa9-93a8-499b-8bd7-50d430290972 req-723a49aa-a71b-41af-9e43-03f177b244b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090203 Mar 29 02:10:29.262682 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 253/519] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:29.268033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6856c8ee-935b-4d63-af27-9dc6f4281ac0 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:29.268991 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:29.268991 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:29.270675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6856c8ee-935b-4d63-af27-9dc6f4281ac0 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '170b7f20db27468598998e59138af139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30803560cec4190983ea9e2f86c2417', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:29.271383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6856c8ee-935b-4d63-af27-9dc6f4281ac0 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:29.272319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6856c8ee-935b-4d63-af27-9dc6f4281ac0 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905 tempest-InstanceUsageAuditLogNegativeTestJSON-1791412905-project] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-29 02:10:26" status: 403 len: 128 microversion: 2.1 time: 0.008405 Mar 29 02:10:29.272973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 254/520] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:10:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-29%2002%3A10%3A26 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:29.301892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1423680251", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:29.445108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:10:30.709138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:10:30.709753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:10:30.710006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:10:30.710418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:10:30.710826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:10:30.731370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:30.731808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:30.736437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:30.747164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:30.778641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Getting quotas for project f52345b4968b43c084e21a9c840affaf. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:10:30.788158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Getting quotas for user bc3e059f77854460b855e0dd15bb2be5 and project f52345b4968b43c084e21a9c840affaf. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:10:30.813991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:10:30.817407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:10:30.996870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0461365-f080-4164-8fd6-1f8536528b20 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.722722 Mar 29 02:10:30.999711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 255/521] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:10:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:10:31.544270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f9c2045-b0b9-4938-8876-d20f7023381a tempest-FloatingIPDetailsNegativeTestJSON-1816471928 tempest-FloatingIPDetailsNegativeTestJSON-1816471928-project] Calling method '.version_select at 0x7f87242e9700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:31.693536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-6f9c2045-b0b9-4938-8876-d20f7023381a tempest-FloatingIPDetailsNegativeTestJSON-1816471928 tempest-FloatingIPDetailsNegativeTestJSON-1816471928-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 19460f41-22f3-4999-b5e3-ac438f7e765a could not be found", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:10:31.694387 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-6f9c2045-b0b9-4938-8876-d20f7023381a tempest-FloatingIPDetailsNegativeTestJSON-1816471928 tempest-FloatingIPDetailsNegativeTestJSON-1816471928-project] HTTP exception thrown: Floating IP not found for ID 19460f41-22f3-4999-b5e3-ac438f7e765a Mar 29 02:10:31.695036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f9c2045-b0b9-4938-8876-d20f7023381a tempest-FloatingIPDetailsNegativeTestJSON-1816471928 tempest-FloatingIPDetailsNegativeTestJSON-1816471928-project] Returning 404 to user: Floating IP not found for ID 19460f41-22f3-4999-b5e3-ac438f7e765a {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:31.695939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6f9c2045-b0b9-4938-8876-d20f7023381a tempest-FloatingIPDetailsNegativeTestJSON-1816471928 tempest-FloatingIPDetailsNegativeTestJSON-1816471928-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/19460f41-22f3-4999-b5e3-ac438f7e765a" status: 404 len: 111 microversion: 2.1 time: 0.694528 Mar 29 02:10:31.697032 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 256/522] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:10:30 2022] GET /compute/v2.1/os-floating-ips/19460f41-22f3-4999-b5e3-ac438f7e765a => generated 111 bytes in 697 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:10:31.702716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:31.706208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:31.724602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:31.727261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:31.730204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:31.731498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:32.359717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Updating instance_info_cache with network_info: [{"id": "aeaecd63-85d0-4c09-8997-74064a224621", "address": "fa:16:3e:d3:b7:0d", "network": {"id": "336eaade-a886-4593-b3c5-291b209e342c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1662358319-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18bfb660f51f43dda11271fa73f58cd2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapaeaecd63-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:10:32.453656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Releasing lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:10:32.456064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-726e8511-fa3d-4f07-b79d-e87f35c1dcc9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 202 len: 0 microversion: 2.1 time: 8.062190 Mar 29 02:10:32.457014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 267/523] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:24 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 0 bytes in 8065 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:10:32.463725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:32.466013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:32.488306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:32.493979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:32.493979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:32.493979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:32.840426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:32.857780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:32.862775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:32.862775 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-411ce848-8e29-41bf-8454-2621ab65260d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1567 microversion: 2.25 time: 1.161587 Mar 29 02:10:32.862775 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 257/524] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:31 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1567 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:32.877422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fdfca22f-b888-45a4-a120-a869c8c13584 req-96edfdbb-fa24-4efe-88fc-ef42a1e8f814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b03c7bf-7933-4632-b749-2b1a4bf40f80", "tag": "aeaecd63-85d0-4c09-8997-74064a224621"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:32.879062 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:32.879062 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:32.887863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fdfca22f-b888-45a4-a120-a869c8c13584 req-96edfdbb-fa24-4efe-88fc-ef42a1e8f814 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:32.888297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fdfca22f-b888-45a4-a120-a869c8c13584 req-96edfdbb-fa24-4efe-88fc-ef42a1e8f814 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:32.919866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fdfca22f-b888-45a4-a120-a869c8c13584 req-96edfdbb-fa24-4efe-88fc-ef42a1e8f814 service nova] Creating event network-changed:aeaecd63-85d0-4c09-8997-74064a224621 for instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 on n-h2-828148-1 Mar 29 02:10:32.934632 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fdfca22f-b888-45a4-a120-a869c8c13584 req-96edfdbb-fa24-4efe-88fc-ef42a1e8f814 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072380 Mar 29 02:10:32.935554 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 258/525] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:32.954134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:32.957056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:32.997029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:32.997518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:32.998318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:32.999645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:33.188326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:33.213732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d173b303-c25d-4cff-b561-50ec38d74f22 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1215 microversion: 2.1 time: 0.274712 Mar 29 02:10:33.219332 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 259/526] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:32 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1215 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:33.238256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5c14201d-91db-4c5b-9cd7-9edb029b19d9 req-d418ef41-db92-4e9d-9883-3fb985357d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975f936-623a-42eb-ba11-283950a60665", "name": "network-vif-plugged", "status": "completed", "tag": "dedf8652-5f62-4aea-a913-fd78cf041543"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:33.246564 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:33.246564 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:33.259232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5c14201d-91db-4c5b-9cd7-9edb029b19d9 req-d418ef41-db92-4e9d-9883-3fb985357d2f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:33.266281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5c14201d-91db-4c5b-9cd7-9edb029b19d9 req-d418ef41-db92-4e9d-9883-3fb985357d2f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:33.303852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5c14201d-91db-4c5b-9cd7-9edb029b19d9 req-d418ef41-db92-4e9d-9883-3fb985357d2f service nova] Creating event network-vif-plugged:dedf8652-5f62-4aea-a913-fd78cf041543 for instance e975f936-623a-42eb-ba11-283950a60665 on n-h1-828148-1 Mar 29 02:10:33.323702 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5c14201d-91db-4c5b-9cd7-9edb029b19d9 req-d418ef41-db92-4e9d-9883-3fb985357d2f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102715 Mar 29 02:10:33.332169 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 260/527] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:33.338024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d55aba9-0442-4392-9f61-1da71f3c47ef tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'create', calling method: .version_select at 0x7f8724115a60>, body: {"pool": "c0340286-e227-4025-8852-c3316ef08961"} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:33.424317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:33.436581 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-846a4b7f-034d-4321-b9af-82a179b65ec6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.978259 Mar 29 02:10:33.441259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 268/528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:32 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:33.878103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:33.878714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:33.896121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:33.896565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:33.898223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:33.899465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:34.769479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:34.784435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:34.786168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:34.789940 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-276d85ff-a0a5-4cff-93f2-8d3063540cb7 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1542 microversion: 2.25 time: 0.915402 Mar 29 02:10:34.793162 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 269/529] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:33 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1542 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:34.805964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:34.807922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:34.827861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:34.827861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:34.827861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:34.827861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:35.017605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:35.026802 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63b4ecfa-f588-4b8b-9d76-0ea425350760 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1277 microversion: 2.1 time: 0.231830 Mar 29 02:10:35.027361 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 270/530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:34 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:35.032197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:35.032952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:35.041960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:35.042400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:35.043170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:35.043595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:35.939862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:35.950281 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb1b67c5-5566-4c14-9833-c5200e19d602 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1391 microversion: 2.1 time: 0.921577 Mar 29 02:10:35.951597 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 271/531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:35 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1391 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:35.964985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7a515f0-daff-4dac-a624-511495869eae tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '.version_select at 0x7f8724137e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:35.967028 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:35.967028 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:35.968752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a515f0-daff-4dac-a624-511495869eae tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:35.969432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a515f0-daff-4dac-a624-511495869eae tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:35.982922 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7a515f0-daff-4dac-a624-511495869eae tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1100 microversion: 2.25 time: 0.027151 Mar 29 02:10:35.993732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 272/532] 10.222.0.36 () {60 vars in 1183 bytes} [Tue Mar 29 02:10:35 2022] GET /compute/v2.1/os-migrations => generated 1100 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:36.001854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:36.012551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:36.014083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:36.014896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:36.016613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:36.017864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:36.539358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid a7b90c86-71ca-4d35-9054-c7ecd9b1378e {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:36.605880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89b05104-8d45-49ea-a7e2-ba872455855a tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 2035 microversion: 2.25 time: 0.608757 Mar 29 02:10:36.606635 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 273/533] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:35 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 2035 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:36.620442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:36.621087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:36.634988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:36.635737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:36.636710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:36.637401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:36.805988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:36.820208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e501df6-5b7f-4388-a368-ff75042cf5e9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1277 microversion: 2.1 time: 0.210641 Mar 29 02:10:36.836199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 274/534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:36 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:36.958499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-956704600", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "2a492824-76d3-4dc8-9d37-f81c1b4928a3"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:37.101849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] validate_networks() for [('2a492824-76d3-4dc8-9d37-f81c1b4928a3', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:10:38.590080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:10:38.591171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:10:38.591878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:10:38.592445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:10:38.593081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:10:38.608178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:38.609392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:38.623539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:38.623992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:38.692709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:10:38.709586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for user f540281478cf4d929afbce240e2f4c66 and project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:10:38.730402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:10:38.732765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:10:38.909209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8387613c-475b-4760-9e70-df9bd8e0e36e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.954782 Mar 29 02:10:38.910154 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 275/535] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:10:38.914884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:38.915980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:38.933960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:38.935147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:38.940724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:38.941406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.125646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:40.136280 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13cb7f7f-87a5-4304-b905-80ab4f5a378d tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1589 microversion: 2.1 time: 1.224873 Mar 29 02:10:40.142322 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 276/536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:38 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1589 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:40.156419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:40.157392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:40.170320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.173347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.174368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.175465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.693786 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d55aba9-0442-4392-9f61-1da71f3c47ef tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.359811 Mar 29 02:10:40.701290 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 261/537] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:10:33 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:40.705955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:40.706589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:40.714788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.715562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.716778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.717239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.777236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:40.798408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6331b6ab-0eab-40d0-b3d1-1a77634267d4 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.654702 Mar 29 02:10:40.798993 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 277/538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:40 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:40.803503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:40.804043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:40.815123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.815568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.816350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:40.818587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:40.877721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:40.891719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:40.893322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:40.894645 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c6130f6a-51b4-4f4a-b6d7-ad1bad543bfd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1265 microversion: 2.25 time: 0.192440 Mar 29 02:10:40.895383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 262/539] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:40 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:41.075515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Action: 'update', calling method: .version_select at 0x7f87242e9280>, body: {"quota_set": {"ram": "5120"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:41.081021 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:41.081021 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:41.183286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.184150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.185377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.186041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.191497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74340cf2-2d95-4873-af8b-4686484604c4 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.390969 Mar 29 02:10:41.200339 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 278/540] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:10:40 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665/os-interface => generated 284 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:41.208229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.127"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:41.210409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:41.223807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.225752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.225752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.227829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.314111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Acquired lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:10:41.353705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b324b0c4-a58d-4494-8191-e9b289204ad6 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f" status: 200 len: 240 microversion: 2.36 time: 0.456925 Mar 29 02:10:41.355015 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 263/541] 10.222.0.36 () {62 vars in 1302 bytes} [Tue Mar 29 02:10:40 2022] PUT /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f => generated 240 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:41.360760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-83a02434-4e4b-4b86-acc1-f6588368641b req-fa8e82c3-38de-47b3-92a3-b5e06bdab16e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50abf642-17cb-4335-a618-08f567dd0476", "tag": "0318097b-b47b-4bfe-98d9-d6dcdb104191"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:41.362525 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:41.362525 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:41.372540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-83a02434-4e4b-4b86-acc1-f6588368641b req-fa8e82c3-38de-47b3-92a3-b5e06bdab16e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.373310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-83a02434-4e4b-4b86-acc1-f6588368641b req-fa8e82c3-38de-47b3-92a3-b5e06bdab16e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.392701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-83a02434-4e4b-4b86-acc1-f6588368641b req-fa8e82c3-38de-47b3-92a3-b5e06bdab16e service nova] Creating event network-changed:0318097b-b47b-4bfe-98d9-d6dcdb104191 for instance 50abf642-17cb-4335-a618-08f567dd0476 on n-h1-828148-1 Mar 29 02:10:41.403031 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-83a02434-4e4b-4b86-acc1-f6588368641b req-fa8e82c3-38de-47b3-92a3-b5e06bdab16e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045861 Mar 29 02:10:41.404044 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 264/542] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:41.409780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Calling method '.version_select at 0x7f87242e9d30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:41.691892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.692635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.693820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.694893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.720605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfdab361-f66c-4373-9723-bf25300253d1 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f/detail" status: 200 len: 672 microversion: 2.36 time: 0.315035 Mar 29 02:10:41.722270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 265/543] 10.222.0.36 () {60 vars in 1303 bytes} [Tue Mar 29 02:10:41 2022] GET /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f/detail => generated 672 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:41.815498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:41.816637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:41.827159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.828075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:41.829119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:41.829921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:42.632871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:42.648964 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8397932b-fcfa-497a-a03d-b684a7cc0dbc tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.837549 Mar 29 02:10:42.649544 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 266/544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:41 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:10:42.653925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:42.654525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:42.683436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:42.684006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:42.685335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:42.703713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.055828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:43.071106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:43.075412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:43.077038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64062588-b6a4-4070-afec-7f148f005d19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1319 microversion: 2.25 time: 0.426499 Mar 29 02:10:43.078734 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 267/545] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:42 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1319 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:43.103112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Action: 'update', calling method: .version_select at 0x7f8724464040>, body: {"quota_set": {"ram": "2048"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:43.105346 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:43.105346 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:43.410941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.411500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.413863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.414508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.459248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.460115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.462072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.463280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.511152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.127 (7763b6d7-f548-42b3-a44c-43658bc8695b) with port aeaecd63-85d0-4c09-8997-74064a224621 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c0340286-e227-4025-8852-c3316ef08961.", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:10:43.511839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Releasing lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:10:43.512559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.127 (7763b6d7-f548-42b3-a44c-43658bc8695b) with port aeaecd63-85d0-4c09-8997-74064a224621 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c0340286-e227-4025-8852-c3316ef08961. Mar 29 02:10:43.512559 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-7bd068e4-4c37-4bc5-a89c-e7737a311448'] Mar 29 02:10:43.517892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Returning 400 to user: Cannot associate floating IP 172.25.5.127 (7763b6d7-f548-42b3-a44c-43658bc8695b) with port aeaecd63-85d0-4c09-8997-74064a224621 using fixed IP 172.20.0.12, as that fixed IP already has a floating IP on external network c0340286-e227-4025-8852-c3316ef08961. Mar 29 02:10:43.517892 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-7bd068e4-4c37-4bc5-a89c-e7737a311448'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:43.517892 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2cfacdf-c376-43e6-b588-78f0ecbedd83 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 400 len: 382 microversion: 2.1 time: 2.312162 Mar 29 02:10:43.517892 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 279/546] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:41 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 382 bytes in 2314 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:10:43.525536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0fc094fd-c7b6-41af-8e9d-eebdbfc860d1 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '.version_select at 0x7f8717fbd5e0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:43.701265 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-489f1c30-6e31-46ac-a37d-bb47b5301d25 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f?user_id=24eec743186243cebf34d73bf5062421" status: 200 len: 240 microversion: 2.36 time: 0.620839 Mar 29 02:10:43.706120 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 268/547] 10.222.0.36 () {62 vars in 1383 bytes} [Tue Mar 29 02:10:43 2022] PUT /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f?user_id=24eec743186243cebf34d73bf5062421 => generated 240 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:43.719570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:43.721592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:43.744021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.745679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:43.746680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:43.749723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:44.311909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:44.323299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b978db3-c2b4-4e9d-9170-117f8dcc0c05 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.614159 Mar 29 02:10:44.328204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 269/548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:43 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:44.332794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e8363d0-177c-437a-8fe9-c75ca76d2f58 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] Calling method '.version_select at 0x7f8724059c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:44.543910 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e8363d0-177c-437a-8fe9-c75ca76d2f58 tempest-QuotasAdminTestV236-1617706314 tempest-QuotasAdminTestV236-1617706314-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f?user_id=24eec743186243cebf34d73bf5062421" status: 200 len: 282 microversion: 2.36 time: 0.214700 Mar 29 02:10:44.553270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 270/549] 10.222.0.36 () {60 vars in 1363 bytes} [Tue Mar 29 02:10:44 2022] GET /compute/v2.1/os-quota-sets/bdde1951684f4e5589fc506cade3052f?user_id=24eec743186243cebf34d73bf5062421 => generated 282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:44.564253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:44.567687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:44.581936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:44.585228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:44.586760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:44.588162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:45.507679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:45.520486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:45.522539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:45.525418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8effd39b-c6c6-419a-91e1-4eb205246276 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.964019 Mar 29 02:10:45.526014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 271/550] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:44 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:45.531487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:45.532886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:45.544259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:45.544707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:45.546040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:45.546040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:46.402620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:46.411118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12c4b7b7-654b-45e8-bb3a-08bb699ee993 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.883713 Mar 29 02:10:46.422239 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 272/551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:45 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:46.699684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Action: 'update', calling method: .version_select at 0x7f87242e9700>, body: {"quota_set": {"ram": "5120"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:46.701958 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:46.701958 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:46.771602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:46.772227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:46.773727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:46.774347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:46.902506 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34b75ba6-66d7-42d5-ac7e-9cbe8b1ac3db tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da" status: 200 len: 148 microversion: 2.57 time: 0.478707 Mar 29 02:10:46.903533 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 273/552] 10.222.0.36 () {62 vars in 1302 bytes} [Tue Mar 29 02:10:46 2022] PUT /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da => generated 148 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:46.913931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:46.916310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:46.926656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:46.932329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:46.934191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:46.935457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.662830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:47.675839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:47.684207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:47.685401 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dc997ef2-c3b4-4380-b684-be286c058773 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.780442 Mar 29 02:10:47.686283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 274/553] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:46 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:47.693861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0f9f47d6-cfad-48bc-8e35-c1446ff07edb req-03e67b88-3dc1-40dc-83f6-b0ba72a59891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314c9d8f-a6a4-4bc1-bcc4-9a48b6235598", "tag": "3f5634f6-fe04-45d7-b5ec-b32dc63c8872"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:47.695258 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:47.695258 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:47.723068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0f9f47d6-cfad-48bc-8e35-c1446ff07edb req-03e67b88-3dc1-40dc-83f6-b0ba72a59891 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.725314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0f9f47d6-cfad-48bc-8e35-c1446ff07edb req-03e67b88-3dc1-40dc-83f6-b0ba72a59891 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.757662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0fc094fd-c7b6-41af-8e9d-eebdbfc860d1 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/7763b6d7-f548-42b3-a44c-43658bc8695b" status: 202 len: 0 microversion: 2.1 time: 4.236658 Mar 29 02:10:47.758816 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 280/554] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:10:43 2022] DELETE /compute/v2.1/os-floating-ips/7763b6d7-f548-42b3-a44c-43658bc8695b => generated 0 bytes in 4238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:10:47.764133 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0f9f47d6-cfad-48bc-8e35-c1446ff07edb req-03e67b88-3dc1-40dc-83f6-b0ba72a59891 service nova] Creating event network-changed:3f5634f6-fe04-45d7-b5ec-b32dc63c8872 for instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 on n-h1-828148-1 Mar 29 02:10:47.769351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Calling method '.version_select at 0x7f87242e8940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:47.770658 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0f9f47d6-cfad-48bc-8e35-c1446ff07edb req-03e67b88-3dc1-40dc-83f6-b0ba72a59891 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083158 Mar 29 02:10:47.771775 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 275/555] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:47.776801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:47.778025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:47.786364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.787143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.788213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.788795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.891753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.892197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.893015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.894887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.936558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6556cab-d346-4f3e-82bc-80d3ae6e7b0f tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da/detail" status: 200 len: 463 microversion: 2.57 time: 0.176325 Mar 29 02:10:47.937664 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 281/556] 10.222.0.36 () {60 vars in 1303 bytes} [Tue Mar 29 02:10:47 2022] GET /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da/detail => generated 463 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:47.950443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:47.951367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:47.960365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.961356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:47.962682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:47.963271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:48.278030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:48.289072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b8fc272-a7df-4846-b285-6b43e4ec0eb8 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 200 len: 1708 microversion: 2.1 time: 0.343874 Mar 29 02:10:48.289640 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 282/557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:47 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 1708 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:48.306487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a740ec9a-aee2-4439-8002-7fa7fb90b8f1 req-68cef89d-4427-4697-9b17-39300482e0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e975f936-623a-42eb-ba11-283950a60665", "tag": "dedf8652-5f62-4aea-a913-fd78cf041543"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:48.308182 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:48.308182 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:48.329107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a740ec9a-aee2-4439-8002-7fa7fb90b8f1 req-68cef89d-4427-4697-9b17-39300482e0fb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:48.330161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a740ec9a-aee2-4439-8002-7fa7fb90b8f1 req-68cef89d-4427-4697-9b17-39300482e0fb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:48.357308 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a740ec9a-aee2-4439-8002-7fa7fb90b8f1 req-68cef89d-4427-4697-9b17-39300482e0fb service nova] Creating event network-changed:dedf8652-5f62-4aea-a913-fd78cf041543 for instance e975f936-623a-42eb-ba11-283950a60665 on n-h1-828148-1 Mar 29 02:10:48.363291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a740ec9a-aee2-4439-8002-7fa7fb90b8f1 req-68cef89d-4427-4697-9b17-39300482e0fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071380 Mar 29 02:10:48.364915 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 283/558] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:48.372299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: .version_select at 0x7f8726250550>, body: {"removeFloatingIp": {"address": "172.25.5.228"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:48.623354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:48.637482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6fd87181-5567-41dc-8367-042cf90bb1ae tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.864482 Mar 29 02:10:48.639665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 276/559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:47 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:48.644082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Action: 'update', calling method: .version_select at 0x7f8724115c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:48.645903 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:48.645903 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:48.793643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:48.794224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:48.794863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:48.795284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:48.891885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:48.892638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:48.901879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:48.902960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:49.051571 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7cbbfa92-79ec-4d3d-af59-a0ee4f7ef1a4 tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da?user_id=64cf554952624d2fa5a18c01ab4f2e84" status: 200 len: 148 microversion: 2.57 time: 0.410497 Mar 29 02:10:49.052812 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 277/560] 10.222.0.36 () {62 vars in 1383 bytes} [Tue Mar 29 02:10:48 2022] PUT /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da?user_id=64cf554952624d2fa5a18c01ab4f2e84 => generated 148 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:49.061630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:49.062574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:49.083765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:49.084529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:49.085857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:49.086501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:49.414895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:49.424309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:49.425308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:49.426987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:49.429145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:49.814174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:49.824030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:49.825776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:49.827060 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ef7f66d-9244-412d-9bc5-663525a71fba tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.773034 Mar 29 02:10:49.837903 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 278/561] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:49 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:49.895498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Acquired lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:10:50.117794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1886662426", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "f0bf6988-5c26-404c-85f6-c1676da0daf5"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:50.193671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] validate_networks() for [('f0bf6988-5c26-404c-85f6-c1676da0daf5', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:10:51.057275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:10:51.059653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:10:51.061226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:10:51.061968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:10:51.062560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:10:51.073859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:51.074525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:51.075328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:51.075763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:51.097825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:10:51.103121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for user 530e622216e14b4daae0ea35922590c9 and project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:10:51.115786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:10:51.118949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:10:51.212946 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c8f268ba-78ab-4905-bc65-30162d4ef2ef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.373645 Mar 29 02:10:51.214301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 279/562] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:10:51.219647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88fcb437-8c26-499a-85ef-06b0a939253c tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] Calling method '.version_select at 0x7f87243441f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:51.465829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:10:51.540881 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88fcb437-8c26-499a-85ef-06b0a939253c tempest-QuotasAdminTestV257-1913936835 tempest-QuotasAdminTestV257-1913936835-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da?user_id=64cf554952624d2fa5a18c01ab4f2e84" status: 200 len: 190 microversion: 2.57 time: 0.324738 Mar 29 02:10:51.541839 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 280/563] 10.222.0.36 () {60 vars in 1363 bytes} [Tue Mar 29 02:10:51 2022] GET /compute/v2.1/os-quota-sets/76f61277857e4bab8f60150162af14da?user_id=64cf554952624d2fa5a18c01ab4f2e84 => generated 190 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:10:51.547393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e762a8e9-613e-449b-9e29-e5e6afd60123 req-928705a4-f261-4672-a5ad-575d902ac6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50abf642-17cb-4335-a618-08f567dd0476", "name": "network-vif-plugged", "status": "completed", "tag": "0318097b-b47b-4bfe-98d9-d6dcdb104191"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:51.549228 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:51.549228 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:51.559796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e762a8e9-613e-449b-9e29-e5e6afd60123 req-928705a4-f261-4672-a5ad-575d902ac6a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:51.560455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e762a8e9-613e-449b-9e29-e5e6afd60123 req-928705a4-f261-4672-a5ad-575d902ac6a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:51.583051 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e762a8e9-613e-449b-9e29-e5e6afd60123 req-928705a4-f261-4672-a5ad-575d902ac6a8 service nova] Creating event network-vif-plugged:0318097b-b47b-4bfe-98d9-d6dcdb104191 for instance 50abf642-17cb-4335-a618-08f567dd0476 on n-h1-828148-1 Mar 29 02:10:51.589652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e762a8e9-613e-449b-9e29-e5e6afd60123 req-928705a4-f261-4672-a5ad-575d902ac6a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045766 Mar 29 02:10:51.590772 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 281/564] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:51.598210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:51.599344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:51.610692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:51.612229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:51.613511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:51.614315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:52.120718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:52.130682 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-380ad732-3698-4f74-bd4a-5dac3f8d983d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.537645 Mar 29 02:10:52.141079 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 282/565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:51 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:52.146163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:52.147154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:52.154890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:52.155332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:52.156105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:52.156523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:52.465599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:52.475006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:52.476498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:52.478118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6425adf2-ee79-49cb-b531-292006a00a77 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.335299 Mar 29 02:10:52.479295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 283/566] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:52 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:52.484126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9e19735-65a7-4bcd-a6cd-93d608212267 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:52.484977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b9e19735-65a7-4bcd-a6cd-93d608212267 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:52.538569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Updating instance_info_cache with network_info: [{"id": "aeaecd63-85d0-4c09-8997-74064a224621", "address": "fa:16:3e:d3:b7:0d", "network": {"id": "336eaade-a886-4593-b3c5-291b209e342c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1662358319-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "18bfb660f51f43dda11271fa73f58cd2", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapaeaecd63-85", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:10:52.564602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9e19735-65a7-4bcd-a6cd-93d608212267 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:52.573774 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9e19735-65a7-4bcd-a6cd-93d608212267 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1208 microversion: 2.1 time: 0.093021 Mar 29 02:10:52.574769 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 284/567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:52 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:52.579484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-06676d81-2231-433b-a474-5924ad890979 req-ade355e6-a36d-4bfd-88b6-a994a78da268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b03c7bf-7933-4632-b749-2b1a4bf40f80", "tag": "aeaecd63-85d0-4c09-8997-74064a224621"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:52.581331 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:52.581331 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:52.590953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-06676d81-2231-433b-a474-5924ad890979 req-ade355e6-a36d-4bfd-88b6-a994a78da268 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:52.591381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-06676d81-2231-433b-a474-5924ad890979 req-ade355e6-a36d-4bfd-88b6-a994a78da268 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:52.607416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-06676d81-2231-433b-a474-5924ad890979 req-ade355e6-a36d-4bfd-88b6-a994a78da268 service nova] Creating event network-changed:aeaecd63-85d0-4c09-8997-74064a224621 for instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 on n-h2-828148-1 Mar 29 02:10:52.612886 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-06676d81-2231-433b-a474-5924ad890979 req-ade355e6-a36d-4bfd-88b6-a994a78da268 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036252 Mar 29 02:10:52.613141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 285/568] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:52.615898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Releasing lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:10:52.617149 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7bc14c05-520f-4cf7-822b-bdaf1d7ac20a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 202 len: 0 microversion: 2.1 time: 4.250628 Mar 29 02:10:52.620765 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 284/569] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:48 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 0 bytes in 4254 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:10:52.634756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96f529be-08d8-4248-8719-f0e7d9a022a9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '.version_select at 0x7f87256553a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.021583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-366600e4-0504-495d-a590-c9effe712105 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Calling method '.version_select at 0x7f87242e9a60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.070759 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-366600e4-0504-495d-a590-c9effe712105 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:53.072754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-366600e4-0504-495d-a590-c9effe712105 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:53.074131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-366600e4-0504-495d-a590-c9effe712105 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "DELETE /compute/v2.1/images/8e7ad4d3-594b-4bd0-8919-8029a8bfa482/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.459458 Mar 29 02:10:53.074823 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 286/570] 10.222.0.36 () {58 vars in 1292 bytes} [Tue Mar 29 02:10:52 2022] DELETE /compute/v2.1/images/8e7ad4d3-594b-4bd0-8919-8029a8bfa482/metadata/os_distro => generated 62 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:53.086639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-794e32e0-2d52-4690-80a3-02503e7dbbb6 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Calling method '.version_select at 0x7f8724350f70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.120623 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-794e32e0-2d52-4690-80a3-02503e7dbbb6 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:53.121657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-794e32e0-2d52-4690-80a3-02503e7dbbb6 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:53.122502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-794e32e0-2d52-4690-80a3-02503e7dbbb6 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "GET /compute/v2.1/images/0222a750-3e71-42ed-96cd-b9a3a880a301/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039752 Mar 29 02:10:53.123670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 287/571] 10.222.0.36 () {58 vars in 1292 bytes} [Tue Mar 29 02:10:53 2022] GET /compute/v2.1/images/0222a750-3e71-42ed-96cd-b9a3a880a301/metadata/os_version => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:53.133645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-297af0da-0381-4d08-9498-63fe65bb61ba tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Calling method '.version_select at 0x7f87242e91f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.164485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-297af0da-0381-4d08-9498-63fe65bb61ba tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:53.166760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-297af0da-0381-4d08-9498-63fe65bb61ba tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:53.167790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-297af0da-0381-4d08-9498-63fe65bb61ba tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "GET /compute/v2.1/images/2a3410c2-ee15-4fa4-9e14-0f4465bd413a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.038962 Mar 29 02:10:53.169163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 288/572] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:10:53 2022] GET /compute/v2.1/images/2a3410c2-ee15-4fa4-9e14-0f4465bd413a/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:10:53.175533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.176292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:53.211100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:53.211568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:53.212397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:53.212854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:53.596230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:53.605597 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-207ab8ab-87bc-4467-9e27-7f5f1bb003d0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1319 microversion: 2.1 time: 0.435402 Mar 29 02:10:53.606412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 289/573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:53 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:53.626093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2623679c-50ba-4647-a84b-6fa9579d1d0c tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Action: 'update_all', calling method: .version_select at 0x7f8724d4c0d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:53.665777 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2623679c-50ba-4647-a84b-6fa9579d1d0c tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:53.666339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2623679c-50ba-4647-a84b-6fa9579d1d0c tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:53.667309 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2623679c-50ba-4647-a84b-6fa9579d1d0c tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "PUT /compute/v2.1/images/0287828e-b2fa-4610-9741-fbaae9cd6370/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050488 Mar 29 02:10:53.671943 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 290/574] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:10:53 2022] PUT /compute/v2.1/images/0287828e-b2fa-4610-9741-fbaae9cd6370/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:53.674869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:53.675480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:53.693105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:53.693554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:53.694340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:53.694767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:54.030083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:54.045779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:54.047614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:54.049637 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36c2b323-faf9-48bf-961f-6cfb492b57c5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.380035 Mar 29 02:10:54.050321 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 291/575] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:53 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:54.055425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:54.056192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:54.064783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:54.065476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:54.066474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:54.067027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:54.295284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:54.311034 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a233af2-298b-4ffe-aae9-7b97386fd08c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1260 microversion: 2.1 time: 0.259450 Mar 29 02:10:54.312791 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 292/576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:54 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:54.318162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57034c9d-ced4-4655-a537-2bcca85273ae tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Action: 'update', calling method: .version_select at 0x7f8724d0be50>, body: {"meta": {"os_distro": "alt"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:54.351743 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-57034c9d-ced4-4655-a537-2bcca85273ae tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:54.351743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57034c9d-ced4-4655-a537-2bcca85273ae tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:54.353675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-57034c9d-ced4-4655-a537-2bcca85273ae tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "PUT /compute/v2.1/images/90bf6fd0-ee93-4e32-b630-e5afab3465ea/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.038624 Mar 29 02:10:54.354825 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 293/577] 10.222.0.36 () {60 vars in 1309 bytes} [Tue Mar 29 02:10:54 2022] PUT /compute/v2.1/images/90bf6fd0-ee93-4e32-b630-e5afab3465ea/metadata/os_distro => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:54.363591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b8a2a986-5f06-4ccc-96b3-8112805b1232 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Action: 'create', calling method: .version_select at 0x7f87242e90d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:54.396726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b8a2a986-5f06-4ccc-96b3-8112805b1232 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] HTTP exception thrown: Image not found. Mar 29 02:10:54.397524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b8a2a986-5f06-4ccc-96b3-8112805b1232 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:54.398541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b8a2a986-5f06-4ccc-96b3-8112805b1232 tempest-ImagesMetadataNegativeTestJSON-1440859496 tempest-ImagesMetadataNegativeTestJSON-1440859496-project] 10.222.0.36 "POST /compute/v2.1/images/f802cbae-d91c-4726-903a-54da5feec05c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039066 Mar 29 02:10:54.399901 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 294/578] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Mar 29 02:10:54 2022] POST /compute/v2.1/images/f802cbae-d91c-4726-903a-54da5feec05c/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:10:54.622823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:54.625259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:54.646104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:54.646795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:54.649448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:54.654967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:55.161702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:55.175093 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efccde9d-cee6-42af-91db-6a0557106377 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1468 microversion: 2.1 time: 0.555619 Mar 29 02:10:55.177120 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 295/579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:54 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1468 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:10:55.191229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:55.191879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:55.199640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:55.200271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:55.201252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:55.201859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:55.570488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:55.580679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:55.582231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:55.583372 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0d58baf-40e5-4e7a-94ae-39aac320ab8c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.404964 Mar 29 02:10:55.583913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 296/580] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:55 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:55.600368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:55.601109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:55.609163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:55.609603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:55.610382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:55.610837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:55.670332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lazy-loading 'flavor' on Instance uuid 50abf642-17cb-4335-a618-08f567dd0476 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:56.184739 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c7caf5e-a52a-445e-aff8-bb6419a7c178 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476/action" status: 202 len: 0 microversion: 2.1 time: 0.587711 Mar 29 02:10:56.185483 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 297/581] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:55 2022] POST /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:10:56.190898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:56.191856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:56.200270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.200716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:56.201559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.202029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:56.414572 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96f529be-08d8-4248-8719-f0e7d9a022a9 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/4987d707-cb94-4334-9fa1-9f7687df2e65" status: 202 len: 0 microversion: 2.1 time: 3.790207 Mar 29 02:10:56.415576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 285/582] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:10:52 2022] DELETE /compute/v2.1/os-floating-ips/4987d707-cb94-4334-9fa1-9f7687df2e65 => generated 0 bytes in 3792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:10:56.423771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:56.424630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:56.433072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.433600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:56.434465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.434963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:56.641761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:56.651522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-707f8ba2-b05e-4079-b27c-50e1e2a380ca tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1476 microversion: 2.1 time: 0.234574 Mar 29 02:10:56.652701 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 286/583] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:56 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:56.658613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-392087bd-5729-4166-b223-d4c041858d73 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:56.668334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-392087bd-5729-4166-b223-d4c041858d73 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:56.668334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-392087bd-5729-4166-b223-d4c041858d73 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 400 len: 142 microversion: 2.1 time: 0.006941 Mar 29 02:10:56.668334 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 287/584] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:56 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 142 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:10:56.668334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:56.668334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:56.677145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.677604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:56.678629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:56.679099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.010207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:57.019775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:57.021687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:57.022996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-451b3602-b171-4a2c-97d3-152eb046d378 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.360445 Mar 29 02:10:57.041386 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 288/585] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:56 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:57.041386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:57.043191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:57.048083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:57.052143 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22bba46c-d8a7-451e-a1b3-e967f22dd84c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 0.865234 Mar 29 02:10:57.057766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 298/586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:56 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:57.061092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:57.061723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.062707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:57.063466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.134407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Acquired lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:10:57.260239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-26125df1-2e7a-4e87-a46d-fadae25473a7 req-7474f1a5-0ed3-451f-a7b2-8985c2d457ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314c9d8f-a6a4-4bc1-bcc4-9a48b6235598", "name": "network-vif-plugged", "status": "completed", "tag": "3f5634f6-fe04-45d7-b5ec-b32dc63c8872"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:57.262628 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:57.262628 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:10:57.280919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-26125df1-2e7a-4e87-a46d-fadae25473a7 req-7474f1a5-0ed3-451f-a7b2-8985c2d457ca service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:57.280919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-26125df1-2e7a-4e87-a46d-fadae25473a7 req-7474f1a5-0ed3-451f-a7b2-8985c2d457ca service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.303160 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-26125df1-2e7a-4e87-a46d-fadae25473a7 req-7474f1a5-0ed3-451f-a7b2-8985c2d457ca service nova] Creating event network-vif-plugged:3f5634f6-fe04-45d7-b5ec-b32dc63c8872 for instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 on n-h1-828148-1 Mar 29 02:10:57.311413 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-26125df1-2e7a-4e87-a46d-fadae25473a7 req-7474f1a5-0ed3-451f-a7b2-8985c2d457ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054600 Mar 29 02:10:57.312976 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 299/587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:57.670780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:57.671576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:57.680344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:57.680929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.681702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:57.682159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:57.980952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:57.989071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-416bd675-0fce-4b60-899d-186d71d6a5e0 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1459 microversion: 2.1 time: 0.323240 Mar 29 02:10:57.994431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 300/588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:57 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1459 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:57.994770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Releasing lock "refresh_cache-6b03c7bf-7933-4632-b749-2b1a4bf40f80" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:10:57.994770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] HTTP exception thrown: floating IP not found Mar 29 02:10:57.994770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Returning 404 to user: floating IP not found {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:57.994770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93eed23d-31a2-4e59-9861-3ac4c04a27ee tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 404 len: 67 microversion: 2.1 time: 0.959032 Mar 29 02:10:57.995399 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 289/589] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:57 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 67 bytes in 960 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:58.004007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-528f05c8-5f6f-4388-a23b-04ded46d09ff tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Action: 'action', calling method: .version_select at 0x7f872624e550>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:58.004791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:58.005436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:58.013556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.014004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.014775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.015211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.075177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-528f05c8-5f6f-4388-a23b-04ded46d09ff tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Mar 29 02:10:58.075782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-528f05c8-5f6f-4388-a23b-04ded46d09ff tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:58.076771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-528f05c8-5f6f-4388-a23b-04ded46d09ff tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action" status: 404 len: 88 microversion: 2.1 time: 0.076341 Mar 29 02:10:58.077359 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 301/590] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:57 2022] POST /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80/action => generated 88 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:58.082032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:58.082650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:58.098675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.098675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.098675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.098675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.460867 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65555f29-166e-4059-9ce4-8aca64fda616 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1610 microversion: 2.1 time: 0.459273 Mar 29 02:10:58.473735 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 290/591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:58 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1610 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:10:58.479887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:58.483813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:58.488639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.489133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.489912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.490348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.497728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:58.510565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:58.513989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:58.515934 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-73589025-0b63-4212-85d5-aba4ace04014 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1361 microversion: 2.25 time: 0.437642 Mar 29 02:10:58.516872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 302/592] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:58 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1361 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:10:58.529487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:58.530410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:58.542235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.542956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.543953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.544579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.655768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:10:58.903761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:58.915872 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb0cf0b8-a382-4394-bb6a-094651e1dfef tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 0.439804 Mar 29 02:10:58.920040 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 291/593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:58 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:58.922522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-69dd8d16-a51e-4c3a-b0f8-8f11ab9dc191 req-fd3208f6-0931-451a-9a7e-88322b5d51c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93b65e2-c37b-434a-8d78-1ebae6ffca02", "tag": "1599bc25-908e-448d-84dd-83016b587979"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:58.924704 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:58.924704 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:58.934470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-69dd8d16-a51e-4c3a-b0f8-8f11ab9dc191 req-fd3208f6-0931-451a-9a7e-88322b5d51c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:58.935269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-69dd8d16-a51e-4c3a-b0f8-8f11ab9dc191 req-fd3208f6-0931-451a-9a7e-88322b5d51c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:58.954171 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-69dd8d16-a51e-4c3a-b0f8-8f11ab9dc191 req-fd3208f6-0931-451a-9a7e-88322b5d51c8 service nova] Creating event network-changed:1599bc25-908e-448d-84dd-83016b587979 for instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 on n-h2-828148-1 Mar 29 02:10:58.960633 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-69dd8d16-a51e-4c3a-b0f8-8f11ab9dc191 req-fd3208f6-0931-451a-9a7e-88322b5d51c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042438 Mar 29 02:10:58.964405 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 292/594] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:59.003011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.006421 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:10:59.006421 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:10:59.011890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.011890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.012370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.012775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.041687 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26cad027-1177-4439-b2c8-4f06d71669e7 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.075730 Mar 29 02:10:59.042430 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 293/595] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:10:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:59.082238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edb73ce4-471f-4242-837a-68086bca4019 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 204 len: 0 microversion: 2.1 time: 0.563775 Mar 29 02:10:59.083233 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 303/596] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:10:58 2022] DELETE /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:10:59.089766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-828148-1", "block_migration": true, "disk_over_commit": false}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:10:59.093738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:59.108294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.109083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.110669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.111297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.214129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Lazy-loading 'flavor' on Instance uuid 50abf642-17cb-4335-a618-08f567dd0476 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:10:59.263690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 50abf642-17cb-4335-a618-08f567dd0476 while it is in vm_state suspended Mar 29 02:10:59.264290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 50abf642-17cb-4335-a618-08f567dd0476 while it is in vm_state suspended {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:10:59.265125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-462a70f2-1f31-42e5-8933-ed40764475b8 tempest-LiveMigrationNegativeTest-142360050 tempest-LiveMigrationNegativeTest-142360050-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476/action" status: 409 len: 155 microversion: 2.1 time: 0.180582 Mar 29 02:10:59.265842 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 304/597] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:10:59 2022] POST /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476/action => generated 155 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:10:59.272253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.272253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:59.276711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70249f2f-dc8e-4bfd-b952-d868f8ba6b59 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] Calling method '.version_select at 0x7f8717fbd550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.278760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.279200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.279992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.280419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.358901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70249f2f-dc8e-4bfd-b952-d868f8ba6b59 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] 10.222.0.36 "GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f" status: 200 len: 784 microversion: 2.1 time: 0.314853 Mar 29 02:10:59.359873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 294/598] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f => generated 784 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:59.364117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.364898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:59.374882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.375332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.376099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.376524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.443398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:10:59.646662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:10:59.661008 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-11b731ff-1f41-4285-b280-fabe715ca165 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1542 microversion: 2.1 time: 0.394062 Mar 29 02:10:59.662303 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 305/599] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1542 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:10:59.683217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-362a7fc9-8e3a-440d-8965-ee708067a824 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] Calling method '.version_select at 0x7f87242e9a60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.799543 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-362a7fc9-8e3a-440d-8965-ee708067a824 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] 10.222.0.36 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.125590 Mar 29 02:10:59.800355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 306/600] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/images => generated 445 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:59.811303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.811909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:59.819556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8addfbdb-3725-48df-a8ec-a8f82ea678ba tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "DELETE /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 204 len: 0 microversion: 2.1 time: 0.457997 Mar 29 02:10:59.820499 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 295/601] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:10:59 2022] DELETE /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:10:59.826331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ab3c1082-8de6-4e99-8e84-fd22d976b4c0 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] Calling method '.version_select at 0x7f8724137d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.841120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.841120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.841120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.841120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.923658 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ab3c1082-8de6-4e99-8e84-fd22d976b4c0 tempest-ListImagesTestJSON-645247932 tempest-ListImagesTestJSON-645247932-project] 10.222.0.36 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.101268 Mar 29 02:10:59.924210 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 296/602] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:10:59.938652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:10:59.939319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:10:59.955246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.955716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:10:59.956505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:10:59.956960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.178619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:00.190889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1d6f3b1-07e5-422c-878a-b8b2cce5914f tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1465 microversion: 2.1 time: 0.265200 Mar 29 02:11:00.191852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 297/603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1465 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:00.196996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:00.197967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:00.207319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.223404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.223404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.223404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.268716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:00.295053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:00.300276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:00.303853 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e173d47-59ab-432f-b2de-bbc8191770f9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1557 microversion: 2.25 time: 0.494877 Mar 29 02:11:00.304619 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 307/604] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:10:59 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1557 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:00.335325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:00.335937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:00.344214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.344668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.345474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.346087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.467321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:00.476248 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b3723ba-2bda-465d-971f-91dbab0ad227 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 0.283163 Mar 29 02:11:00.477656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 298/605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:00 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:00.680048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:00.681556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:00.694407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.696646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.699889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.701175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.755324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:00.830274 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58f2a265-02e7-44b8-9e08-d01e9796e740 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 2049 microversion: 2.25 time: 0.502524 Mar 29 02:11:00.841258 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 308/606] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:00 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 2049 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:00.848931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:00.850595 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:00.850595 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:00.853603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.854286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.855375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:00.855993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:00.885390 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09ac250a-3dab-4e7b-a2b4-466ab63e693f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039942 Mar 29 02:11:00.892428 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 309/607] 10.222.0.36 () {60 vars in 1216 bytes} [Tue Mar 29 02:11:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:11:01.201137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:01.209128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:01.209745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:01.213371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-715a17c0-de40-4fca-9d6f-c476e7dde0d3 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1542 microversion: 2.1 time: 0.536047 Mar 29 02:11:01.216687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 299/608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:00 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1542 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:01.222266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.222721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.223508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.223948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.475131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1569736537", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:01.552748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:01.553387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:01.553999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:01.554577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:01.555131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:01.565012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.565696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.567257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.567852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.589777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Getting quotas for project bdc1a3a997c040de85464c430ac8ebcf. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:01.596722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Getting quotas for user 96d3ba2e670a451385115b811ebf5faa and project bdc1a3a997c040de85464c430ac8ebcf. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:01.610262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:01.614500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:01.734878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:01.749095 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-494c00b5-2812-486c-a609-e5fc78b5afc3 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1465 microversion: 2.1 time: 0.543897 Mar 29 02:11:01.750225 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 310/609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:01 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1465 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:01.755098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:01.755865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:01.768336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.769493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.770472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:01.771271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:01.812290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac7ab7a3-0c58-4d78-a9e2-df9c1738f6ab tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.518171 Mar 29 02:11:01.815363 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 300/610] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 29 02:11:01.835650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:01.840698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:02.109353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.126661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.130722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.165527 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0aff5aa-1845-480d-933e-ed3ff1495ecc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "PUT /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1359 microversion: 2.75 time: 0.337708 Mar 29 02:11:02.166157 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 301/611] 10.222.0.36 () {62 vars in 1296 bytes} [Tue Mar 29 02:11:01 2022] PUT /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:02.172182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6959bb99-fefa-4624-a765-c468700d4998 req-4db50e1a-86d2-459d-90fe-7cbe4dad64de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b03c7bf-7933-4632-b749-2b1a4bf40f80", "name": "network-vif-deleted", "tag": "aeaecd63-85d0-4c09-8997-74064a224621"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:02.186722 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:02.186722 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:02.213204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6959bb99-fefa-4624-a765-c468700d4998 req-4db50e1a-86d2-459d-90fe-7cbe4dad64de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.214325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6959bb99-fefa-4624-a765-c468700d4998 req-4db50e1a-86d2-459d-90fe-7cbe4dad64de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:02.283385 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6959bb99-fefa-4624-a765-c468700d4998 req-4db50e1a-86d2-459d-90fe-7cbe4dad64de service nova] Creating event network-vif-deleted:aeaecd63-85d0-4c09-8997-74064a224621 for instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 on n-h2-828148-1 Mar 29 02:11:02.300826 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6959bb99-fefa-4624-a765-c468700d4998 req-4db50e1a-86d2-459d-90fe-7cbe4dad64de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133226 Mar 29 02:11:02.305327 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 302/612] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:02.324502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:02.325795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:02.452140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.465956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.467470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.473348 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3dc8a6b4-bbfe-4774-9755-6d8ce164d97a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1359 microversion: 2.75 time: 0.166051 Mar 29 02:11:02.474346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 303/613] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:02 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:02.482513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:02.482513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:02.491127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.491780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:02.493396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.494001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:02.610144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.610799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:02.613204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lazy-loading 'fault' on Instance uuid 6b03c7bf-7933-4632-b749-2b1a4bf40f80 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:02.679211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aac8878650d744f3a12ebbad01fac90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bfb660f51f43dda11271fa73f58cd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:02.688081 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebabcff1-c05f-4a52-bc3e-bfcda5287405 tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 200 len: 1321 microversion: 2.1 time: 0.212439 Mar 29 02:11:02.688655 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 304/614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:02 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:02.781878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:02.788054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:02.799672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.800424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:02.801391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:02.801986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.208501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:03.217124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b64877b6-67fb-4f76-941a-fd33e585325b tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1465 microversion: 2.1 time: 0.453735 Mar 29 02:11:03.217817 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 305/615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:02 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1465 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:03.332409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:03.345233 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-429df7d8-8d77-4fba-a640-0382bd385225 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 1.593753 Mar 29 02:11:03.356658 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 311/616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:01 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:03.500212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:03.500968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:03.512149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:03.513598 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:03.513598 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:03.515392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.516008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.517189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.517624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.521028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.526610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.526610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.526610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.634581 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-092a411c-b17a-4714-ba7c-a582a29917ba tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.415823 Mar 29 02:11:03.635921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 306/617] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:11:03 2022] GET /compute/v2.1/os-services => generated 944 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:03.705384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:03.717539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:03.719477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:03.737871 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64e94ba0-9b07-46fa-aad3-5ad844e83365 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1363 microversion: 2.75 time: 0.241644 Mar 29 02:11:03.738481 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 312/618] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:03 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:03.755786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:03.756580 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:03.756580 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:03.762418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.762841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.763677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.764091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.817717 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f4bf0f53-3446-4296-9ec3-e8fb1ca4f2b8 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?host=n-d-828148-1" status: 200 len: 578 microversion: 2.1 time: 0.066325 Mar 29 02:11:03.818325 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 313/619] 10.222.0.36 () {58 vars in 1171 bytes} [Tue Mar 29 02:11:03 2022] GET /compute/v2.1/os-services?host=n-d-828148-1 => generated 578 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:03.840563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:03.848646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] [instance: 6b03c7bf-7933-4632-b749-2b1a4bf40f80] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:03.882135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.885189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.887503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:03.887503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:03.958201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f8724d6af70>, body: {"keypair": {"name": "tempest-keypair-1037876415"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:04.008147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:04.017574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:04.023060 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] HTTP exception thrown: Instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 could not be found. Mar 29 02:11:04.023600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] Returning 404 to user: Instance 6b03c7bf-7933-4632-b749-2b1a4bf40f80 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:04.035583 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7ec0ceeb-23cd-46a0-858a-a8e9a43bfb3a tempest-FloatingIPsAssociationNegativeTestJSON-502744346 tempest-FloatingIPsAssociationNegativeTestJSON-502744346-project] 10.222.0.36 "GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80" status: 404 len: 111 microversion: 2.1 time: 0.188570 Mar 29 02:11:04.044620 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 314/620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:03 2022] GET /compute/v2.1/servers/6b03c7bf-7933-4632-b749-2b1a4bf40f80 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:04.058519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.059676 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:04.059676 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:04.065370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.068815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.071238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.072150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.151936 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0039d49d-aa9a-44b4-b774-a929ed3c2055 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106088 Mar 29 02:11:04.161333 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 315/621] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:04.178263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.188639 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:04.188639 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:04.191436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.197332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.199748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.200906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.241403 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-daa4de85-c35c-4afe-adf1-567b43f4f977 tempest-ServicesAdminTestJSON-1123706311 tempest-ServicesAdminTestJSON-1123706311-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.067533 Mar 29 02:11:04.242370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 316/622] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/os-services => generated 944 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:04.246978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.247582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:04.255857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.256307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.257171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.257615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.410557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:04.429672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:04.502712 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-411c7d49-39c0-471e-8009-d96db839c5d8 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.865323 Mar 29 02:11:04.504468 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 307/623] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:03 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 868 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:04.521639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-60ae0f58-5cd1-45bf-b1d7-b2684ce84d6d req-5ab55fd8-9daa-44a8-8b68-b7c1c7f21af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50abf642-17cb-4335-a618-08f567dd0476", "name": "network-vif-deleted", "tag": "0318097b-b47b-4bfe-98d9-d6dcdb104191"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:04.526484 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:04.526484 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:04.550513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:04.553167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-60ae0f58-5cd1-45bf-b1d7-b2684ce84d6d req-5ab55fd8-9daa-44a8-8b68-b7c1c7f21af6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.553837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-60ae0f58-5cd1-45bf-b1d7-b2684ce84d6d req-5ab55fd8-9daa-44a8-8b68-b7c1c7f21af6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.566582 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a401729-0e44-43c5-aea2-ab2ea1e79a3a tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 200 len: 1295 microversion: 2.1 time: 0.322775 Mar 29 02:11:04.567409 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 317/624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 1295 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:04.588196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.590428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:04.592110 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-60ae0f58-5cd1-45bf-b1d7-b2684ce84d6d req-5ab55fd8-9daa-44a8-8b68-b7c1c7f21af6 service nova] Creating event network-vif-deleted:0318097b-b47b-4bfe-98d9-d6dcdb104191 for instance 50abf642-17cb-4335-a618-08f567dd0476 on n-h1-828148-1 Mar 29 02:11:04.597821 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-60ae0f58-5cd1-45bf-b1d7-b2684ce84d6d req-5ab55fd8-9daa-44a8-8b68-b7c1c7f21af6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086533 Mar 29 02:11:04.600983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 308/625] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:04.601568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.606840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cba1a11-b92f-4160-a871-5da114c81567 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8725f05d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.607794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.609428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.609911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.623983 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cba1a11-b92f-4160-a871-5da114c81567 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1037876415" status: 200 len: 706 microversion: 2.2 time: 0.019192 Mar 29 02:11:04.624873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 309/626] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1037876415 => generated 706 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:04.641861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25c6248f-c99b-481a-885e-77039fd5bded tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724137a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.814059 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25c6248f-c99b-481a-885e-77039fd5bded tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037876415" status: 204 len: 0 microversion: 2.2 time: 0.181577 Mar 29 02:11:04.815957 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 310/627] 10.222.0.36 () {60 vars in 1260 bytes} [Tue Mar 29 02:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037876415 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:04.828603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:04.831154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:04.862281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.862281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:04.862281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:04.862281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.052205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:05.064866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-57481f76-75a0-4a7d-85fa-74e29fdf21e8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 0.486322 Mar 29 02:11:05.077361 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 318/628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:05.077361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f87242e90d0>, body: {"keypair": {"name": "tempest-keypair-885692635"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:05.099966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:05.110055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:05.110916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:05.111496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:05.117403 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51d679e2-c476-49b3-9cb1-cd8e4719f7d4 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1411 microversion: 2.75 time: 0.300132 Mar 29 02:11:05.121859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:05.131037 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 311/629] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:04 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1411 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:05.453134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-518c263e-77f4-4267-bd88-856d1f9c4b35 req-23816d47-174b-4bb7-8d8a-b31fdf202479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b65e2-c37b-434a-8d78-1ebae6ffca02", "name": "network-vif-plugged", "status": "completed", "tag": "1599bc25-908e-448d-84dd-83016b587979"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:05.455736 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:05.455736 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:05.465577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-518c263e-77f4-4267-bd88-856d1f9c4b35 req-23816d47-174b-4bb7-8d8a-b31fdf202479 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.466493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-518c263e-77f4-4267-bd88-856d1f9c4b35 req-23816d47-174b-4bb7-8d8a-b31fdf202479 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.473672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:05.481189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:05.490578 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-518c263e-77f4-4267-bd88-856d1f9c4b35 req-23816d47-174b-4bb7-8d8a-b31fdf202479 service nova] Creating event network-vif-plugged:1599bc25-908e-448d-84dd-83016b587979 for instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 on n-h2-828148-1 Mar 29 02:11:05.499945 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9f48e4d-10a7-4532-ba51-ab9e31c94a0a tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.428786 Mar 29 02:11:05.500691 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 319/630] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:05 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:05.507084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-518c263e-77f4-4267-bd88-856d1f9c4b35 req-23816d47-174b-4bb7-8d8a-b31fdf202479 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057390 Mar 29 02:11:05.508868 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 312/631] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:11:05.512291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1655e355-946b-4d8c-a579-dc36e8798f08 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f87242e9160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:05.585210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:05.586033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 50abf642-17cb-4335-a618-08f567dd0476] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:05.592115 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1655e355-946b-4d8c-a579-dc36e8798f08 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885692635" status: 204 len: 0 microversion: 2.2 time: 0.085184 Mar 29 02:11:05.599638 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 320/632] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Mar 29 02:11:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885692635 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:05.602739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.603222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.605308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.605607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-366001c1-7d09-4bb8-950e-a8f3654542c0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f8724d6db80>, body: {"keypair": {"name": "tempest-keypair-1241510970", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:05.606175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.655683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366001c1-7d09-4bb8-950e-a8f3654542c0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:05.662078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-366001c1-7d09-4bb8-950e-a8f3654542c0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:05.729780 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] HTTP exception thrown: Instance 50abf642-17cb-4335-a618-08f567dd0476 could not be found. Mar 29 02:11:05.730616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Returning 404 to user: Instance 50abf642-17cb-4335-a618-08f567dd0476 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:05.731929 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d9e511e-72c6-4ce4-81a6-db4a5e9927a2 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476" status: 404 len: 111 microversion: 2.1 time: 0.151260 Mar 29 02:11:05.733427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 313/633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:05 2022] GET /compute/v2.1/servers/50abf642-17cb-4335-a618-08f567dd0476 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:05.741835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:05.742836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:05.751944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.764959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.764959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.764959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.825708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:11:05.858932 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-366001c1-7d09-4bb8-950e-a8f3654542c0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.257936 Mar 29 02:11:05.859548 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 321/634] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:11:05 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Mar 29 02:11:05.869823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6a03a79-4484-4972-bc48-9fb63ed7d385", "device": "/dev/xvdb"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:05.871521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:05.885358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.885989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:05.900473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:05.902392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.179475 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ecc7a024-af95-4c2c-9a9f-a4252e23d27d tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "DELETE /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 204 len: 0 microversion: 2.1 time: 0.441505 Mar 29 02:11:06.180912 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 314/635] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:11:05 2022] DELETE /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:06.186587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74b3f14c-ffbf-4107-9cde-82023ba1afeb tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724d6ad30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:06.271209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74b3f14c-ffbf-4107-9cde-82023ba1afeb tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241510970" status: 204 len: 0 microversion: 2.2 time: 0.088868 Mar 29 02:11:06.271780 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 315/636] 10.222.0.36 () {60 vars in 1260 bytes} [Tue Mar 29 02:11:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1241510970 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:06.301008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:06.301737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:06.309652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.310088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.310872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.311278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.588226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:06.596289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4144079a-6837-450f-ad63-b9674adff114 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1308 microversion: 2.1 time: 0.305565 Mar 29 02:11:06.596856 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 316/637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:06 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1308 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:06.601344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:06.601949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:06.609052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.609496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.610257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.610687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.739613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:06.748364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:06.749783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:06.755029 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-862e0137-be4b-4124-aaf8-02820e0d0387 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1417 microversion: 2.75 time: 0.157197 Mar 29 02:11:06.755663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 317/638] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:06 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1417 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:06.760526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:06.761296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:06.768236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.768690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.769470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:06.769894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:06.943810 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1659dbe5-6ff8-4c82-b316-3a35609b810d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "POST /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.078409 Mar 29 02:11:06.945314 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 322/639] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Mar 29 02:11:05 2022] POST /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments => generated 194 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:11:06.964441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f8724d41c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1162273541"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:07.002233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:07.009833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:07.303640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:07.319221 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc339366-d44f-4b19-91ba-47d22e5d8cd9 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1474 microversion: 2.1 time: 0.562519 Mar 29 02:11:07.324996 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 318/640] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:06 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1474 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:07.613674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:07.615021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:07.624029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:07.624806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:07.626233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:07.626874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:07.645215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:07.658533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:07.691593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b90ed7af-5b59-466d-9a7e-06597e129ec0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.743235 Mar 29 02:11:07.693833 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 323/641] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:06 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 748 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:07.707599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f8717e94d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1319453849"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:07.736075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:07.742188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:08.199372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:08.210506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-325d57cd-5952-4920-8375-8c90620044e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1487 microversion: 2.1 time: 0.601951 Mar 29 02:11:08.210913 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 319/642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:07 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1487 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:08.226196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:08.226823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:08.258475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.258943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:08.259742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.260114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:08.524932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:08.538897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:08.542189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:08.555513 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36601f48-510a-42ba-8392-e2d5782aaee6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1417 microversion: 2.75 time: 0.332778 Mar 29 02:11:08.556137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:08.568206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 320/643] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:08 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1417 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:08.573272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:08.576758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:08.577065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:08.593437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e9de18d-167d-4d24-b423-a61cec553335 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.891340 Mar 29 02:11:08.595279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 324/644] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:07 2022] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 894 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:08.604115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:08.605208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:08.605869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.606321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:08.608078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.611892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:08.648070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.650200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:08.650200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:08.650545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:09.011585 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d34faf8-850f-4f3e-8551-ba263ef68fbe tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02/action" status: 202 len: 0 microversion: 2.1 time: 0.441808 Mar 29 02:11:09.012413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 321/645] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:11:08 2022] POST /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:11:09.017735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f87241c5dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-19528704"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:09.041269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:09.046342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:09.620508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:09.626275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:09.630652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86ec20ab-d5f0-4b70-aa25-70c87df54d16 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1474 microversion: 2.1 time: 1.033957 Mar 29 02:11:09.631231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 325/646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:08 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1474 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:09.636772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:09.637803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:09.644054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:09.645246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:09.645857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:09.646775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:09.647379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:09.677518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f675b92-b764-49df-8318-548aaa8c7ef0 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2334 microversion: 2.2 time: 0.663927 Mar 29 02:11:09.678582 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 322/647] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:09 2022] POST /compute/v2.1/os-keypairs => generated 2334 bytes in 666 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:09.694328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:09.699830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:09.728785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:09.729402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:09.730276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:09.730770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:09.977771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:09.987256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:09.990957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:09.997990 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5742d056-b3fd-48f5-ab8d-37af21338509 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1438 microversion: 2.75 time: 0.318223 Mar 29 02:11:09.999094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 323/648] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:09 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1438 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:10.005198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-518ea9a7-5878-46aa-9c0c-48df738f5132 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f87242e8b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:10.008993 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-518ea9a7-5878-46aa-9c0c-48df738f5132 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:10.025540 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-518ea9a7-5878-46aa-9c0c-48df738f5132 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:10.037942 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-518ea9a7-5878-46aa-9c0c-48df738f5132 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.037583 Mar 29 02:11:10.044540 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 324/649] 10.222.0.36 () {60 vars in 1176 bytes} [Tue Mar 29 02:11:09 2022] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:10.051078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:10.052876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:10.062385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.062963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.063874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.064426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.214932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:10.215625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:10.216286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:10.217153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:10.217709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:10.552211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:10.574229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.574872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.577546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.578441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.597945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:10.609678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67fe46fa-1671-40dd-82cb-74ae40bb1077 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 200 len: 1472 microversion: 2.1 time: 0.977044 Mar 29 02:11:10.610270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 326/650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:09 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 1472 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:10.629710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8076d430-0619-417a-99f4-015e9b37a443 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8717e8b940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:10.734323 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8076d430-0619-417a-99f4-015e9b37a443 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-19528704" status: 204 len: 0 microversion: 2.2 time: 0.110373 Mar 29 02:11:10.735028 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 327/651] 10.222.0.36 () {60 vars in 1314 bytes} [Tue Mar 29 02:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-19528704 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:10.741112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-335ed0bb-d990-4402-a3b2-714d61d74873 req-1a010199-c974-44de-b28c-d29a9e733bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "616855f6-bf60-4249-bf70-07c170c10325", "name": "network-vif-deleted", "tag": "ba99a210-149c-4283-9d12-ca4b219a5274"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:10.742801 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:10.742801 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:10.770035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-335ed0bb-d990-4402-a3b2-714d61d74873 req-1a010199-c974-44de-b28c-d29a9e733bb0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.770476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-335ed0bb-d990-4402-a3b2-714d61d74873 req-1a010199-c974-44de-b28c-d29a9e733bb0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.775599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:10.785198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:10.786687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:10.792926 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cd176d88-157b-4b99-bfa7-08c4d4c9885b tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "POST /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084/action" status: 202 len: 1495 microversion: 2.75 time: 0.752203 Mar 29 02:11:10.793548 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 325/652] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:11:10 2022] POST /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084/action => generated 1495 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 29 02:11:10.794971 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-335ed0bb-d990-4402-a3b2-714d61d74873 req-1a010199-c974-44de-b28c-d29a9e733bb0 service nova] Creating event network-vif-deleted:ba99a210-149c-4283-9d12-ca4b219a5274 for instance 616855f6-bf60-4249-bf70-07c170c10325 on n-h2-828148-1 Mar 29 02:11:10.797944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1281507428"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:10.799014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:10.805201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-335ed0bb-d990-4402-a3b2-714d61d74873 req-1a010199-c974-44de-b28c-d29a9e733bb0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068467 Mar 29 02:11:10.806065 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 328/653] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:10.806936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.807668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.808542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.809001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.812740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:10.813910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:10.822276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.822720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.823734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.824163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.909801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:10.910375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:10.910899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lazy-loading 'fault' on Instance uuid 616855f6-bf60-4249-bf70-07c170c10325 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:11.083982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc3e059f77854460b855e0dd15bb2be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f52345b4968b43c084e21a9c840affaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:11.093174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24c24f61-e485-4bc1-9fb8-8a44d1ef1ebe tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 200 len: 1308 microversion: 2.1 time: 0.285247 Mar 29 02:11:11.094211 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 329/654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:10 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:11.402334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-771065808", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:11.480352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:11.517726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee3548a6-b5db-44f2-8376-8aa10caf72c9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02/action" status: 202 len: 0 microversion: 2.1 time: 0.722977 Mar 29 02:11:11.520538 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 326/655] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:11:10 2022] POST /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02/action => generated 0 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:11:11.527475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb75c380-1f75-42df-b34d-1643b2edf8dd tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724d6af70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:11.637973 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb75c380-1f75-42df-b34d-1643b2edf8dd tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1319453849" status: 204 len: 0 microversion: 2.2 time: 0.115668 Mar 29 02:11:11.638844 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 327/656] 10.222.0.36 () {60 vars in 1320 bytes} [Tue Mar 29 02:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1319453849 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:11.644185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:11.646775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:11.660937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:11.666053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:11.669682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:11.670327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:11.854099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:11.865577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:11.867080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:11.873783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:11.874308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:11.874664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:11.875065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:11.875727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:11.881329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d645eeaa-4b68-473f-b517-7c8e9ea2a24a tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.241245 Mar 29 02:11:11.881909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 328/657] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:11 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:11.886064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:11.898432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:11.898432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:11.898432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:11.899021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acf07fe0-6f10-4894-a32f-f7748e84983a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e8b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:11.926607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Getting quotas for project 24e6cf8d5000445e8b3b561c84b64de0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:11.933396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Getting quotas for user 40022d2480a041d597d9bb84078927a8 and project 24e6cf8d5000445e8b3b561c84b64de0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:11.949926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:11.952912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:11.968731 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acf07fe0-6f10-4894-a32f-f7748e84983a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.085630 Mar 29 02:11:11.975140 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 329/658] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:11 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:11.975140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1be1c928-406e-4ba2-9826-88f29eaf5867 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f87241c50d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.069365 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1be1c928-406e-4ba2-9826-88f29eaf5867 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1162273541" status: 204 len: 0 microversion: 2.2 time: 0.098662 Mar 29 02:11:12.070926 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 330/659] 10.222.0.36 () {60 vars in 1320 bytes} [Tue Mar 29 02:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1162273541 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:12.079930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f8724b0c0d0>, body: {"keypair": {"name": "tempest-keypair-2126609901"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:12.105024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:12.122127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:12.135026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f8205c1-9c55-4266-aa19-4adca10f30ee tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036414 Mar 29 02:11:12.140496 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 330/660] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:11:12.145316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.146118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] [instance: 616855f6-bf60-4249-bf70-07c170c10325] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:12.154763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:12.155208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:12.155972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:12.156401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:12.222340 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] HTTP exception thrown: Instance 616855f6-bf60-4249-bf70-07c170c10325 could not be found. Mar 29 02:11:12.224423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] Returning 404 to user: Instance 616855f6-bf60-4249-bf70-07c170c10325 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:12.225544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01457cbc-5594-4f16-9da8-105df0ed07b7 tempest-LiveMigrationNegativeTest-1751524106 tempest-LiveMigrationNegativeTest-1751524106-project] 10.222.0.36 "GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325" status: 404 len: 111 microversion: 2.1 time: 0.083749 Mar 29 02:11:12.227431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 331/661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:12 2022] GET /compute/v2.1/servers/616855f6-bf60-4249-bf70-07c170c10325 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:12.249138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-829e1e95-bcec-40f3-9d48-7b076583ad07 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.251220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-829e1e95-bcec-40f3-9d48-7b076583ad07 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:12.401801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:12.416927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:12.443319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-829e1e95-bcec-40f3-9d48-7b076583ad07 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:12.457200 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-829e1e95-bcec-40f3-9d48-7b076583ad07 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1213 microversion: 2.1 time: 0.224149 Mar 29 02:11:12.457868 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 332/662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:12 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1213 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:12.458002 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03336abf-0915-473b-8bfa-f0bf743e2b1d tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 0.379439 Mar 29 02:11:12.463865 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 331/663] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:12 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 384 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:12.474914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01a84fa0-2dac-41f6-a087-e4615f867738 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724344160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.483732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01a84fa0-2dac-41f6-a087-e4615f867738 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-2126609901" status: 200 len: 707 microversion: 2.2 time: 0.014779 Mar 29 02:11:12.484480 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 333/664] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Mar 29 02:11:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2126609901 => generated 707 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:12.495467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f65262c6-c1b9-43ac-8ec2-14e7248bd020 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724b0ca60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.499095 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-f65262c6-c1b9-43ac-8ec2-14e7248bd020 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:12.505439 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-f65262c6-c1b9-43ac-8ec2-14e7248bd020 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:12.511310 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f65262c6-c1b9-43ac-8ec2-14e7248bd020 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.020225 Mar 29 02:11:12.512152 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 332/665] 10.222.0.36 () {60 vars in 1176 bytes} [Tue Mar 29 02:11:12 2022] GET /compute/v2.1/os-keypairs => generated 564 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:12.521600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-02b44c69-4354-49ce-99ec-242dbc795f1f tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8717e8b8b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.632173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-02b44c69-4354-49ce-99ec-242dbc795f1f tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126609901" status: 204 len: 0 microversion: 2.2 time: 0.114071 Mar 29 02:11:12.633714 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 334/666] 10.222.0.36 () {60 vars in 1260 bytes} [Tue Mar 29 02:11:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2126609901 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:12.643674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Action: 'create', calling method: .version_select at 0x7f87241cb8b0>, body: {"keypair": {"name": "tempest-keypair-642014591", "type": "x509"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:12.689340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:12.700635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:12.752924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.processutils [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpyut00kxl/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpyut00kxl/temp.key -subj /CN=f0168f4e451b4ccaa4e07e0d13d6f7fe -extensions v3_req_client {{(pid=103513) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 29 02:11:12.901199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:12.902378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:12.919141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:12.923981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:12.923981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:12.923981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:12.956445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.processutils [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpyut00kxl/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpyut00kxl/temp.key -subj /CN=f0168f4e451b4ccaa4e07e0d13d6f7fe -extensions v3_req_client" returned: 0 in 0.203s {{(pid=103513) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 29 02:11:12.958353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.processutils [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpyut00kxl/temp.key -password pass: {{(pid=103513) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Mar 29 02:11:12.996979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.processutils [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpyut00kxl/temp.key -password pass:" returned: 0 in 0.037s {{(pid=103513) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Mar 29 02:11:13.116812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:13.124504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Getting quotas for user f0168f4e451b4ccaa4e07e0d13d6f7fe and project a1f298a5915045d8bbe76883bcb14aaa. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:13.145524 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae55e125-0c14-498a-a728-08ac6c424ec5 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.506749 Mar 29 02:11:13.149742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 333/667] 10.222.0.36 () {62 vars in 1197 bytes} [Tue Mar 29 02:11:12 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 509 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:13.153955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a48134ca-6bb0-4302-8a25-0d907e0264b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724cf6af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:13.160375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:13.173878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:13.178496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:13.189439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d933adb2-9829-4074-a544-0a75039db4cc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.292313 Mar 29 02:11:13.213939 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 335/668] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:12 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:11:13.219452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-97c5c7e6-9ae5-43cb-8438-943f5ade37ae tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8717e7c550>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:13.225124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a48134ca-6bb0-4302-8a25-0d907e0264b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.075990 Mar 29 02:11:13.225778 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 334/669] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:13 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:13.240025 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-97c5c7e6-9ae5-43cb-8438-943f5ade37ae tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-642014591" status: 200 len: 1533 microversion: 2.2 time: 0.024070 Mar 29 02:11:13.241610 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 336/670] 10.222.0.36 () {60 vars in 1254 bytes} [Tue Mar 29 02:11:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-642014591 => generated 1533 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:13.251734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e20898c-5efb-4c32-bed8-3643c789e06e tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f87241cbdc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:13.255339 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-5e20898c-5efb-4c32-bed8-3643c789e06e tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:13.261693 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-5e20898c-5efb-4c32-bed8-3643c789e06e tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:11:13.267575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e20898c-5efb-4c32-bed8-3643c789e06e tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019087 Mar 29 02:11:13.269664 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 335/671] 10.222.0.36 () {60 vars in 1176 bytes} [Tue Mar 29 02:11:13 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:13.283227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-abbc3c93-f154-43b2-a324-8d7362e722a9 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] Calling method '.version_select at 0x7f8724244700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:13.362112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-abbc3c93-f154-43b2-a324-8d7362e722a9 tempest-KeyPairsV22TestJSON-1879143286 tempest-KeyPairsV22TestJSON-1879143286-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642014591" status: 204 len: 0 microversion: 2.2 time: 0.086580 Mar 29 02:11:13.365135 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 337/672] 10.222.0.36 () {60 vars in 1257 bytes} [Tue Mar 29 02:11:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642014591 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:13.474121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:13.474808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:13.484677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:13.485158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:13.485984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:13.486411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:13.627135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:13.636492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-473972f3-76b2-428e-a86d-e90c7f8af83a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1217 microversion: 2.1 time: 0.165934 Mar 29 02:11:13.653687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 336/673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:13 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:14.213881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:14.214511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:14.222559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:14.223008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:14.223775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:14.224201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:14.238958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4099cbea-e200-4f28-82a0-4e93c099da27 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b0c280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:14.291330 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4099cbea-e200-4f28-82a0-4e93c099da27 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.056124 Mar 29 02:11:14.292095 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 337/674] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:14 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:14.361688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:14.372877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:14.374400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:14.387378 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ba42e18-6eec-4ce8-9a72-ab8ac336a1ed tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.178400 Mar 29 02:11:14.405094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 338/675] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:14 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:14.661161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:14.662739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:14.671209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:14.671881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:14.673372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:14.674029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:14.838723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:14.848801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44a2e1a0-00a6-430d-9a10-4567905c8aca tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1273 microversion: 2.1 time: 0.191226 Mar 29 02:11:14.849867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 338/676] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:14 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:15.305875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9d43d0e-a94e-4c40-be9b-8af2719f65e1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717e7c940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:15.361600 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9d43d0e-a94e-4c40-be9b-8af2719f65e1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.060505 Mar 29 02:11:15.362663 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 339/677] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:15 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:15.414722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:15.415325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:15.427524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:15.427969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:15.428745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:15.431536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:15.562719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:15.573797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:15.576014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:15.582796 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00eda9e4-b791-44c8-bd54-2c28005e16a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.172244 Mar 29 02:11:15.583915 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 339/678] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:15 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:15.867926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:15.867926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:15.876113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:15.876569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:15.877655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:15.878271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:16.082522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:16.101499 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8548e97d-fb7e-45ca-bec6-5eb847c34978 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1271 microversion: 2.1 time: 0.235999 Mar 29 02:11:16.102112 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 340/679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:15 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:16.375767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7479c814-f28f-4755-b34f-321b11ae1ca1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724245820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:16.453621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7479c814-f28f-4755-b34f-321b11ae1ca1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.081773 Mar 29 02:11:16.455251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 340/680] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:16 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:16.603328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:16.604029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:16.617661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:16.622047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:16.623427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:16.628361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:16.939665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:16.951806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:16.953363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:16.961913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7114077-95e2-402b-b501-86fa3e45a2dc tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.359497 Mar 29 02:11:16.961913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 341/681] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:16 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:17.120642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:17.121355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:17.137514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:17.137979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:17.138995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:17.139229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:17.471828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-612a3a48-8784-4bbd-bbb9-833b765c3d3f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717e7c700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:17.576506 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-612a3a48-8784-4bbd-bbb9-833b765c3d3f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.111276 Mar 29 02:11:17.578341 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 342/682] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:17 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:17.588966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-55f2de2a-b498-4979-bc0c-8855a8241eb3 req-b4cfd237-ac05-4fb9-a52c-51b5eced01b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b65e2-c37b-434a-8d78-1ebae6ffca02", "name": "network-vif-plugged", "status": "completed", "tag": "1599bc25-908e-448d-84dd-83016b587979"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:17.592672 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:17.592672 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:17.614040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-55f2de2a-b498-4979-bc0c-8855a8241eb3 req-b4cfd237-ac05-4fb9-a52c-51b5eced01b8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:17.614630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-55f2de2a-b498-4979-bc0c-8855a8241eb3 req-b4cfd237-ac05-4fb9-a52c-51b5eced01b8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:17.657828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-55f2de2a-b498-4979-bc0c-8855a8241eb3 req-b4cfd237-ac05-4fb9-a52c-51b5eced01b8 service nova] Creating event network-vif-plugged:1599bc25-908e-448d-84dd-83016b587979 for instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 on n-h2-828148-1 Mar 29 02:11:17.668648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:17.669445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-55f2de2a-b498-4979-bc0c-8855a8241eb3 req-b4cfd237-ac05-4fb9-a52c-51b5eced01b8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088405 Mar 29 02:11:17.671648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 343/683] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:17.679211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-246a8896-3d1a-4f12-9837-19cab3ae28c3 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.563514 Mar 29 02:11:17.685318 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 341/684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:17 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:17.969043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1996214416", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:17.979763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:17.980417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:17.992157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:17.992613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:17.993495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:17.993930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:18.108337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:18.176303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:18.186709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:18.188210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:18.201325 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4158624-a2c2-4a3e-aed9-c0afa91301d7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.225601 Mar 29 02:11:18.214013 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 342/685] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:17 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:18.592695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49c689b1-6cb9-4d94-b46a-c3a38642a482 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e8550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:18.707480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49c689b1-6cb9-4d94-b46a-c3a38642a482 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.111232 Mar 29 02:11:18.707480 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 343/686] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:18 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:18.721728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:18.733013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:18.742943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:18.744183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:18.745259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:18.745915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:18.948763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:18.949324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:18.949684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:18.950316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:18.950905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:18.970006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:18.970777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:18.973087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:18.973852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:19.017881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Getting quotas for project 227324fd625649afb3baa16a37f3b4ee. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:19.038859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Getting quotas for user 7e9dae8006744e15b9529cbda35d9742 and project 227324fd625649afb3baa16a37f3b4ee. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:19.069304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:19.074709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:19.123224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:19.132120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-853aea25-c82f-4abe-94d8-4b114d2fdfa1 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.427899 Mar 29 02:11:19.139426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 344/687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:18 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:19.222953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:19.223739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:19.241243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:19.242584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:19.243552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:19.244135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:19.282627 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d548014-157b-4cec-8e1d-fccb229f6d72 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605533 Mar 29 02:11:19.283952 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 344/688] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:11:19.297581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63215faf-421b-43a1-99be-6b47ed2afc2a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:19.301616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63215faf-421b-43a1-99be-6b47ed2afc2a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:19.500960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63215faf-421b-43a1-99be-6b47ed2afc2a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:19.526725 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63215faf-421b-43a1-99be-6b47ed2afc2a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1217 microversion: 2.1 time: 0.222534 Mar 29 02:11:19.526725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 345/689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:19 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:19.529730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-abbd254f-549a-4dec-8a3e-1fb1cd15af96 req-927df4a6-48f6-40b5-9eaf-4296677dbf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843b3ac2-c37f-4bd5-9486-18f89a6352e7", "tag": "1fb147f0-7e62-463b-adfc-d2f67cafa0fd"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:19.535876 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:19.535876 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:19.538845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:19.547414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-abbd254f-549a-4dec-8a3e-1fb1cd15af96 req-927df4a6-48f6-40b5-9eaf-4296677dbf0c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:19.548382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-abbd254f-549a-4dec-8a3e-1fb1cd15af96 req-927df4a6-48f6-40b5-9eaf-4296677dbf0c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:19.555304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:19.557086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:19.569381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-abbd254f-549a-4dec-8a3e-1fb1cd15af96 req-927df4a6-48f6-40b5-9eaf-4296677dbf0c service nova] Creating event network-changed:1fb147f0-7e62-463b-adfc-d2f67cafa0fd for instance 843b3ac2-c37f-4bd5-9486-18f89a6352e7 on n-h1-828148-1 Mar 29 02:11:19.573908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7feb4433-f37c-46d0-bd09-24674df8a747 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.352818 Mar 29 02:11:19.575465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 345/690] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:19 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:11:19.578215 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-abbd254f-549a-4dec-8a3e-1fb1cd15af96 req-927df4a6-48f6-40b5-9eaf-4296677dbf0c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055349 Mar 29 02:11:19.579422 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 346/691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:19.720407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-491264dd-924d-4177-a745-abbb3d447ed9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717e94dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:19.834004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-491264dd-924d-4177-a745-abbb3d447ed9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.118856 Mar 29 02:11:19.835381 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 347/692] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:19 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:19.867207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-400457893", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:19.974512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:20.153165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:20.154089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:20.165797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:20.166203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:20.166968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:20.167395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:20.403866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:20.404531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:20.407792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:20.408485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:20.409041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:20.423401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:20.444147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:20.444147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:20.444147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:20.450094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:20.456680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for user 035be210e94e4072b31cb011a5189ee4 and project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:20.473220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:20.475859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:20.928160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-100e96b2-80b5-428f-bb93-4a1972c476d4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349795 Mar 29 02:11:20.928853 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 346/693] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:11:20.934871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a12a395c-9f5c-4ea8-9f21-44496c0fda5d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:20.935593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a12a395c-9f5c-4ea8-9f21-44496c0fda5d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:21.038993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a12a395c-9f5c-4ea8-9f21-44496c0fda5d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.044456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a12a395c-9f5c-4ea8-9f21-44496c0fda5d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1217 microversion: 2.1 time: 0.114328 Mar 29 02:11:21.045226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 347/694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:20 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:21.049734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:21.050326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:21.060922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.061374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:21.062207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.062644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:21.209003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.223112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.225181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.231488 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e7b3f73-5e62-4ac9-a55a-54b5fabc62dd tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.185034 Mar 29 02:11:21.232999 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 348/695] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:21 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:21.237957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f18bf09a-86f9-4d50-b49e-009f37885b2e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724d21ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:21.305038 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f18bf09a-86f9-4d50-b49e-009f37885b2e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.070166 Mar 29 02:11:21.306264 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 349/696] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:21 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:21.311261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d7e13cf-17f8-4623-848f-0db397b82a24 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:21.312125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d7e13cf-17f8-4623-848f-0db397b82a24 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:21.481523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d7e13cf-17f8-4623-848f-0db397b82a24 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.494015 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d7e13cf-17f8-4623-848f-0db397b82a24 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1212 microversion: 2.1 time: 0.186451 Mar 29 02:11:21.495044 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 350/697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:21 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:21.499730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:21.500500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:21.513425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:21.514005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.514357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:21.515312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.515887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:21.525894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e490217-b321-4822-b6cc-cd55800f62f4 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 1.378998 Mar 29 02:11:21.538510 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 348/698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:20 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:21.837864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:21.930298 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15564aba-1e36-460c-9c14-bbc78b10d73c tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 2127 microversion: 2.25 time: 0.433270 Mar 29 02:11:21.930957 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 351/699] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:21 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 2127 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:21.950472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-828148-1", "block_migration": "auto"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:21.951712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:21.962096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.962951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:21.964937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:21.965542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.060955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:22.061577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:22.079392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.080142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.081135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.081730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.284904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'flavor' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:22.310986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:22.322094 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3eab61c8-e1af-4629-8d1e-a2de101fbe94 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1213 microversion: 2.1 time: 0.264548 Mar 29 02:11:22.323558 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 352/700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:22 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1213 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:22.335690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:22.336650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:22.348501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.349989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.352375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.353016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.363953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Going to try to live migrate instance to n-h2-828148-1 {{(pid=103514) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:11:22.500500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:22.510500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:22.512021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:22.517489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58c8e725-08e9-4eb9-a2e7-73e10ca795f6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.192787 Mar 29 02:11:22.518361 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 353/701] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:22 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:22.525711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9082e51-9126-418e-9782-1160441bd025 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724d178b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:22.604908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9082e51-9126-418e-9782-1160441bd025 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.085470 Mar 29 02:11:22.610538 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 354/702] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:22 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:22.610538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:22.613143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:22.622020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.622778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.623618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.624116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.771603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:22.783238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5ef3752-227f-4083-9a11-6b9c3dc85cd7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1216 microversion: 2.1 time: 0.176033 Mar 29 02:11:22.792805 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 355/703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:22 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1216 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:22.792805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:22.792805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:22.797928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.798674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:22.799988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:22.803081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:23.349170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:23.360790 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f4582f5-2de6-440a-a64c-6575697e44cf tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.575539 Mar 29 02:11:23.365696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 356/704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:22 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:23.502138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Calling method '.version_select at 0x7f8725ee3790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:23.555198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 85a95364-f99d-4bab-8ef9-d8f7f4f4b06c does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:11:23.555770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Neutron security group 85a95364-f99d-4bab-8ef9-d8f7f4f4b06c not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:11:23.556347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] HTTP exception thrown: Security group 85a95364-f99d-4bab-8ef9-d8f7f4f4b06c does not exist Mar 29 02:11:23.556347 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-159388b9-5c9a-4b3e-9f3d-3d44fef3025b'] Mar 29 02:11:23.557009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Returning 404 to user: Security group 85a95364-f99d-4bab-8ef9-d8f7f4f4b06c does not exist Mar 29 02:11:23.557009 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-159388b9-5c9a-4b3e-9f3d-3d44fef3025b'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:23.564587 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3e8d26f1-8590-472c-8e4a-e9a8de7cf4d2 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/85a95364-f99d-4bab-8ef9-d8f7f4f4b06c" status: 404 len: 194 microversion: 2.1 time: 0.191025 Mar 29 02:11:23.564587 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 357/705] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:11:23 2022] DELETE /compute/v2.1/os-security-groups/85a95364-f99d-4bab-8ef9-d8f7f4f4b06c => generated 194 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:23.582154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:23.582539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:23.602806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:23.603255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:23.605886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:23.606313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:23.759962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:23.773859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f5ae7fe-ead2-49d6-80cd-07cf7971a3b7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1287 microversion: 2.1 time: 0.208339 Mar 29 02:11:23.776609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 358/706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:23 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1287 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:23.789435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:23.790908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:23.800975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:23.801427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:23.802220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:23.802663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:23.978911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:23.988750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:23.990315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:23.995649 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d49f6b0-d53b-42b3-acb6-8f6ab1037d64 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.209892 Mar 29 02:11:23.996248 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 359/707] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:23 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:24.013634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4764c14b-eb30-4ceb-a51a-8086b57de338 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.016250 Mar 29 02:11:24.024184 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 360/708] 10.222.0.36 () {58 vars in 1163 bytes} [Tue Mar 29 02:11:23 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 29 02:11:24.024184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6dc97c32-6238-4ead-b57d-175a49336c8d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b0c8b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:24.089440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6dc97c32-6238-4ead-b57d-175a49336c8d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.074231 Mar 29 02:11:24.090424 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 361/709] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:24 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:24.095346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:24.095997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:24.103931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:24.104385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:24.105214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:24.105636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:24.252526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:24.261902 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0b8067e-5d99-4541-8cec-e0a004368362 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1264 microversion: 2.1 time: 0.170197 Mar 29 02:11:24.262697 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 362/710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:24 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:24.267577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e421daf3-a07a-4425-bbe8-0041350cc88c tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Calling method '.version_select at 0x7f8724d17c10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:24.482347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e421daf3-a07a-4425-bbe8-0041350cc88c tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.218216 Mar 29 02:11:24.482947 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 363/711] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:11:24 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:24.487845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:24.488684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:24.499284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:24.500912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:24.501271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:24.501942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:24.829684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:24.839290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e8735ba9-56d0-4bb0-9acd-dd313a2c5c0e tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.355242 Mar 29 02:11:24.840284 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 364/712] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:24 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:24.845215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d33deec5-38b0-425c-a3a2-5b25869b332d tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Calling method '.version_select at 0x7f8724b0c1f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:24.996479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-d33deec5-38b0-425c-a3a2-5b25869b332d tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:11:24.999732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d33deec5-38b0-425c-a3a2-5b25869b332d tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] HTTP exception thrown: Insufficient rights for removing default security group. Mar 29 02:11:24.999732 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1c14706d-7581-4f29-963b-78922a8bdac7'] Mar 29 02:11:24.999732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d33deec5-38b0-425c-a3a2-5b25869b332d tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Returning 400 to user: Insufficient rights for removing default security group. Mar 29 02:11:24.999732 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1c14706d-7581-4f29-963b-78922a8bdac7'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:24.999732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d33deec5-38b0-425c-a3a2-5b25869b332d tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/92e1ba44-9329-490e-93ff-dacf0b166999" status: 400 len: 182 microversion: 2.1 time: 0.157341 Mar 29 02:11:25.008849 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 365/713] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:11:24 2022] DELETE /compute/v2.1/os-security-groups/92e1ba44-9329-490e-93ff-dacf0b166999 => generated 182 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:11:25.015185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.015795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:25.034029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.034029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.034029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.034434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.204908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:25.216299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4821cdcd-c879-4657-918a-bd875f7c63c3 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1275 microversion: 2.1 time: 0.205846 Mar 29 02:11:25.217627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 366/714] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:25.222814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Calling method '.version_select at 0x7f8724d218b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.251195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:11:25.251806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Neutron security group 038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:11:25.252342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] HTTP exception thrown: Security group 038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663 does not exist Mar 29 02:11:25.252342 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-62aeffc1-9c2f-445f-bcac-a696748ed634'] Mar 29 02:11:25.252960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Returning 404 to user: Security group 038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663 does not exist Mar 29 02:11:25.252960 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-62aeffc1-9c2f-445f-bcac-a696748ed634'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:25.253781 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-816ef981-d9eb-448d-a5de-1af9634454ce tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663" status: 404 len: 194 microversion: 2.1 time: 0.034914 Mar 29 02:11:25.258925 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 367/715] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/os-security-groups/038fe1e4-bb8b-45c9-8dc6-d43a6c8ba663 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:25.262863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.263623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:25.273859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.274775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.275802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.276589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.423673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:25.435217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:25.436897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:25.442453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2808350b-4f44-4971-9a6e-4d7951d7685e tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.186723 Mar 29 02:11:25.448808 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 368/716] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:25.448808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82469d87-0c14-460b-a076-6e360fad031f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e8af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.514987 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82469d87-0c14-460b-a076-6e360fad031f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.064863 Mar 29 02:11:25.514987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 369/717] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:25.515670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Action: 'update', calling method: .version_select at 0x7f8724b0c820>, body: {"security_group": {"name": "tempest-sg-1777420930", "description": "tempest-description-1203632936"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:25.551105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:11:25.551922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Neutron security group 5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:11:25.552608 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] HTTP exception thrown: Security group 5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52 does not exist Mar 29 02:11:25.552608 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-9ff30a08-ea42-4910-8376-f0296ecd9913'] Mar 29 02:11:25.553996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] Returning 404 to user: Security group 5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52 does not exist Mar 29 02:11:25.553996 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-9ff30a08-ea42-4910-8376-f0296ecd9913'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:25.556394 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bede934c-0f67-4cbc-8d31-3f6ba1db18f5 tempest-SecurityGroupsNegativeTestJSON-456752524 tempest-SecurityGroupsNegativeTestJSON-456752524-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52" status: 404 len: 194 microversion: 2.1 time: 0.044991 Mar 29 02:11:25.560331 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 370/718] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Mar 29 02:11:25 2022] PUT /compute/v2.1/os-security-groups/5c2ebcb4-9f1a-4e66-85af-39dd4cb3ed52 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:25.571413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.572067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:25.581191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.581643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.583235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.583235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.883384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:25.904209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-98128b96-3050-46c4-a891-de8634d0ab95 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1270 microversion: 2.1 time: 0.341839 Mar 29 02:11:25.905181 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 371/719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1270 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:25.921055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:25.921897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:25.932025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.932478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:25.933294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:25.933736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:26.168316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:26.168316 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b31d8f77-e42a-4c87-a417-c909f0d1b93d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.250544 Mar 29 02:11:26.168316 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 372/720] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:25 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:26.235610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:26.236214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:26.244165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:26.244608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:26.245395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:26.245829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:26.361344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:26.369399 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3505f934-b3d9-4495-9d5d-5a1eef40792c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1275 microversion: 2.1 time: 0.137250 Mar 29 02:11:26.372196 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 373/721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:26 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1275 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:26.474737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:26.476661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:26.485171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:26.485710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:26.486585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:26.487090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:26.866743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:26.883871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:26.885441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:26.901851 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed604e33-3596-43b5-8cb9-5b9f67789cb1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.431753 Mar 29 02:11:26.903241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 374/722] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:26 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:26.907734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0dbbf50-b64f-44b6-a9a3-6eb72c14d6da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724245700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:26.980004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0dbbf50-b64f-44b6-a9a3-6eb72c14d6da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.075513 Mar 29 02:11:26.980616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 375/723] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:26 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:26.989120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:26.989743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:27.003952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.004750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.006473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.023869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.038249 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bbbd7907-034f-428f-bed0-8286b2535ebf tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/action" status: 202 len: 0 microversion: 2.25 time: 5.092212 Mar 29 02:11:27.039210 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 349/724] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:11:21 2022] POST /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/action => generated 0 bytes in 5094 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:27.046823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:27.047426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:27.068817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.072102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.073399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.073988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.502810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:27.502810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b8c37358-f8cd-4072-9b29-fd5a1ae29307 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1270 microversion: 2.1 time: 0.515382 Mar 29 02:11:27.502810 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 376/725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:26 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1270 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:27.515295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:27.520050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:27.532964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.537458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.538893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.539456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.860938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:27.872812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-278d700c-5e62-4c76-a227-2a340c854b6a tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 0.370395 Mar 29 02:11:27.884005 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 377/726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:27 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:27.889701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:27.890553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:27.906069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.906874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:27.907876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:27.908534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.007488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.034890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.037555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.040441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae06ebdf-ff08-4257-af5d-c63a28b61942 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.997177 Mar 29 02:11:28.051257 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 350/727] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:27 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:11:28.056976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1dd78dc3-44dd-49e7-8eda-9186d523957a req-24218165-01ed-4dcc-b84c-63f9c857058e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b3ac2-c37f-4bd5-9486-18f89a6352e7", "name": "network-vif-plugged", "status": "completed", "tag": "1fb147f0-7e62-463b-adfc-d2f67cafa0fd"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:28.075736 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:28.075736 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:28.098320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1dd78dc3-44dd-49e7-8eda-9186d523957a req-24218165-01ed-4dcc-b84c-63f9c857058e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.099159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1dd78dc3-44dd-49e7-8eda-9186d523957a req-24218165-01ed-4dcc-b84c-63f9c857058e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.139460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1dd78dc3-44dd-49e7-8eda-9186d523957a req-24218165-01ed-4dcc-b84c-63f9c857058e service nova] Creating event network-vif-plugged:1fb147f0-7e62-463b-adfc-d2f67cafa0fd for instance 843b3ac2-c37f-4bd5-9486-18f89a6352e7 on n-h1-828148-1 Mar 29 02:11:28.150828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1dd78dc3-44dd-49e7-8eda-9186d523957a req-24218165-01ed-4dcc-b84c-63f9c857058e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097275 Mar 29 02:11:28.151364 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 351/728] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:28.173067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:28.173799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:28.204310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.209121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.212603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.219175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.249970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.265104 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b309ba0d-5033-4d18-ac3f-2fb4a61b7776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.379489 Mar 29 02:11:28.268408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 378/729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:27 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:28.274775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f45db16-e364-438a-9535-c1eacce3b310 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8725f05ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:28.336241 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f45db16-e364-438a-9535-c1eacce3b310 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.066493 Mar 29 02:11:28.337793 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 379/730] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:28 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:28.516431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:28.517518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:28.529857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.531317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.532453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.533167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.679943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.699612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.702584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.716090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5ad0e8f-9733-438e-b545-c0c490d9699d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.553854 Mar 29 02:11:28.732679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 352/731] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:28 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:28.823233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:28.832471 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-023a77e1-4155-4891-8b50-75eeaa4d148e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.321781 Mar 29 02:11:28.833855 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 380/732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:28 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:28.889856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:28.890692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:28.901713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.902548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:28.903515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:28.904128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.067305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:29.067912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:29.076147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.076922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.077939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.078587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.357709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:29.373858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:29.383753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:29.387597 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f12b0d9c-70e9-4d7f-a9bc-bc3de500c71e tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.323214 Mar 29 02:11:29.390922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 381/733] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:29 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:29.405182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:29.406403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:29.423398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.425334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.429069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.429069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.719237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:29.730008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-449b6c5a-c5da-41ae-929a-8f007bf16065 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.337703 Mar 29 02:11:29.739591 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 382/734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:29 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:29.748180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34f1d007-fc5b-4dda-adba-7076d34d15e6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e8af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:29.844219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34f1d007-fc5b-4dda-adba-7076d34d15e6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.101628 Mar 29 02:11:29.849163 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 383/735] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:29 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:29.855872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:29.856497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:29.877117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.877575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:29.878365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:29.878804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.066165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:30.082857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:30.091250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:30.108595 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a30e4731-8529-4e29-86a2-54b24eec3d56 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.254507 Mar 29 02:11:30.109587 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 384/736] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:29 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:30.121378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:30.128367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:30.143606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.144659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.145515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.145943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.253309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:30.264109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c218968-9e8a-416f-9c33-af6e02682530 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1313 microversion: 2.1 time: 1.377930 Mar 29 02:11:30.266263 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 353/737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:28 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1313 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:30.408550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:30.409980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:30.428288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.428806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.432247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.434141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.558750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:30.567758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cec39bea-fa2b-4b41-80e4-1c64cedba982 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.455084 Mar 29 02:11:30.568600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 385/738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:30 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:30.747843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:30.748467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:30.758976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.759446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:30.767354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:30.767910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.222229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:31.235336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3654ac99-c3f0-4872-8b57-e3e2751b3d5a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.490910 Mar 29 02:11:31.243943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 386/739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:30 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:31.265887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-531897ca-e749-4742-9b9c-5f8d042ff899 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f872427fc10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:31.367742 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-531897ca-e749-4742-9b9c-5f8d042ff899 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.116279 Mar 29 02:11:31.374172 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 387/740] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:31 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:31.384100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f07cc4cb-d5a0-4c14-9534-87eaa405d2bb req-34f5c55e-cba5-403a-8925-3b178e88429d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:31.406221 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:31.406221 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:31.431280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f07cc4cb-d5a0-4c14-9534-87eaa405d2bb req-34f5c55e-cba5-403a-8925-3b178e88429d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:31.431624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f07cc4cb-d5a0-4c14-9534-87eaa405d2bb req-34f5c55e-cba5-403a-8925-3b178e88429d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.472861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:31.479619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f07cc4cb-d5a0-4c14-9534-87eaa405d2bb req-34f5c55e-cba5-403a-8925-3b178e88429d service nova] Creating event network-changed:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:11:31.492895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:31.494687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:31.498756 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f07cc4cb-d5a0-4c14-9534-87eaa405d2bb req-34f5c55e-cba5-403a-8925-3b178e88429d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123161 Mar 29 02:11:31.499388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 388/741] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:31.500928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4c5e0ac-4567-4237-99c0-8275c5d0850f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 1.095940 Mar 29 02:11:31.511999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 354/742] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:30 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:31.520905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:31.520905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:31.521655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:31.521655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:31.544982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:31.555471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.555471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:31.555471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.555821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:31.555821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.561889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:31.567559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:31.988320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.005981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.014091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.025415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03d76bf3-54da-4d01-8715-9149d1b8b9b6 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.524475 Mar 29 02:11:32.027820 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 389/743] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:31 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:32.037058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.037794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:32.082364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.082925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.083925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.084438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.167566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.178618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ada05b0d-652b-40c1-b12a-165084adbc0f tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1463 microversion: 2.1 time: 0.665385 Mar 29 02:11:32.179960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 355/744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:31 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1463 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:32.316479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.325619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cb6f24d8-3a7d-4a7d-90ca-e013dc839da8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.296569 Mar 29 02:11:32.332729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 390/745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:32.339930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.340914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:32.349415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.350114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.351625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.352212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.473561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Calling method '.version_select at 0x7f8724344160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.473561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.473561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.483036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.483493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.499785 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae4b9e0c-2a82-4e5c-b6b1-5ff31aeb16ad tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/24e6cf8d5000445e8b3b561c84b64de0?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631" status: 200 len: 695 microversion: 2.1 time: 0.301579 Mar 29 02:11:32.500356 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 356/746] 10.222.0.36 () {58 vars in 1411 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/os-simple-tenant-usage/24e6cf8d5000445e8b3b561c84b64de0?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631 => generated 695 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:32.504817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eefbd52e-9c8a-429e-b025-6a0b574d7521 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717e94160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.573199 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eefbd52e-9c8a-429e-b025-6a0b574d7521 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.071501 Mar 29 02:11:32.574139 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 357/747] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:32.578942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '.version_select at 0x7f8724d1b550>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.588206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.589023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.666195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.669342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.675066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:32.690219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a75abf5e-3846-4043-970d-eedf87fe6f4d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.362845 Mar 29 02:11:32.692792 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 391/748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:32.704992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.707998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:32.739601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f08fe8e-0a31-4aa5-8a1b-6420c1f04f93 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage/24e6cf8d5000445e8b3b561c84b64de0?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631" status: 200 len: 698 microversion: 2.1 time: 0.164014 Mar 29 02:11:32.740436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.740923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.741776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.742214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.744425 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 358/749] 10.222.0.36 () {58 vars in 1411 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/os-simple-tenant-usage/24e6cf8d5000445e8b3b561c84b64de0?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631 => generated 698 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:32.768617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Calling method '.version_select at 0x7f8717e8bdc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.771728 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-simple-tenant-usage:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:32.771728 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:32.790808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.794476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.840376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.840861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.926818 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72de270d-d84d-44c9-8f4e-c76ad0a7ec38 tempest-TenantUsagesTestJSON-2065913345 tempest-TenantUsagesTestJSON-2065913345-project-admin] 10.222.0.36 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631&detailed=1" status: 200 len: 8508 microversion: 2.1 time: 0.174010 Mar 29 02:11:32.939342 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 359/750] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-03-28T02%3A11%3A32.189631&end=2022-03-30T02%3A11%3A32.189631&detailed=1 => generated 8508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:32.965906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:32.965906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:32.987621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.992519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:32.996350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:32.999443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.143414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:11:33.487079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.499629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.502240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.507542 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e3ba3d5-bf5c-4fe5-90c9-028ffb87c8d5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.813428 Mar 29 02:11:33.518722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 392/751] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:32 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:33.523579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:33.524196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:33.533172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.533832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.535103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.535764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.621880 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-524e91e8-02aa-4ad6-9af2-ac3a06badd3d tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "DELETE /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 204 len: 0 microversion: 2.1 time: 0.663427 Mar 29 02:11:33.625171 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 360/752] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:11:32 2022] DELETE /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:11:33.663697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:33.663697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:33.663697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.663697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.664755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.664755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.728317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.738861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.740416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:33.749226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ee2eaf0-f545-4ba9-bcd3-ae1edbe726a1 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.229249 Mar 29 02:11:33.751202 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 393/753] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:33 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:33.756655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a9f67672-5d03-4165-b4f9-86c2c3dec117 req-91924a9b-6fda-4b22-94ff-c1fd96422545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:33.758751 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:33.758751 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:33.770800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a9f67672-5d03-4165-b4f9-86c2c3dec117 req-91924a9b-6fda-4b22-94ff-c1fd96422545 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.771519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a9f67672-5d03-4165-b4f9-86c2c3dec117 req-91924a9b-6fda-4b22-94ff-c1fd96422545 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.793312 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a9f67672-5d03-4165-b4f9-86c2c3dec117 req-91924a9b-6fda-4b22-94ff-c1fd96422545 service nova] Creating event network-changed:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h1-828148-1 Mar 29 02:11:33.799613 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a9f67672-5d03-4165-b4f9-86c2c3dec117 req-91924a9b-6fda-4b22-94ff-c1fd96422545 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046988 Mar 29 02:11:33.800765 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 394/754] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:33.808379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-627af3bf-ea64-4ce8-8d3a-1ec18e591460 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b0cb80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:33.868415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-627af3bf-ea64-4ce8-8d3a-1ec18e591460 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1412 microversion: 2.1 time: 0.066096 Mar 29 02:11:33.869197 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 395/755] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:33 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1412 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:33.882222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:33.882222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:33.889180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.889640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:33.890434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:33.890870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.191346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:34.204756 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f191414b-5cc1-4258-972a-97dce969fe9b tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1469 microversion: 2.1 time: 0.334406 Mar 29 02:11:34.211185 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 396/756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:33 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:34.221873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:34.222811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:34.231024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.236748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.236748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.236748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.733611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:34.746412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ee2a85a-c00c-4b21-8bf1-bf2ed8d263c9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 1.117677 Mar 29 02:11:34.748395 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 361/757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:33 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:34.755240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:34.756159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:34.769408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.771358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.771358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.772114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.901447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:34.914360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-802ed432-e0b2-4fe7-8fee-c8c0d4f11884 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.700387 Mar 29 02:11:34.916059 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 397/758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:34 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:34.926033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:34.926033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:34.933201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.933894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:34.935010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:34.935610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:35.057821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.080948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.083105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.089403 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8970ef4c-afd7-4126-8fc9-70d418fdef0f tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.171025 Mar 29 02:11:35.090942 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 398/759] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:34 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:35.095808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b9f150c-ea3c-4f03-93e2-d038ad9b27de tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e8550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:35.180198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b9f150c-ea3c-4f03-93e2-d038ad9b27de tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1421 microversion: 2.1 time: 0.087914 Mar 29 02:11:35.181081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 399/760] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:35 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1421 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:35.193137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c61aad45-c528-4f91-aca7-81df037e5c65 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b0c670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:35.265884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c61aad45-c528-4f91-aca7-81df037e5c65 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 200 len: 1421 microversion: 2.1 time: 0.076358 Mar 29 02:11:35.267188 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 400/761] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:35 2022] GET /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 1421 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:35.281793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:35.283672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:35.301891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.303357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:35.303940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:35.304738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:35.305193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:35.312225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.313732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.318517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84bb364f-d474-4637-9784-1685bff75299 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.564980 Mar 29 02:11:35.318517 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 362/762] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:34 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:35.320339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-425d76a1-6f9f-410e-b077-7279e33ec6b6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87240d5430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:35.719208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:35.730717 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aef66183-1e27-4438-8a19-7f44a9a092a9 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1469 microversion: 2.1 time: 0.453969 Mar 29 02:11:35.731856 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 401/763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:35 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:35.763669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:35.763986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:35.771878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:35.772325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:35.773497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:35.773704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.005285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:36.014150 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2a2ca9f-b5a9-4360-aa86-2df2eb6c1d9e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.254512 Mar 29 02:11:36.024135 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 402/764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:35 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:36.029107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:36.030027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:36.040110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.040556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.042127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.042585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.623630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:36.634852 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae377ded-a5b7-4eaf-97f1-a955218d9673 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.609235 Mar 29 02:11:36.639547 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 403/765] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:36 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:36.650258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:36.651000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:36.666183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.671578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.672550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.673093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.908185 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-425d76a1-6f9f-410e-b077-7279e33ec6b6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 204 len: 0 microversion: 2.1 time: 1.591379 Mar 29 02:11:36.908903 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 363/766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:35 2022] DELETE /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 0 bytes in 1593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:36.913408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:36.914006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:36.921572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.922028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.922809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.923243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.935903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:36.947197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:36.952622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:36.954795 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-232ed465-5a8b-4837-a532-0967d028f725 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1447 microversion: 2.75 time: 0.314117 Mar 29 02:11:36.955888 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 404/767] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:36 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1447 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:36.960469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:36.961295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:36.968959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.969716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:36.970639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:36.971458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.147663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40022d2480a041d597d9bb84078927a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24e6cf8d5000445e8b3b561c84b64de0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:37.176027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02e47fe1-ea2e-409e-9539-9aaa2b806e43 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 200 len: 1427 microversion: 2.1 time: 0.218827 Mar 29 02:11:37.177304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 405/768] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:36 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 1427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:37.182321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ef4eb06c-6622-460c-ac89-51b1d2a33afc req-c8ec91c4-28fb-4a86-b76d-37c767f89228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b3ac2-c37f-4bd5-9486-18f89a6352e7", "name": "network-vif-deleted", "tag": "1fb147f0-7e62-463b-adfc-d2f67cafa0fd"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:37.191194 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:37.191194 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:37.209699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ef4eb06c-6622-460c-ac89-51b1d2a33afc req-c8ec91c4-28fb-4a86-b76d-37c767f89228 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.213323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ef4eb06c-6622-460c-ac89-51b1d2a33afc req-c8ec91c4-28fb-4a86-b76d-37c767f89228 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.216306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:37.226930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:37.228754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:37.230179 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f580dd0-8864-498b-8227-465f305a65b6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.320442 Mar 29 02:11:37.230930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 364/769] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:36 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:37.236748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:37.237481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:37.245993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.246701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.247654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.248314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.254686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ef4eb06c-6622-460c-ac89-51b1d2a33afc req-c8ec91c4-28fb-4a86-b76d-37c767f89228 service nova] Creating event network-vif-deleted:1fb147f0-7e62-463b-adfc-d2f67cafa0fd for instance 843b3ac2-c37f-4bd5-9486-18f89a6352e7 on n-h1-828148-1 Mar 29 02:11:37.267489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ef4eb06c-6622-460c-ac89-51b1d2a33afc req-c8ec91c4-28fb-4a86-b76d-37c767f89228 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088118 Mar 29 02:11:37.268805 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 406/770] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:37.278992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:37.279809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:37.289554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.290143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.292523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.293370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.322512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:11:37.700847 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0886f02c-33d8-4377-a993-1086420932d3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 204 len: 0 microversion: 2.1 time: 0.468291 Mar 29 02:11:37.701445 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 365/771] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:11:37 2022] DELETE /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:37.706714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:37.709622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:37.718171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.718928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.719834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:37.720384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:37.839707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:37.850261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-745584b3-2ec4-40c0-8f0a-ffd7b8bf8609 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.575631 Mar 29 02:11:37.851400 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 407/772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:37 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:37.903358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1130106598", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "f0bf6988-5c26-404c-85f6-c1676da0daf5"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:38.003915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] validate_networks() for [('f0bf6988-5c26-404c-85f6-c1676da0daf5', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:38.274543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:38.284103 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4dde942d-4e15-4430-ab89-bc636bc4ebd0 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.581044 Mar 29 02:11:38.284688 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 366/773] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:37 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:38.289389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:38.289991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:38.297880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.298218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.299003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.299517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.448862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:38.459756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:38.461514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:38.466954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-79121fa7-5364-44db-862b-5ad4c19a61ee tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1465 microversion: 2.75 time: 0.180981 Mar 29 02:11:38.467993 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 367/774] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:38 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1465 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:38.472451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:38.473278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] [instance: 843b3ac2-c37f-4bd5-9486-18f89a6352e7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:38.480354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.485129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.485129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.485129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.534290 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] HTTP exception thrown: Instance 843b3ac2-c37f-4bd5-9486-18f89a6352e7 could not be found. Mar 29 02:11:38.535146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] Returning 404 to user: Instance 843b3ac2-c37f-4bd5-9486-18f89a6352e7 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:11:38.536124 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e8f8075-9cac-4159-97aa-c415cef0d254 tempest-TenantUsagesTestJSON-1659812821 tempest-TenantUsagesTestJSON-1659812821-project] 10.222.0.36 "GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7" status: 404 len: 111 microversion: 2.1 time: 0.067066 Mar 29 02:11:38.537163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 368/775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:38 2022] GET /compute/v2.1/servers/843b3ac2-c37f-4bd5-9486-18f89a6352e7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:11:38.542734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:38.543615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:38.551495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.556208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.556208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.556208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.873643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:38.874124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:38.874889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:38.875300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:38.876145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:38.885142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.885587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.886594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:38.887062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:38.908641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:38.915296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for user 530e622216e14b4daae0ea35922590c9 and project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:38.940378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:38.941610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:39.095524 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7218d730-4460-409d-a729-2323dbac5101 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191509 Mar 29 02:11:39.098698 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 408/776] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:11:39.106409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:39.109234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:39.125047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.126177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.127064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.128037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.159325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.180972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.188241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.192070 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e91761d-072f-476a-b5e8-610bd1ec3dfb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.651125 Mar 29 02:11:39.203070 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 369/777] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:38 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:39.204574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a2523ff-7494-44e9-9fed-e919c80a6de8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:39.205236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a2523ff-7494-44e9-9fed-e919c80a6de8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:39.386450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a2523ff-7494-44e9-9fed-e919c80a6de8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.394148 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a2523ff-7494-44e9-9fed-e919c80a6de8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1208 microversion: 2.1 time: 0.198115 Mar 29 02:11:39.403493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 370/778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:39 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1208 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:39.407176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:39.409502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:39.435258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.447845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.447845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.447845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.498250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.507970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b136fcaf-f104-42e9-9d88-7873ebefdede tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.410472 Mar 29 02:11:39.517099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 409/779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:39 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:39.521627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:39.522252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:39.539918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.549614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.550698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.551472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:39.902899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.914615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.920185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:39.931560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ac3596d-99d9-4891-b2df-49d715d828a3 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1453 microversion: 2.75 time: 0.421904 Mar 29 02:11:39.945029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 410/780] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:39 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1453 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:39.977088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-11e17aa7-d50c-4e60-aaed-5b0fc74af57c req-7bba5b4d-1820-4d6a-ac98-9d431165b3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b65e2-c37b-434a-8d78-1ebae6ffca02", "name": "network-vif-unplugged", "status": "completed", "tag": "1599bc25-908e-448d-84dd-83016b587979"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:39.979144 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:39.979144 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:39.991253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-11e17aa7-d50c-4e60-aaed-5b0fc74af57c req-7bba5b4d-1820-4d6a-ac98-9d431165b3fd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:39.991789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-11e17aa7-d50c-4e60-aaed-5b0fc74af57c req-7bba5b4d-1820-4d6a-ac98-9d431165b3fd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.009836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-11e17aa7-d50c-4e60-aaed-5b0fc74af57c req-7bba5b4d-1820-4d6a-ac98-9d431165b3fd service nova] Creating event network-vif-unplugged:1599bc25-908e-448d-84dd-83016b587979 for instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 on n-h2-828148-1 Mar 29 02:11:40.023599 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-11e17aa7-d50c-4e60-aaed-5b0fc74af57c req-7bba5b4d-1820-4d6a-ac98-9d431165b3fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049810 Mar 29 02:11:40.024426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 411/781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:40.142859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:40.151930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24788abc-298d-4a3d-9444-3b6a227d906b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.752708 Mar 29 02:11:40.161853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 371/782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:39 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:40.212281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:40.213551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:40.236441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.237039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.237851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.239220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.410747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:40.411558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:40.424179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.428671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.429724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.430322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.550575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:40.563938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:40.570046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:40.570574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-605bd785-b0f6-4ec6-9678-c60633162cd8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.363298 Mar 29 02:11:40.571939 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 412/783] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:40 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:40.576728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:40.579269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:40.589377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.590187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.591245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.591886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.850025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:40.866429 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5cf0957-fadd-41ac-881b-093081c882a2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.293021 Mar 29 02:11:40.876526 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 413/784] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:40 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:40.954029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:40.954870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:40.965106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.965851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:40.966632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:40.967083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.017788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:41.028918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-65d68a65-f442-4aac-8e96-1632a9b2e47a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1212 microversion: 2.1 time: 0.621763 Mar 29 02:11:41.034747 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 372/785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:40 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1212 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:41.151701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:41.165137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:41.170135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:41.170752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:41.179217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:41.183654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.184101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.184896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.185322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.188969 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-834b94c2-7232-43fd-b021-edb2320b456d tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1453 microversion: 2.75 time: 0.239047 Mar 29 02:11:41.203057 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 414/786] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:40 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1453 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:11:41.524885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:41.557085 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-14c5725f-89b9-4df3-a9d3-dbb65f279281 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 0.390615 Mar 29 02:11:41.570818 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 373/787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:41 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:41.590604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:41.591576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:41.599305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.600087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.601705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.602354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.766516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c171ca71-e460-42e3-ae16-7866868a262d req-3f9ab646-b0aa-4531-a17a-f85b69c841da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b65e2-c37b-434a-8d78-1ebae6ffca02", "name": "network-vif-deleted", "tag": "1599bc25-908e-448d-84dd-83016b587979"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:41.775969 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:41.775969 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:41.788733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c171ca71-e460-42e3-ae16-7866868a262d req-3f9ab646-b0aa-4531-a17a-f85b69c841da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.789624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c171ca71-e460-42e3-ae16-7866868a262d req-3f9ab646-b0aa-4531-a17a-f85b69c841da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.842108 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c171ca71-e460-42e3-ae16-7866868a262d req-3f9ab646-b0aa-4531-a17a-f85b69c841da service nova] Creating event network-vif-deleted:1599bc25-908e-448d-84dd-83016b587979 for instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 on n-h2-828148-1 Mar 29 02:11:41.848065 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c171ca71-e460-42e3-ae16-7866868a262d req-3f9ab646-b0aa-4531-a17a-f85b69c841da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105467 Mar 29 02:11:41.849771 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 374/788] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:11:41.893682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:41.895069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:41.905877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.908087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:41.909404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:41.910189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.223559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.249120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.251919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.254324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a0ef26c-2b5e-438c-9774-33a1883c7333 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.667068 Mar 29 02:11:42.256687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 415/789] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:41 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:42.275394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:42.276475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:42.286383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.287152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.289554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.289554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.384967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.400129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7c7262c9-440f-43cf-8e4b-5ce4ba844476 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.508830 Mar 29 02:11:42.414118 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 375/790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:41 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:11:42.426156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0fa214c1-5f48-4442-8409-f6e8109b62da req-4529aaf9-abd3-4c81-8336-0b9875be1c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-plugged", "status": "completed", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:42.430940 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:42.430940 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:42.443447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0fa214c1-5f48-4442-8409-f6e8109b62da req-4529aaf9-abd3-4c81-8336-0b9875be1c53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.444970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0fa214c1-5f48-4442-8409-f6e8109b62da req-4529aaf9-abd3-4c81-8336-0b9875be1c53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.464639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0fa214c1-5f48-4442-8409-f6e8109b62da req-4529aaf9-abd3-4c81-8336-0b9875be1c53 service nova] Creating event network-vif-plugged:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:11:42.471776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0fa214c1-5f48-4442-8409-f6e8109b62da req-4529aaf9-abd3-4c81-8336-0b9875be1c53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055038 Mar 29 02:11:42.474748 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 376/791] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:42.489049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:42.490160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:42.509489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.510369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.511501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.514380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.616009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.655989 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81411c2f-7382-4a04-8b24-15511a27a1a1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1268 microversion: 2.1 time: 0.395674 Mar 29 02:11:42.661017 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 416/792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:42 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1268 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:42.671487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:42.679920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:42.702944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.703403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.712504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.713201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:42.894316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.911863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.917251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:42.935656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e0dc1aa-7c9a-41f0-9434-eb873cd09f15 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1438 microversion: 2.75 time: 0.456744 Mar 29 02:11:42.937170 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 377/793] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:42 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1438 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:42.945418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-58a1f880-4881-43fe-a331-a14662d9f4a6 req-86ce6d8e-aa4d-4e01-b268-6c33c05636df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314c9d8f-a6a4-4bc1-bcc4-9a48b6235598", "name": "network-vif-unplugged", "status": "completed", "tag": "3f5634f6-fe04-45d7-b5ec-b32dc63c8872"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:42.947791 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:42.947791 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:42.970780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-58a1f880-4881-43fe-a331-a14662d9f4a6 req-86ce6d8e-aa4d-4e01-b268-6c33c05636df service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:42.971262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-58a1f880-4881-43fe-a331-a14662d9f4a6 req-86ce6d8e-aa4d-4e01-b268-6c33c05636df service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:43.027631 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-58a1f880-4881-43fe-a331-a14662d9f4a6 req-86ce6d8e-aa4d-4e01-b268-6c33c05636df service nova] Creating event network-vif-unplugged:3f5634f6-fe04-45d7-b5ec-b32dc63c8872 for instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 on n-h1-828148-1 Mar 29 02:11:43.042184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-58a1f880-4881-43fe-a331-a14662d9f4a6 req-86ce6d8e-aa4d-4e01-b268-6c33c05636df service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102352 Mar 29 02:11:43.054183 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 378/794] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:43.613870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:43.615927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:43.632685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:43.637209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:43.638519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:43.639194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:43.882110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:43.882533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:43.883010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:43.883423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:43.889346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:43.956518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:43.980092 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b062a10-d3bc-46b5-b352-005ab5ff78e2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1317 microversion: 2.1 time: 1.315686 Mar 29 02:11:43.983474 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 417/795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:42 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1317 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:44.009422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:44.010404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:44.036430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.040693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:44.041985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.042440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:44.269874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:44.289745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.290103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:44.290961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.293119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:44.634211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:44.835656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d810f883-0cb2-4871-9fd4-7091bc0c4f6d tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084/action" status: 202 len: 1942 microversion: 2.75 time: 1.787745 Mar 29 02:11:44.836628 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 379/796] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:11:43 2022] POST /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084/action => generated 1942 bytes in 1792 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 29 02:11:44.847699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:44.848315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:44.888681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.888915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:44.889823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:44.890274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:45.387875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:45.405582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:45.409001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:45.410601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01112dd2-36da-46ad-96a5-644ee6872865 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 1.425138 Mar 29 02:11:45.438392 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 418/797] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:43 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:45.444811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:45.445669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:45.457453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:45.458248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:45.459233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:45.460085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:45.902629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:45.913203 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43f50810-2f01-493d-bd47-506534d2bb69 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 1.073117 Mar 29 02:11:45.913819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 380/798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:44 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:45.939031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ec0b53f3-e392-4aa2-bd4a-77074fbcf8cb req-3cb62eb6-bc22-4257-ab95-6ff898c3eacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "name": "network-vif-plugged", "status": "completed", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:45.940901 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:45.940901 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:45.962269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ec0b53f3-e392-4aa2-bd4a-77074fbcf8cb req-3cb62eb6-bc22-4257-ab95-6ff898c3eacb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:45.963227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ec0b53f3-e392-4aa2-bd4a-77074fbcf8cb req-3cb62eb6-bc22-4257-ab95-6ff898c3eacb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:45.989192 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ec0b53f3-e392-4aa2-bd4a-77074fbcf8cb req-3cb62eb6-bc22-4257-ab95-6ff898c3eacb service nova] Creating event network-vif-plugged:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h1-828148-1 Mar 29 02:11:45.997551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ec0b53f3-e392-4aa2-bd4a-77074fbcf8cb req-3cb62eb6-bc22-4257-ab95-6ff898c3eacb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081696 Mar 29 02:11:45.998789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 381/799] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:46.004185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:46.004906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:46.009973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:46.017020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.017362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.018376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.019004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.024644 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51e50727-e041-4fce-8d23-4ea5428113f9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 0.583737 Mar 29 02:11:46.028529 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 419/800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:45 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:46.041855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:46.043338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:46.053672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.054260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.055222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.055731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.330505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:46.397511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:46.408293 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e6fbb35-96df-4ecf-be92-8f4cc186f36d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1467 microversion: 2.1 time: 0.377955 Mar 29 02:11:46.409263 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 420/801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:46 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1467 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:46.418809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f69d346f-119d-447f-a713-fe97ce5279f0 req-e1eb1d75-bdb4-46ae-85e3-ccf91e9656ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "314c9d8f-a6a4-4bc1-bcc4-9a48b6235598", "tag": "3f5634f6-fe04-45d7-b5ec-b32dc63c8872"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:46.421041 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:46.421041 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:46.442837 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d473acd9-c6cc-4673-a054-e62270f0cea2 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.442825 Mar 29 02:11:46.455779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 382/802] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:45 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:46.458628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f69d346f-119d-447f-a713-fe97ce5279f0 req-e1eb1d75-bdb4-46ae-85e3-ccf91e9656ec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.459108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f69d346f-119d-447f-a713-fe97ce5279f0 req-e1eb1d75-bdb4-46ae-85e3-ccf91e9656ec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.501478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f69d346f-119d-447f-a713-fe97ce5279f0 req-e1eb1d75-bdb4-46ae-85e3-ccf91e9656ec service nova] Creating event network-changed:3f5634f6-fe04-45d7-b5ec-b32dc63c8872 for instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 on n-h1-828148-1 Mar 29 02:11:46.514924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f69d346f-119d-447f-a713-fe97ce5279f0 req-e1eb1d75-bdb4-46ae-85e3-ccf91e9656ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103400 Mar 29 02:11:46.515870 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 421/803] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:46.528582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-886121464", "metadata": {"image_type": "test"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:46.542372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:46.564709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.565193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.565980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:46.566411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:46.590237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Action: 'create', calling method: .version_select at 0x7f87242e9550>, body: {"keypair": {"name": "tempest-keypair-1289320101"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:46.616607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for project 49c2cea4684f4d06830d9a5464950077. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:46.622864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for user be981c23208b4fa09861adce9c9ef458 and project 49c2cea4684f4d06830d9a5464950077. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:46.785242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Getting quotas for project 227324fd625649afb3baa16a37f3b4ee. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:46.800118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Getting quotas for user 7e9dae8006744e15b9529cbda35d9742 and project 227324fd625649afb3baa16a37f3b4ee. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:47.019736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for project 49c2cea4684f4d06830d9a5464950077. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:47.028424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for user be981c23208b4fa09861adce9c9ef458 and project 49c2cea4684f4d06830d9a5464950077. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:47.046272 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa587a7d-961b-4e20-aeb3-20e87cdef77a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.600700 Mar 29 02:11:47.047458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 383/804] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:11:46 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:47.054245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:47.055081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:47.064370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.065041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.065966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.066592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.395576 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2fda6949-7c3d-4d34-89ca-c6118773c881 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "POST /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b/action" status: 202 len: 0 microversion: 2.1 time: 0.878349 Mar 29 02:11:47.396611 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 422/805] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:11:46 2022] POST /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:11:47.412465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:47.413996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:47.422276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.423583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.425412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.425412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.824701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:47.837914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f7ebbe1-6192-452a-9caf-aac2ef3e8dd0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.439678 Mar 29 02:11:47.841731 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 423/806] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:47 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:47.852543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:47.856366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:47.871836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.872196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.872999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:47.873427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:47.879190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:47.898516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:47.900163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:47.911779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c50d37c8-d1a3-4a39-bbe2-6b24d879fca2 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.862616 Mar 29 02:11:47.917116 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 384/807] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:47 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:47.929535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4165ef0d-8f8c-48b1-9438-46ae35aa8b8f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e8b940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:48.046865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4165ef0d-8f8c-48b1-9438-46ae35aa8b8f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.128575 Mar 29 02:11:48.052938 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 385/808] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:47 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:48.058095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:48.058733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:48.076192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:48.084275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:48.085735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:48.086190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:48.391701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:48.401494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0281778d-d473-455e-aaf1-46a330c41bc3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 0.558432 Mar 29 02:11:48.402065 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 424/809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:47 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:48.504814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-805901749", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "485d325a-bc41-4095-b60e-02a724f93cc5"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:48.581103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] validate_networks() for [('485d325a-bc41-4095-b60e-02a724f93cc5', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:48.751608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:48.855550 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d7ea5e3-fde3-4d21-952c-01342a9cb5b1 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.801123 Mar 29 02:11:48.857099 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 386/810] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:48 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:48.879608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:48.881905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:48.890087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:48.890956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:48.891922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:48.892527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:49.533374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:49.533928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:49.534503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:49.535014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:49.535497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:49.545292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:49.546024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:49.547024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:49.547654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:49.567625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Getting quotas for project 0273fd4bb30f4e4799f3d95f575d2e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:49.574312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Getting quotas for user 62774a07593a48118dca823e480d5ca9 and project 0273fd4bb30f4e4799f3d95f575d2e9e. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:49.587031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Going to run 3 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:49.589907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:49.690491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:49.691599 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb442876-46af-42c4-9988-d1c706036272 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1312 microversion: 2.1 time: 0.833047 Mar 29 02:11:49.692176 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 387/811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:48 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1312 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:49.701050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:49.701942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:49.723899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:49.724677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:49.725715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:49.726333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:49.753052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:49.984605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=359583e9-8ed5-4f16-a82e-4bc1b6c6cac3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:50.040755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:50.051405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:50.053914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:50.055615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa0e91e2-9d91-4cf0-88a5-c126c0f1bcf8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.361804 Mar 29 02:11:50.067083 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 388/812] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:49 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:50.072372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37bf29e9-e6c1-4455-8cf1-f6628b00c1dd tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e8bee0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:50.155641 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-afcc6d10-7bc3-4a46-87dd-7893fc5e1257 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748327 Mar 29 02:11:50.155874 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37bf29e9-e6c1-4455-8cf1-f6628b00c1dd tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.086901 Mar 29 02:11:50.156473 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 389/813] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:50 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:50.161232 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 425/814] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:11:50.167365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:50.170451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:50.170615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:50.171401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:50.180304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.181341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.182395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.183642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.193347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.193347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.193347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.193347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.453780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:50.556501 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-84d595c0-4722-4380-9abb-14dfa434db9e tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.393945 Mar 29 02:11:50.557604 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 426/815] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:50 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:50.562054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6e6ce924-18f6-4266-bb49-6641e3b97c8b req-c88dcf7f-3098-43d3-a407-10c16ccfc6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc2c33f9-e618-4d44-88ca-1c4828670ea7", "tag": "24f54f47-ae93-4415-8b00-b834c87cc5c7"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:50.564089 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:50.564089 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:50.575850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e6ce924-18f6-4266-bb49-6641e3b97c8b req-c88dcf7f-3098-43d3-a407-10c16ccfc6f9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.576653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e6ce924-18f6-4266-bb49-6641e3b97c8b req-c88dcf7f-3098-43d3-a407-10c16ccfc6f9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.596888 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6e6ce924-18f6-4266-bb49-6641e3b97c8b req-c88dcf7f-3098-43d3-a407-10c16ccfc6f9 service nova] Creating event network-changed:24f54f47-ae93-4415-8b00-b834c87cc5c7 for instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 on n-h2-828148-1 Mar 29 02:11:50.603074 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6e6ce924-18f6-4266-bb49-6641e3b97c8b req-c88dcf7f-3098-43d3-a407-10c16ccfc6f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044198 Mar 29 02:11:50.603997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 427/816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:50.614418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:50.614418 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:50.614418 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:11:50.614921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:50.616422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:11:50.659916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.661419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.663021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.663664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.799240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00addf90-7afa-4fd4-b1f1-673b06f47f35 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.193855 Mar 29 02:11:50.799824 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 428/817] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:11:50 2022] GET /compute/v2.1/servers => generated 1015 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:50.804389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:50.806113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:50.815865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.816605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:50.822221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:50.822899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.207570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.213119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.220735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e79ecb9-a414-4a10-81f7-caf0a61e7eb9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 1.058633 Mar 29 02:11:51.221862 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 390/818] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:50 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:51.229119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f22124e-1f4f-427e-be1e-80df25f982b0 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:51.230004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f22124e-1f4f-427e-be1e-80df25f982b0 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:51.240062 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2838e66c-5c72-4b23-a40a-5effdce06457 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1462 microversion: 2.1 time: 0.437528 Mar 29 02:11:51.240062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 429/819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:50 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1462 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:51.269378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:51.269378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:51.282593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.282731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.283508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.284126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.343598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f22124e-1f4f-427e-be1e-80df25f982b0 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.352391 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f22124e-1f4f-427e-be1e-80df25f982b0 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1222 microversion: 2.1 time: 0.127632 Mar 29 02:11:51.362038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 391/820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:51 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:51.369134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-034b8028-7a84-4dc7-af25-8ae444a1bcb1 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e7c160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:51.451128 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-034b8028-7a84-4dc7-af25-8ae444a1bcb1 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.087744 Mar 29 02:11:51.456978 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 392/821] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:51 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:51.589019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.600396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.602138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:51.603639 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db6f2cbb-ddeb-4220-a881-0307e52ef0d6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.361878 Mar 29 02:11:51.604354 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 430/822] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:51 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:51.620709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:51.621274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:51.630007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.630460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.631777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.632219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.647419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:51.648202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:51.664508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.664977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.674237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:51.674691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:51.710816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:11:52.118836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c0a4814-be55-48b4-90a9-47a2eb88a870 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 204 len: 0 microversion: 2.1 time: 0.508609 Mar 29 02:11:52.120965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 431/823] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:11:51 2022] DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:11:52.126792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:52.127712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:52.138270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:52.138743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:52.139686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:52.140288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:52.273494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:52.339679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cff3006d-c497-4459-a436-b7bb576a1d58 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.218755 Mar 29 02:11:52.353413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 432/824] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:52 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:52.358874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-530938789", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "1181097416", "adminPass": "***", "networks": [{"uuid": "8f44b1e6-4d31-4a23-b9f3-7a33c5ab24a3"}], "security_groups": [{"name": "tempest-securitygroup--2064310644"}], "key_name": "tempest-keypair-1380048371", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:52.499909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] validate_networks() for [('8f44b1e6-4d31-4a23-b9f3-7a33c5ab24a3', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:11:52.963059 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2878ab0-2e46-450c-8e72-3f0f5a458a46 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1613 microversion: 2.1 time: 1.510322 Mar 29 02:11:52.964369 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 393/825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:51 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1613 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:52.970237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:52.971058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:52.991539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:52.992586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:52.993766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:52.994360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.291809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:11:53.295636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:11:53.295636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:11:53.295636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:11:53.295636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:11:53.306851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.307650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.309013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.309663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.342530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:11:53.348371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Getting quotas for user da55b089ffbf4fe383c220193a34341c and project ce6234d4e0a44db988a8b7e7cef1cc16. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:11:53.363325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:11:53.374972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:11:53.408451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:53.436603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b22712ca-6ace-4f87-bc83-441ef0c14674 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 0.463309 Mar 29 02:11:53.437482 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 394/826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:52 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:53.446976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:53.451058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:53.464190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.466012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.467335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.468661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.567460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-babe9efa-1940-4637-b55d-8a7264322197 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.212532 Mar 29 02:11:53.569713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 433/827] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:11:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:11:53.576258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25484953-9d9b-402a-a551-6d4ab36e9fd1 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724137700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:53.654726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25484953-9d9b-402a-a551-6d4ab36e9fd1 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.079102 Mar 29 02:11:53.654726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 434/828] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:53 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:53.666032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:53.667006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:53.685557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.686191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.687352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.687938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.710797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:53.731743 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf8e72a7-fb53-4f4d-8733-1e34db212098 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1226 microversion: 2.1 time: 0.291101 Mar 29 02:11:53.741239 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 395/829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:53 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1226 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:53.755086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:53.758349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:53.795877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.806176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.816337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:53.817115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:53.932732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '290f81f2a34543a2812af388717ad506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35b3b7951bfa4f3b914de847772d8de3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:53.933435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] flavor_id is None. Assuming migration. {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4011}} Mar 29 02:11:53.935542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:11:54.109997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:54.121048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:54.126132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:54.127684 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3786fe00-22c3-4da2-9d01-8a04f77ab738 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 0.470555 Mar 29 02:11:54.128293 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 435/830] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:53 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:54.151811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:54.154015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:54.165690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.166152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:54.166933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.167447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:54.328457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:54.400249 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2758f6c5-c952-4830-802e-2db748d19e63 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.254221 Mar 29 02:11:54.401091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 436/831] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:54 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:54.407729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aee64fd1-c4be-4522-b455-067ec5b1de4a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:54.408565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aee64fd1-c4be-4522-b455-067ec5b1de4a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:54.520229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aee64fd1-c4be-4522-b455-067ec5b1de4a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:54.529511 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aee64fd1-c4be-4522-b455-067ec5b1de4a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1264 microversion: 2.1 time: 0.127123 Mar 29 02:11:54.530279 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 437/832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:54 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:54.535045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:54.535653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:54.544335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.545124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:54.546129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.546724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:54.759333 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c75c5d2-5041-4d4a-b661-c6861b895c4e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3/action" status: 202 len: 0 microversion: 2.1 time: 1.016378 Mar 29 02:11:54.771103 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 396/833] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:11:53 2022] POST /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3/action => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:11:54.775198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24b8831f-7d7e-4f2a-8662-19a1db8b3315 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724464ca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:54.879208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24b8831f-7d7e-4f2a-8662-19a1db8b3315 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.109601 Mar 29 02:11:54.881902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 397/834] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:54 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:54.889928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:54.891445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:54.904923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.905663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:54.906920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:54.907725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.013948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:55.023301 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f22f4ed3-47a4-4ddc-8ed9-d7286d5456b2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 0.491665 Mar 29 02:11:55.023897 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 438/835] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:54 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:55.032048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:55.032942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:55.041861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.042468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.050018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.050018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.379584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:55.391134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11f4970e-a600-480a-9e08-f8343a34924c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1471 microversion: 2.1 time: 0.366000 Mar 29 02:11:55.393543 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 439/836] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:55 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:55.405147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:55.405932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:55.426587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.429786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.433611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.434296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.467302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:55.499191 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-686c1f66-db14-446a-948f-958e5ef9ea4c tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1274 microversion: 2.1 time: 0.613364 Mar 29 02:11:55.502580 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 398/837] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:54 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1274 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:55.517844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:55.522551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:55.551943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.554162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:55.557581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:55.559532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:56.372519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:56.389990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:56.392750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:56.400320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-311489ff-279c-4a4c-bc19-1264b50a6ff4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1645 microversion: 2.25 time: 1.003249 Mar 29 02:11:56.401495 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 440/838] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:55 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1645 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:56.411111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:56.411900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:56.420305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:56.421027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:56.422008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:56.422636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:56.656198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:56.676549 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68ae4d76-e8a4-4edc-ba2b-8fb99dd65c79 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1316 microversion: 2.1 time: 0.271685 Mar 29 02:11:56.677523 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 441/839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:56 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:56.686506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-830ed614-dbce-43de-ade2-77d571048668 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724137040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:56.965798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:11:57.126604 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a005862-ceff-4d99-a3ff-51df4d89d9f6 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 1.619057 Mar 29 02:11:57.129461 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 399/840] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:11:55 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:11:57.170950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:57.181919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:57.198190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:57.200010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:57.202762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:57.204783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:58.249540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:58.265204 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b53e7d9f-5e90-4147-96f8-5eae87085009 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 1.105361 Mar 29 02:11:58.270125 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 400/841] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:57 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:58.298831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-da315fc2-9840-400a-ad36-74ff80225fbd req-ad97f693-4a27-4434-ba10-95be3afc2a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-plugged", "status": "completed", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:11:58.303090 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:11:58.303090 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:11:58.361046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-da315fc2-9840-400a-ad36-74ff80225fbd req-ad97f693-4a27-4434-ba10-95be3afc2a75 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:58.363922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-da315fc2-9840-400a-ad36-74ff80225fbd req-ad97f693-4a27-4434-ba10-95be3afc2a75 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:58.439129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-da315fc2-9840-400a-ad36-74ff80225fbd req-ad97f693-4a27-4434-ba10-95be3afc2a75 service nova] Creating event network-vif-plugged:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:11:58.456231 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-da315fc2-9840-400a-ad36-74ff80225fbd req-ad97f693-4a27-4434-ba10-95be3afc2a75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181199 Mar 29 02:11:58.463653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 401/842] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:11:58.487797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:58.489338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:58.525992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:58.527812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:58.528798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:58.531139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:59.360349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:11:59.371685 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-734ab28e-6367-4374-86ad-e052b508c9cc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1471 microversion: 2.1 time: 0.906520 Mar 29 02:11:59.379997 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 402/843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:58 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1471 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:11:59.389557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:11:59.401946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:11:59.411662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:59.412734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:11:59.413772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:11:59.421521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:00.836701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:00.857502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6dcb0e9f-4097-4d6a-946f-add4c6634955 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1322 microversion: 2.1 time: 1.475112 Mar 29 02:12:00.863439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 403/844] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:11:59 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1322 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:00.863439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:00.863871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:00.890680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:00.893920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:00.893920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:00.895467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:02.175120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:02.186305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:02.187888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:02.189062 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67190a3a-41b6-4d81-a260-4800ef27a7a0 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1635 microversion: 2.25 time: 1.329495 Mar 29 02:12:02.189818 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 404/845] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:00 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1635 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:02.201978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:02.202824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:02.211738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:02.212427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:02.220457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:02.220457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:04.170674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:04.189773 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1db03f26-1421-40cc-b7dd-1d4b1fb0cfe1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 1.998200 Mar 29 02:12:04.192485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 405/846] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:02 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:04.210859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:04.211562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:04.229628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:04.230687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:04.231983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:04.235380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:04.562677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:04.794092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4cb8021-9e23-40a8-9e48-3204ad458514 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.585919 Mar 29 02:12:04.817242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 406/847] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:04 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:04.830129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:04.831839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:04.846301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:04.850059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:04.853548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:04.859341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:06.547495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:06.572540 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e6e0066-b38e-41d7-ab02-c98820f1d736 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1308 microversion: 2.1 time: 1.752972 Mar 29 02:12:06.573622 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 407/848] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:04 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1308 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:06.578280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:06.580103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:06.593963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:06.594417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:06.595238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:06.595686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:07.386688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:07.425304 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-562db5ea-d5e2-4d59-b9ab-259375e228cd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1471 microversion: 2.1 time: 0.848874 Mar 29 02:12:07.427674 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 408/849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:06 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1471 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:07.435953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975f936-623a-42eb-ba11-283950a60665", "name": "network-vif-unplugged", "status": "completed", "tag": "dedf8652-5f62-4aea-a913-fd78cf041543"}, {"server_uuid": "cc2c33f9-e618-4d44-88ca-1c4828670ea7", "name": "network-vif-plugged", "status": "completed", "tag": "24f54f47-ae93-4415-8b00-b834c87cc5c7"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:07.438407 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:07.438407 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:07.460281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:07.461306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:07.493603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] Creating event network-vif-unplugged:dedf8652-5f62-4aea-a913-fd78cf041543 for instance e975f936-623a-42eb-ba11-283950a60665 on n-h1-828148-1 Mar 29 02:12:07.497211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] Creating event network-vif-plugged:24f54f47-ae93-4415-8b00-b834c87cc5c7 for instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 on n-h2-828148-1 Mar 29 02:12:07.525278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-24f5f45d-11f3-49cc-a90d-7833f7d430a2 req-10421a30-681a-4eed-a066-0f2917ee71d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088047 Mar 29 02:12:07.526317 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 409/850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:07.541181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:07.541901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:07.559163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:07.559834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:07.560415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:07.560882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:08.808879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:08.818878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a744184-4768-4c82-aae5-51cf0e5c0b84 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1322 microversion: 2.1 time: 1.282927 Mar 29 02:12:08.819712 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 410/851] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:07 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1322 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:08.824396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6ac0c9c-2cc0-4e03-b98f-b412d018cfc8 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '.version_select at 0x7f8717e7cca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:08.825743 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:08.825743 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:08.827089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ac0c9c-2cc0-4e03-b98f-b412d018cfc8 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:08.827528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ac0c9c-2cc0-4e03-b98f-b412d018cfc8 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:08.849838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6ac0c9c-2cc0-4e03-b98f-b412d018cfc8 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1700 microversion: 2.25 time: 0.028764 Mar 29 02:12:08.850440 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 411/852] 10.222.0.36 () {60 vars in 1183 bytes} [Tue Mar 29 02:12:08 2022] GET /compute/v2.1/os-migrations => generated 1700 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:08.865220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3be6c731-ae3b-4a0a-8a13-783dd920b19a req-23479d5a-536e-46d2-a44e-0bac0f489e78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0b0148-e275-4810-9e65-e920f042fb19", "tag": "ed935824-c6c3-495d-b51c-95809d05e46c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:08.866623 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:08.866623 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:08.875497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3be6c731-ae3b-4a0a-8a13-783dd920b19a req-23479d5a-536e-46d2-a44e-0bac0f489e78 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:08.875935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3be6c731-ae3b-4a0a-8a13-783dd920b19a req-23479d5a-536e-46d2-a44e-0bac0f489e78 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:08.892898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3be6c731-ae3b-4a0a-8a13-783dd920b19a req-23479d5a-536e-46d2-a44e-0bac0f489e78 service nova] Creating event network-changed:ed935824-c6c3-495d-b51c-95809d05e46c for instance ea0b0148-e275-4810-9e65-e920f042fb19 on n-h2-828148-1 Mar 29 02:12:08.898267 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3be6c731-ae3b-4a0a-8a13-783dd920b19a req-23479d5a-536e-46d2-a44e-0bac0f489e78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036946 Mar 29 02:12:08.899276 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 412/853] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:08.906039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-783c505d-cbaf-4a8a-8f00-d84f33a6538a req-faf2cc00-4663-4e2e-954f-a2d5ca6a5749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e975f936-623a-42eb-ba11-283950a60665", "name": "network-vif-deleted", "tag": "dedf8652-5f62-4aea-a913-fd78cf041543"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:08.907507 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:08.907507 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:08.917496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-783c505d-cbaf-4a8a-8f00-d84f33a6538a req-faf2cc00-4663-4e2e-954f-a2d5ca6a5749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:08.917944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-783c505d-cbaf-4a8a-8f00-d84f33a6538a req-faf2cc00-4663-4e2e-954f-a2d5ca6a5749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:08.935408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-783c505d-cbaf-4a8a-8f00-d84f33a6538a req-faf2cc00-4663-4e2e-954f-a2d5ca6a5749 service nova] Creating event network-vif-deleted:dedf8652-5f62-4aea-a913-fd78cf041543 for instance e975f936-623a-42eb-ba11-283950a60665 on n-h1-828148-1 Mar 29 02:12:08.940477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-783c505d-cbaf-4a8a-8f00-d84f33a6538a req-faf2cc00-4663-4e2e-954f-a2d5ca6a5749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039259 Mar 29 02:12:08.941306 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 413/854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:08.948043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:08.948043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:08.956398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:08.956865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:08.957707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:08.958140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:09.756373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:09.769389 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-689bcd42-c9bd-434b-b811-2ab92919f9b5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.826501 Mar 29 02:12:09.779133 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 414/855] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:08 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:09.783781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:09.786747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:09.793479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:09.794355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:09.794952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:09.795404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:10.045703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:10.155409 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0442b7ab-6965-493a-8ab1-31f64d07576f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.375091 Mar 29 02:12:10.156000 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 415/856] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:09 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:10.172076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:10.172669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:10.188660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:10.189132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:10.189930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:10.190358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:10.794275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:10.806662 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-074d4ab6-d669-4722-8aec-83317847891b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1487 microversion: 2.1 time: 0.649505 Mar 29 02:12:10.818459 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 416/857] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:10 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1487 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:10.818459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:10.818947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:10.834509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:10.842527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:10.844652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:10.845141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.250387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:11.263382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a5ac579-6c24-439b-ba32-6ab35ce46180 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1476 microversion: 2.1 time: 0.455009 Mar 29 02:12:11.264300 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 417/858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:10 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:11.270115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:11.271571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:11.281232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.281823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.282681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.283194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.542434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:11.624061 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5f07e4a6-a4d3-423f-8cc6-e0198028986d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 2127 microversion: 2.25 time: 0.357882 Mar 29 02:12:11.637663 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 418/859] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:11 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 2127 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:11.643125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:11.644295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:11.656488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.657314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.658268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.658862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.908133 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-830ed614-dbce-43de-ade2-77d571048668 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 15.227560 Mar 29 02:12:11.914744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 442/860] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:11:56 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 15235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:11.919811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:11.920755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:11.929432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.930245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.931346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:11.931999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:11.966168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:11.979482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be48265b-9284-4980-8a2c-0c156b0a134f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1322 microversion: 2.1 time: 0.340235 Mar 29 02:12:11.980690 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 419/861] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:11 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:11.994123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f0ea9d0-739f-40a4-a5f0-57183844f83c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:12.008000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f0ea9d0-739f-40a4-a5f0-57183844f83c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.008691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f0ea9d0-739f-40a4-a5f0-57183844f83c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.082485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f0ea9d0-739f-40a4-a5f0-57183844f83c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Going to try to stop instance {{(pid=103514) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:12:12.258109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:12.275911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-750f363f-d8d0-416c-a632-f4bd8572be3a tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.358740 Mar 29 02:12:12.286415 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 443/862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:11 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:12.291598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7fcc49be-5adb-4bc5-8a68-d80fb8aec19b req-fbf3e5ba-378a-4dfc-8f5e-5681322266ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f63f1d-d440-449c-97bc-3b353195a7df", "tag": "693c5807-2028-4104-9515-c798153c42ac"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:12.295272 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:12.295272 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:12.306550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7fcc49be-5adb-4bc5-8a68-d80fb8aec19b req-fbf3e5ba-378a-4dfc-8f5e-5681322266ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.307372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7fcc49be-5adb-4bc5-8a68-d80fb8aec19b req-fbf3e5ba-378a-4dfc-8f5e-5681322266ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.333671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7fcc49be-5adb-4bc5-8a68-d80fb8aec19b req-fbf3e5ba-378a-4dfc-8f5e-5681322266ed service nova] Creating event network-changed:693c5807-2028-4104-9515-c798153c42ac for instance 17f63f1d-d440-449c-97bc-3b353195a7df on n-h2-828148-1 Mar 29 02:12:12.339420 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7fcc49be-5adb-4bc5-8a68-d80fb8aec19b req-fbf3e5ba-378a-4dfc-8f5e-5681322266ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050939 Mar 29 02:12:12.341278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 444/863] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:12.349454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229", "tag": "3c0e7801-36d4-4fbe-b606-5d0668ea4fb4"}, {"name": "network-changed", "server_uuid": "359583e9-8ed5-4f16-a82e-4bc1b6c6cac3", "tag": "51532724-78e3-4ed8-b5dc-3f72372a05a1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:12.352376 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:12.352376 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:12.363083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.363681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.388232 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] Creating event network-changed:3c0e7801-36d4-4fbe-b606-5d0668ea4fb4 for instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 on n-h2-828148-1 Mar 29 02:12:12.388855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] Creating event network-changed:51532724-78e3-4ed8-b5dc-3f72372a05a1 for instance 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 on n-h1-828148-1 Mar 29 02:12:12.397394 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0ea82c30-d30e-4c4f-8ee5-ff3e3dc043e9 req-8e5ce6d9-39a9-45d5-b6c9-3debb507bff5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054558 Mar 29 02:12:12.398468 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 445/864] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:12.403500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:12.404447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:12.413082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.413797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.414742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.415325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.577033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f0ea9d0-739f-40a4-a5f0-57183844f83c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7/action" status: 202 len: 0 microversion: 2.1 time: 0.594770 Mar 29 02:12:12.583328 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 420/865] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:12:11 2022] POST /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:12:12.587869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:12.589289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:12.599539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.600251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.601126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.601627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.603585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:12.723740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dcaeacc-e3a5-4845-bcc7-0fdf47686c39 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.323957 Mar 29 02:12:12.745951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 446/866] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:12 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:12.750746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:12.751360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:12.759483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.760015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:12.760794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:12.761249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:13.446829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:13.456264 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f287e4e0-f902-4569-94d6-414d8523a886 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1476 microversion: 2.1 time: 0.708392 Mar 29 02:12:13.457005 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 447/867] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:12 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1476 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:13.462432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:13.463104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:13.472729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:13.472729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:13.480716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:13.480716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:13.807316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:13.884969 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c6ef87c-555a-4417-8cf6-49dce2ecba9d tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 2127 microversion: 2.25 time: 1.302579 Mar 29 02:12:13.885978 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 421/868] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:12 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 2127 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:13.890217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-879bd34d-ff0a-4cd4-8047-0210a39ebe1e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e55a60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:13.959528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-879bd34d-ff0a-4cd4-8047-0210a39ebe1e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.072693 Mar 29 02:12:13.967296 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 422/869] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:13 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:13.971903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:13.972511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:13.973549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:13.980638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:13.981112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:13.981902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:13.982372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:13.987085 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04abc90c-e545-4731-bab2-15d46a6ecc88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.528896 Mar 29 02:12:13.987995 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 448/870] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:13 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:13.993095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:13.999252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:14.001989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.002445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.003227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.003666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.340980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:14.351887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca5b805f-3700-4cc5-aee3-be4b90531df5 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.362755 Mar 29 02:12:14.352478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 449/871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:13 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:14.361974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:14.362590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:14.381154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.381610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.382403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.382840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.677742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:14.688872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:14.699705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86236775-b896-4e28-abea-1e7a0cba5c1d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1322 microversion: 2.1 time: 0.731272 Mar 29 02:12:14.700608 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 423/872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:13 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:14.705815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:14.711239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:14.728901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.729408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.730274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.730709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.774067 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-577e08be-d494-4e7f-aa6c-3ba899507867 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.415509 Mar 29 02:12:14.775732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 450/873] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:14 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:14.780546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-068f61d2-db80-4fea-89f2-534a671a4b73 req-fe9bb8ee-5110-4927-b180-7618ba7ca0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f63f1d-d440-449c-97bc-3b353195a7df", "name": "network-vif-plugged", "status": "completed", "tag": "693c5807-2028-4104-9515-c798153c42ac"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:14.782611 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:14.782611 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:14.792651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-068f61d2-db80-4fea-89f2-534a671a4b73 req-fe9bb8ee-5110-4927-b180-7618ba7ca0d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.793385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-068f61d2-db80-4fea-89f2-534a671a4b73 req-fe9bb8ee-5110-4927-b180-7618ba7ca0d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.811540 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-068f61d2-db80-4fea-89f2-534a671a4b73 req-fe9bb8ee-5110-4927-b180-7618ba7ca0d5 service nova] Creating event network-vif-plugged:693c5807-2028-4104-9515-c798153c42ac for instance 17f63f1d-d440-449c-97bc-3b353195a7df on n-h2-828148-1 Mar 29 02:12:14.817788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-068f61d2-db80-4fea-89f2-534a671a4b73 req-fe9bb8ee-5110-4927-b180-7618ba7ca0d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040430 Mar 29 02:12:14.818626 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 451/874] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:14.824658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:14.826036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:14.837859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.838731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.840504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:14.842732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:14.980277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lazy-loading 'services' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:15.177960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:15.193051 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f8aaec5-40f8-42e8-8f79-2d145be9da52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1476 microversion: 2.1 time: 0.373022 Mar 29 02:12:15.194656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 452/875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:14 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:15.203115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-06844594-3a9e-4c55-9444-4b19a5b85cf7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724cf60d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.316122 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-06844594-3a9e-4c55-9444-4b19a5b85cf7 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1423 microversion: 2.1 time: 0.116378 Mar 29 02:12:15.316917 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 453/876] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1423 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:15.322507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.323122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:15.338606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.339304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.340093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.340797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.420625 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd07b95d-85da-4405-815f-32cd2f2c29bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "DELETE /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments/c6a03a79-4484-4972-bc48-9fb63ed7d385" status: 202 len: 0 microversion: 2.25 time: 0.718039 Mar 29 02:12:15.422219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 424/877] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Mar 29 02:12:14 2022] DELETE /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments/c6a03a79-4484-4972-bc48-9fb63ed7d385 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:15.429851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.430587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:15.438520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.438967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.439949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.440163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.592721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:15.609859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd6df889-e28f-4591-9b88-b85a267b9665 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.291856 Mar 29 02:12:15.622224 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 454/878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:15.628851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.630168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:15.638180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.638637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.639418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.639855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.714530 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe37cac5-04fe-475d-a33c-fa8bffc6775d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.089373 Mar 29 02:12:15.715987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 455/879] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:12:15.721392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.721797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:15.730250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.730701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.731587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:15.731921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:15.966921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:15.977240 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6edbb2d2-c3fe-4952-90fd-dc05a3532f74 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.553606 Mar 29 02:12:15.978206 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 425/880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:15.998383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:15.999152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:16.008087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.008801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.010037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.010914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.131170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:16.141069 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c2dddce-4257-4e8e-8648-af570bd64946 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1322 microversion: 2.1 time: 0.424085 Mar 29 02:12:16.144907 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 456/881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:16.165565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:16.211330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:16.211933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:16.219551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.220033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.220759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.221354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.229907 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-698ae57c-44cb-4c7e-b6e1-bf760c8aa133 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1929 microversion: 2.75 time: 0.250276 Mar 29 02:12:16.241176 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 426/882] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:15 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:16.329548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7593c2f-c676-4040-b703-43b900a188ed tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e8b8b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:16.434303 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7593c2f-c676-4040-b703-43b900a188ed tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1432 microversion: 2.1 time: 0.109102 Mar 29 02:12:16.434968 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 427/883] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:16 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1432 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:16.474554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f25a86f-437b-42d5-a307-b646b51df837 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87241caaf0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:16.490603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:16.508328 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9cde10ce-893f-428e-8571-d2690acf1d5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1475 microversion: 2.1 time: 0.300797 Mar 29 02:12:16.518867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 457/884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:16 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:16.524814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "name": "network-vif-unplugged", "status": "completed", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:16.526543 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:16.526543 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:16.534911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.535590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.565378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] Creating event network-vif-unplugged:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h2-828148-1 Mar 29 02:12:16.572308 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f25a86f-437b-42d5-a307-b646b51df837 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 200 len: 1432 microversion: 2.1 time: 0.129588 Mar 29 02:12:16.582223 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 428/885] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:16 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 1432 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:16.582357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] Instance db329457-1bd1-43c4-a0db-66492ded36c3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:12:16.589146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:16.590062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:16.595849 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e1e1b33a-ef54-4d02-ad49-db579e36d819 req-87658d94-41fe-4d30-bad3-c755243e0395 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075485 Mar 29 02:12:16.596998 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 458/886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:16.600634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.601464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.602411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.602992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.632866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:16.633770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:16.660120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.660760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:16.663257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:16.668488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.005902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:17.022132 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-98be6d7c-07dc-46a6-afb9-ee3a7fd2af11 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.394052 Mar 29 02:12:17.023146 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 459/887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:16 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:17.028366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:17.029537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:17.049258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.049258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.049258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.049258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.220365 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1ab6cb4-5157-4bee-92c2-945a68d27917 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.195975 Mar 29 02:12:17.224611 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 460/888] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:12:17 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:12:17.226970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c7bf43ff-b407-4c24-a88c-0b5e2b2eda34 req-7e5c65de-ff79-4a22-8955-b4123836cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0b0148-e275-4810-9e65-e920f042fb19", "name": "network-vif-plugged", "status": "completed", "tag": "ed935824-c6c3-495d-b51c-95809d05e46c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:17.228509 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:17.228509 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:17.240529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c7bf43ff-b407-4c24-a88c-0b5e2b2eda34 req-7e5c65de-ff79-4a22-8955-b4123836cb3c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.241014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c7bf43ff-b407-4c24-a88c-0b5e2b2eda34 req-7e5c65de-ff79-4a22-8955-b4123836cb3c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.263825 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c7bf43ff-b407-4c24-a88c-0b5e2b2eda34 req-7e5c65de-ff79-4a22-8955-b4123836cb3c service nova] Creating event network-vif-plugged:ed935824-c6c3-495d-b51c-95809d05e46c for instance ea0b0148-e275-4810-9e65-e920f042fb19 on n-h2-828148-1 Mar 29 02:12:17.269043 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c7bf43ff-b407-4c24-a88c-0b5e2b2eda34 req-7e5c65de-ff79-4a22-8955-b4123836cb3c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046622 Mar 29 02:12:17.271209 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 461/889] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:17.276439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:17.277183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:17.287208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.287896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.288649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.289196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.419209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:17.429890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9193aa10-ea27-4ef7-869e-e4560642d076 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1480 microversion: 2.1 time: 0.849352 Mar 29 02:12:17.430469 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 429/890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:16 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1480 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:17.446451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:17.447288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:17.454970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.455416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.456373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.456806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.859899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:17.874804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcd37b40-afd5-48c0-8525-23d3ad4ab4dc tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.602236 Mar 29 02:12:17.875385 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 462/891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:17 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:17.889739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:17.890372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:17.895057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:17.898672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.899125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.900539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.901031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.904736 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d0f77a4-0e9a-40cf-8d78-2328c67b57f9 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 200 len: 1515 microversion: 2.1 time: 0.462681 Mar 29 02:12:17.916347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 430/892] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:17 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 1515 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:17.932536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:17.933276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:17.940994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.941449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:17.942371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:17.942895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.220572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:18.282598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3cbaa4be-c5a1-408b-8b0d-f74164e3530f tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1935 microversion: 2.75 time: 0.396677 Mar 29 02:12:18.283324 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 463/893] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:17 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1935 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:18.300756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:18.301431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:18.309368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.309824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.310846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.311057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.326751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:18.335812 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-778dc058-eda3-4cf0-8356-2c1ecc1f855a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1475 microversion: 2.1 time: 0.409265 Mar 29 02:12:18.336582 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 431/894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:17 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1475 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:18.350917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:18.354178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:18.360071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.360738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.361700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.362320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.566151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:18.576493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1bbd6174-dc2e-4d22-aac1-275fa9f582cc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1322 microversion: 2.1 time: 0.279337 Mar 29 02:12:18.577372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 464/895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:18 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:18.581918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:18.582911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:18.590793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.591243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.592025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.592506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.665647 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-499d0075-4ad6-4e9f-8a38-0b149575c120 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.087164 Mar 29 02:12:18.670937 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 465/896] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:12:18 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:18.671940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:18.672266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:18.681888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.682339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.683124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.683570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.873201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:18.902920 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a001162d-0ead-4ee0-95d4-5f42fa6c7b74 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.546450 Mar 29 02:12:18.906283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 432/897] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:18 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:18.915533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:18.922080 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:18.922080 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:18.934176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:18.935569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:18.964913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] Creating event network-changed:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h2-828148-1 Mar 29 02:12:18.972607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] Instance db329457-1bd1-43c4-a0db-66492ded36c3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:12:18.987405 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e251b99c-689a-4b45-b1c6-d92789950655 req-16cfd267-c3cb-49d9-8dff-3a1445f70d9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079787 Mar 29 02:12:18.989927 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 433/898] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:18.997949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:19.000197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:19.006440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:19.009957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:19.010413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:19.011203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:19.012079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:19.016762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c01ecb7-6e16-457b-99db-e0381182fa79 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1467 microversion: 2.1 time: 0.349304 Mar 29 02:12:19.017718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 466/899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:18 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1467 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:19.045940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d400e4a0-fb16-47de-a38a-26603f7b2344 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f872427fc10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:19.112151 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d400e4a0-fb16-47de-a38a-26603f7b2344 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f" status: 200 len: 784 microversion: 2.1 time: 0.076137 Mar 29 02:12:19.116915 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 467/900] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:19 2022] GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:12:19.125391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f01106d-f0a0-415e-8eee-ae929944750d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:19.143664 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f01106d-f0a0-415e-8eee-ae929944750d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022150 Mar 29 02:12:19.144324 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 468/901] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:12:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:12:19.155210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-431a1ba1-48e7-4c21-a568-3e535f6b592b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f872427fc10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:19.656802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:19.666611 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86c2166c-f6c2-41d5-8a55-fe02b9841240 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1390 microversion: 2.1 time: 0.675215 Mar 29 02:12:19.667249 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 434/902] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:18 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1390 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:19.680981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}, {"server_uuid": "2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229", "name": "network-vif-plugged", "status": "completed", "tag": "3c0e7801-36d4-4fbe-b606-5d0668ea4fb4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:19.682792 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:19.682792 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:19.706467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:19.706920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:19.764390 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] Creating event network-vif-unplugged:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:12:19.767671 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] Creating event network-vif-plugged:3c0e7801-36d4-4fbe-b606-5d0668ea4fb4 for instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 on n-h2-828148-1 Mar 29 02:12:19.783673 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4af090f8-8db4-413c-8650-f60455343497 req-fa55edf6-dc74-4fd1-9489-e1d2e7755cbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.114901 Mar 29 02:12:19.796111 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 435/903] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:19.805881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:19.806776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:19.816269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:19.821361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:19.821361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:19.821361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.021334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:20.082425 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4382ab2a-7489-4261-aee4-d0042be0462a tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1935 microversion: 2.75 time: 0.284523 Mar 29 02:12:20.083671 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 436/904] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:19 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1935 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:20.101622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:20.102680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:20.111713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.114728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.114728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.114728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.495214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:20.503461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d98cc7c3-a932-4d4c-94e3-da897ca370d2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1473 microversion: 2.1 time: 0.407045 Mar 29 02:12:20.508862 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 437/905] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:20 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1473 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:20.508862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:20.509196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:20.516627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.517116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.519044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.519044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.723207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:20.733732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed89939c-829f-4223-b6e4-df60318a81a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1322 microversion: 2.1 time: 0.228204 Mar 29 02:12:20.734623 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 438/906] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:20 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:20.747807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:20.748415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:20.756184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.756713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.757749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.758351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.832511 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-431a1ba1-48e7-4c21-a568-3e535f6b592b tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "DELETE /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 204 len: 0 microversion: 2.1 time: 1.680809 Mar 29 02:12:20.840237 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 469/907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:19 2022] DELETE /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 0 bytes in 1684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:20.849446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:20.850076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:20.866497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.867061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:20.874524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:20.874524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.006738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:21.022724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f4eb77f-2a8e-4a3c-b1af-f1b53d3afa2a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.278276 Mar 29 02:12:21.033204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 439/908] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:20 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:21.039082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d94b584a-89b1-4aaa-b12a-fc07bd7ab017 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e7c940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:21.064432 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d94b584a-89b1-4aaa-b12a-fc07bd7ab017 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] HTTP exception thrown: Image not found. Mar 29 02:12:21.065289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d94b584a-89b1-4aaa-b12a-fc07bd7ab017 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:21.066872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d94b584a-89b1-4aaa-b12a-fc07bd7ab017 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 404 len: 62 microversion: 2.1 time: 0.032266 Mar 29 02:12:21.068018 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 440/909] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:21 2022] GET /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:12:21.083817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-388093252"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:21.083817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:21.091511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.092231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.093188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.093710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.126993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:21.138474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9fe21858-08b6-4cda-9ae7-a8b7af6bd909 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1588 microversion: 2.1 time: 0.297089 Mar 29 02:12:21.141014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 470/910] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:20 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1588 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:21.144620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:21.145302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:21.154403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.154851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.155685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.156113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.306355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] Lazy-loading 'services' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:21.369076 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f021602d-9ecb-46c7-b4db-cb7e6986a557 tempest-ServersAdmin275Test-1298033323 tempest-ServersAdmin275Test-1298033323-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1920 microversion: 2.75 time: 0.228660 Mar 29 02:12:21.369833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 471/911] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:21 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1920 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:21.374326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:21.374846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:21.383042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.383487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.384256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.384747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.551129 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c61f09ef-ca52-49cf-b259-8855fb3c8c99 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180231 Mar 29 02:12:21.552306 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 472/912] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:12:21 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:21.558104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:21.573162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:21.573162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.573162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.573162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.573689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.642508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:12:21.841995 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb7c6717-ad3d-430b-b5ec-12f81a9e509c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "POST /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b/action" status: 202 len: 0 microversion: 2.1 time: 0.764255 Mar 29 02:12:21.842678 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 441/913] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:12:21 2022] POST /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 29 02:12:21.849678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:21.850783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:21.863223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.869481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:21.869481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:21.869481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.113487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:22.125770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be471d9c-dc20-4f18-9f46-e35710db13fc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1473 microversion: 2.1 time: 0.281296 Mar 29 02:12:22.126593 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 442/914] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:21 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1473 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:22.131738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:22.132513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:22.141837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.142278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.143458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.144039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.348509 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc2f00d1-4831-4d31-8444-0dd69458da65 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 204 len: 0 microversion: 2.75 time: 0.793844 Mar 29 02:12:22.353086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 473/915] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:12:21 2022] DELETE /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:12:22.359231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-48e4e586-b0c8-42e0-beb0-9d928085a513 req-c901fc4e-fc6d-4148-9cfd-60c2b05b41f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359583e9-8ed5-4f16-a82e-4bc1b6c6cac3", "name": "network-vif-plugged", "status": "completed", "tag": "51532724-78e3-4ed8-b5dc-3f72372a05a1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:22.359231 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:22.359231 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:22.370322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-48e4e586-b0c8-42e0-beb0-9d928085a513 req-c901fc4e-fc6d-4148-9cfd-60c2b05b41f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.372618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-48e4e586-b0c8-42e0-beb0-9d928085a513 req-c901fc4e-fc6d-4148-9cfd-60c2b05b41f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.392425 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-48e4e586-b0c8-42e0-beb0-9d928085a513 req-c901fc4e-fc6d-4148-9cfd-60c2b05b41f1 service nova] Creating event network-vif-plugged:51532724-78e3-4ed8-b5dc-3f72372a05a1 for instance 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 on n-h1-828148-1 Mar 29 02:12:22.398436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-48e4e586-b0c8-42e0-beb0-9d928085a513 req-c901fc4e-fc6d-4148-9cfd-60c2b05b41f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047687 Mar 29 02:12:22.402021 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 474/916] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:22.408688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9611cbbf-fab6-46ab-a88e-785e9eb65b09 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8725ea0160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:22.430196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:22.440335 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a650ea01-357e-4f8e-bf8b-8d62c764b939 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1322 microversion: 2.1 time: 0.312173 Mar 29 02:12:22.444329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 443/917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:22 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:22.460915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:22.461643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:22.472027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.481422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.482321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.482770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.485433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9611cbbf-fab6-46ab-a88e-785e9eb65b09 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.081822 Mar 29 02:12:22.492071 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 475/918] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:22 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:22.496871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:22.498323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:22.507693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.510699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.510699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:22.510699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:22.742574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:22.753996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:22.756166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:22.762684 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aba05b6b-d9ca-4e18-a1d6-4c49ff38e0f7 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1444 microversion: 2.75 time: 0.269145 Mar 29 02:12:22.763369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 476/919] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:22 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1444 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:23.063704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.076029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7ac6e990-deff-4856-9db8-b940496c1a86 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.630531 Mar 29 02:12:23.086119 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 444/920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:22 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:23.149288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:23.150033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:23.159410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.160317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.160708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.161193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.457804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:23.459358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:23.469530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.469976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.470958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.471396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.594749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.607682 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24c3e33b-4995-42f3-a6ac-d4624c36c592 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1470 microversion: 2.1 time: 0.463809 Mar 29 02:12:23.612544 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 477/921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:23 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:23.630366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-219ca8e7-bf47-417a-8b13-99ee879e9111 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724245af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:23.725793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.737073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5d4a92a1-a91c-4f06-820e-ef639a797d9a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1322 microversion: 2.1 time: 0.282949 Mar 29 02:12:23.747437 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-219ca8e7-bf47-417a-8b13-99ee879e9111 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.130486 Mar 29 02:12:23.751921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 478/922] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:23 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:23.752490 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 445/923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:23 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:23.757869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:23.764398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:23.774214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.775112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.776136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.776625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.785559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:23.787778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:23.810773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.811397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.812205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:23.812640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:23.957120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.966752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.975711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:23.975711 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-578c9863-dab7-4c7e-8e8e-167bd16beb96 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1444 microversion: 2.75 time: 0.194401 Mar 29 02:12:23.975711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 446/924] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:23 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:24.094883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:24.095888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:24.106172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.108298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.109654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.110326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.115916 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d376ea9-741b-4ab9-89e2-9fe4ed01a82b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3/action" status: 204 len: 0 microversion: 2.1 time: 0.361387 Mar 29 02:12:24.116627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 479/925] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:12:23 2022] POST /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3/action => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:24.126048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:24.127953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:24.146584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.147028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.149935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.150399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.445583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:24.456031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e79da9d-08c2-494f-b0be-1bc2ce658bd9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1470 microversion: 2.1 time: 0.334802 Mar 29 02:12:24.456647 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 480/926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:24 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1470 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:24.470008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:24.470634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:24.489421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.489877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.491151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.491597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.696340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:24.713679 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98930d75-2f2f-47fa-8950-a3ee9a3c001b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.623506 Mar 29 02:12:24.723291 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 447/927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:24 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:24.723291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fafe2f6e-9b49-48dd-aed0-bb3c47690d6a req-4238cae0-0c15-468e-aa98-92dd8aeffda3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea0b0148-e275-4810-9e65-e920f042fb19", "tag": "ed935824-c6c3-495d-b51c-95809d05e46c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:24.723798 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:24.723798 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:24.749169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fafe2f6e-9b49-48dd-aed0-bb3c47690d6a req-4238cae0-0c15-468e-aa98-92dd8aeffda3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.749634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fafe2f6e-9b49-48dd-aed0-bb3c47690d6a req-4238cae0-0c15-468e-aa98-92dd8aeffda3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.787514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fafe2f6e-9b49-48dd-aed0-bb3c47690d6a req-4238cae0-0c15-468e-aa98-92dd8aeffda3 service nova] Creating event network-changed:ed935824-c6c3-495d-b51c-95809d05e46c for instance ea0b0148-e275-4810-9e65-e920f042fb19 on n-h2-828148-1 Mar 29 02:12:24.797199 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fafe2f6e-9b49-48dd-aed0-bb3c47690d6a req-4238cae0-0c15-468e-aa98-92dd8aeffda3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079207 Mar 29 02:12:24.800288 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 448/928] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:24.811087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:24.811793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:24.835157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.835535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.836325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:24.836757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:24.858924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:24.880558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3dd81241-e6b6-476f-948b-d6a62a54e201 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1588 microversion: 2.1 time: 0.421757 Mar 29 02:12:24.893351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 481/929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:24 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1588 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:24.904549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ec04b93-c3e3-4a13-aef8-139d2ab1ced2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87242e83a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:25.022296 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ec04b93-c3e3-4a13-aef8-139d2ab1ced2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.127563 Mar 29 02:12:25.023826 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 482/930] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:24 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:25.031141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:25.033037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:25.046129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.046129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.046343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.046764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.160530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.161544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.161992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lazy-loading 'fault' on Instance uuid 2bcba8eb-bfde-4fe9-9626-4010bec00084 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:25.251841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:25.265823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:25.267858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '96d3ba2e670a451385115b811ebf5faa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc1a3a997c040de85464c430ac8ebcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:25.280334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6351bf6-a716-4047-9a78-c33449cc1945 tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 200 len: 1449 microversion: 2.75 time: 0.254010 Mar 29 02:12:25.292691 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 483/931] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:25 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 1449 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:12:25.305944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:25.322425 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46bc4b8c-a32b-4c4c-baeb-f7fa881d538a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1515 microversion: 2.1 time: 0.520638 Mar 29 02:12:25.324633 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 449/932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:24 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:25.340766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:25.343505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:25.354110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.355138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.356172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.357107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.475208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:25.476174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:25.490079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.490655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.492272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.492817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.765216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:25.776395 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f4f2443-ae0e-43f8-8c73-ceba6ee92efc tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 200 len: 1514 microversion: 2.1 time: 0.438998 Mar 29 02:12:25.789438 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 484/933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:25 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 1514 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:25.789438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:25.789438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:25.800043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.803705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:25.803705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:25.803705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.167381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:26.180506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-94bcd2ab-5f2e-44b3-bad7-92cc9830e26b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.400655 Mar 29 02:12:26.191254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 485/934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:25 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:26.198501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:26.199586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:26.209903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.211652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.213377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.214007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.228970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:26.243511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-039da005-f7d3-48ab-a2ff-b8b5364eb8d5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1470 microversion: 2.1 time: 0.772827 Mar 29 02:12:26.245595 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 450/935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:25 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1470 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:26.258005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e136ebb-280f-4f82-8987-2050e892d583 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717d57160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:26.308532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:12:26.346672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e136ebb-280f-4f82-8987-2050e892d583 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.091960 Mar 29 02:12:26.356672 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 451/936] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:26 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:26.362356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:26.363293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] [instance: 2bcba8eb-bfde-4fe9-9626-4010bec00084] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:26.372996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.373791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.374782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.375429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.446057 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] HTTP exception thrown: Instance 2bcba8eb-bfde-4fe9-9626-4010bec00084 could not be found. Mar 29 02:12:26.447037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] Returning 404 to user: Instance 2bcba8eb-bfde-4fe9-9626-4010bec00084 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:26.448113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09dd25c4-42fc-4dc1-b845-e46d1e2b5dca tempest-ServersAdmin275Test-882630028 tempest-ServersAdmin275Test-882630028-project] 10.222.0.36 "GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084" status: 404 len: 111 microversion: 2.75 time: 0.089997 Mar 29 02:12:26.448930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 452/937] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:12:26 2022] GET /compute/v2.1/servers/2bcba8eb-bfde-4fe9-9626-4010bec00084 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:12:26.854644 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acef92f2-ab9b-4be7-af01-696712f9ecc6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 204 len: 0 microversion: 2.1 time: 0.630011 Mar 29 02:12:26.854644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 486/938] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:12:26 2022] DELETE /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:26.855359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:26.855359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:26.855359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.855359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:26.856783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:26.857441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:27.085391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:27.099900 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a19744c-291f-40f2-9c4c-ce782074441b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 200 len: 1520 microversion: 2.1 time: 0.266848 Mar 29 02:12:27.100707 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 453/939] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:26 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:27.210517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:27.211467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:27.219830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:27.221181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:27.222017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:27.222457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:27.263265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:27.264553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:27.273163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:27.273614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:27.274584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:27.275420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:27.516402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:27.539748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:27.545374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-002cf4ca-44e6-4079-96e6-2543c66f76d5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.349290 Mar 29 02:12:27.547535 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 487/940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:27 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:27.552144 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed06b0a7-0c14-44b8-97db-367550273a70 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1470 microversion: 2.1 time: 0.293013 Mar 29 02:12:27.553787 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 454/941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:27 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:27.572736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60e19871-3b4b-4f95-bf6c-32fbe09d0cae tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f872427fee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:27.646962 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60e19871-3b4b-4f95-bf6c-32fbe09d0cae tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.085642 Mar 29 02:12:27.659194 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 488/942] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:27 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:28.117202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:28.117822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:28.123809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-40ed16f4-541d-40b3-a578-5e27fa05b578 req-2544ebd6-ab1d-47e8-9bb6-121e483a79a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "name": "network-vif-plugged", "status": "completed", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:28.127857 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:28.127857 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:28.134278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.134726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.135508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.135937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.143486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-40ed16f4-541d-40b3-a578-5e27fa05b578 req-2544ebd6-ab1d-47e8-9bb6-121e483a79a1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.144165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-40ed16f4-541d-40b3-a578-5e27fa05b578 req-2544ebd6-ab1d-47e8-9bb6-121e483a79a1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.163903 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-40ed16f4-541d-40b3-a578-5e27fa05b578 req-2544ebd6-ab1d-47e8-9bb6-121e483a79a1 service nova] Creating event network-vif-plugged:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h2-828148-1 Mar 29 02:12:28.168964 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-40ed16f4-541d-40b3-a578-5e27fa05b578 req-2544ebd6-ab1d-47e8-9bb6-121e483a79a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049328 Mar 29 02:12:28.169988 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 489/943] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:28.424258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:28.435416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d42f022-0d20-4a0b-bb04-ce0528892cf5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 200 len: 1520 microversion: 2.1 time: 0.322212 Mar 29 02:12:28.445819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 455/944] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:28 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:28.570993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:28.571860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:28.586214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.586937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.587891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.588531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.591505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:28.593557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:28.608435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.613034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.613034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:28.613034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:28.932555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:28.942379 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f42697b9-39f4-42ca-9cc8-64d9ab8b02e5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.378409 Mar 29 02:12:28.943353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 490/945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:28 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:28.949385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-760f5000-257e-45d6-99a6-ddc7948db552 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87242958b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:29.009392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-760f5000-257e-45d6-99a6-ddc7948db552 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.064831 Mar 29 02:12:29.011409 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 491/946] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:28 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:29.409221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:29.415627 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f66019e-f414-40b9-a705-51fbe63c3148 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1462 microversion: 2.1 time: 0.849561 Mar 29 02:12:29.428388 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 456/947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:28 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1462 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:29.435217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:29.436306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:29.447355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.450917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.450917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.450917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.454420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:29.455542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:29.467245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.468520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.470168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.471347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.841830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:29.865143 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-64c347ea-2deb-46ec-b2c4-adbf3f643484 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1613 microversion: 2.1 time: 0.433470 Mar 29 02:12:29.866775 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d48c55bd-19c3-4e48-ad56-06d4b3070e8f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 200 len: 1520 microversion: 2.1 time: 0.416792 Mar 29 02:12:29.868729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 492/948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:29 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1613 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:29.872679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 457/949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:29 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:29.899469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9833389-9dc2-4efd-a4f2-cea83e3064ac tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '.version_select at 0x7f87242958b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:29.901118 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:29.901118 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:29.903010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9833389-9dc2-4efd-a4f2-cea83e3064ac tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.903485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9833389-9dc2-4efd-a4f2-cea83e3064ac tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.914209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9833389-9dc2-4efd-a4f2-cea83e3064ac tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1561 microversion: 2.1 time: 0.021400 Mar 29 02:12:29.917263 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 493/950] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:12:29 2022] GET /compute/v2.1/os-migrations => generated 1561 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:29.960607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:29.962627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:29.974948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.976735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:29.981662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:29.983496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.029368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df1d9f88-cfbd-4030-87b2-39765c945f0f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87241cb310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:30.204420 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df1d9f88-cfbd-4030-87b2-39765c945f0f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.185317 Mar 29 02:12:30.205605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 494/951] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:30 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:30.214799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-104470420", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:30.425362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:12:30.466913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:30.476430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-17196ea2-b12e-4901-948b-929a9edbeac3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.520422 Mar 29 02:12:30.481020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 458/952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:29 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:30.484746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-78c84fa6-0347-4d4f-992e-32ec140e900e req-26524ba3-81d3-4e5c-a2fe-506b18afbc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229", "name": "network-vif-deleted", "tag": "3c0e7801-36d4-4fbe-b606-5d0668ea4fb4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:30.490728 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:30.490728 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:30.517839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-78c84fa6-0347-4d4f-992e-32ec140e900e req-26524ba3-81d3-4e5c-a2fe-506b18afbc9c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.522166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-78c84fa6-0347-4d4f-992e-32ec140e900e req-26524ba3-81d3-4e5c-a2fe-506b18afbc9c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.574842 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-78c84fa6-0347-4d4f-992e-32ec140e900e req-26524ba3-81d3-4e5c-a2fe-506b18afbc9c service nova] Creating event network-vif-deleted:3c0e7801-36d4-4fbe-b606-5d0668ea4fb4 for instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 on n-h2-828148-1 Mar 29 02:12:30.585484 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-78c84fa6-0347-4d4f-992e-32ec140e900e req-26524ba3-81d3-4e5c-a2fe-506b18afbc9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099952 Mar 29 02:12:30.588893 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 459/953] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:30.600981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-db951d0a-91b7-448a-bd05-d3afe26eea2e req-24def40a-07ca-4b6a-8617-a0f8cb091e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-plugged", "status": "completed", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:30.609693 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:30.609693 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:30.636190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db951d0a-91b7-448a-bd05-d3afe26eea2e req-24def40a-07ca-4b6a-8617-a0f8cb091e4b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.638789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db951d0a-91b7-448a-bd05-d3afe26eea2e req-24def40a-07ca-4b6a-8617-a0f8cb091e4b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.703960 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-db951d0a-91b7-448a-bd05-d3afe26eea2e req-24def40a-07ca-4b6a-8617-a0f8cb091e4b service nova] Creating event network-vif-plugged:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:12:30.754776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-db951d0a-91b7-448a-bd05-d3afe26eea2e req-24def40a-07ca-4b6a-8617-a0f8cb091e4b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161689 Mar 29 02:12:30.755403 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 460/954] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:30.891647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:30.893393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:30.915173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.917132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.920696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.921682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.963102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:12:30.963832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:12:30.964469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:12:30.965039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:12:30.976941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:12:30.976941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.976941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:30.978543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:30.979201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:31.010328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:12:31.022421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for user 035be210e94e4072b31cb011a5189ee4 and project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:12:31.036348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:12:31.039117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:12:31.063857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:31.064538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:31.065168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lazy-loading 'fault' on Instance uuid 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:31.150906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46f5514f-20ef-41d6-8e10-cf0eb91660ca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943764 Mar 29 02:12:31.152669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 495/955] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:12:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:12:31.173958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96e24860-b1ce-4585-bffb-6996f5e5f236 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:31.175484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96e24860-b1ce-4585-bffb-6996f5e5f236 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:31.261362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:31.268766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22995214-69f3-4093-8a9f-cf056816f50b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 200 len: 1312 microversion: 2.1 time: 0.387055 Mar 29 02:12:31.286089 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 461/956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:30 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:31.292290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37904829-ed44-4c00-b4dd-5fa359f321f8 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e55670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:31.310708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96e24860-b1ce-4585-bffb-6996f5e5f236 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:31.325076 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96e24860-b1ce-4585-bffb-6996f5e5f236 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1212 microversion: 2.1 time: 0.165763 Mar 29 02:12:31.330368 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 496/957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:31 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1212 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:31.494853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:31.496329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:31.506453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:31.507136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:31.508107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:31.508701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:31.785243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:31.796790 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c28f9a3e-eda8-459e-b7a7-78e33b5664cd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.305970 Mar 29 02:12:31.797412 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 497/958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:31 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:12:32.293786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:32.294549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:32.304713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.305633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.306804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.307501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.406155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] HTTP exception thrown: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. Mar 29 02:12:32.406973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 404 to user: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:32.408728 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac84ece9-fd12-432a-bff8-af608ae46569 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 404 len: 111 microversion: 2.1 time: 0.119664 Mar 29 02:12:32.411262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 498/959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:32 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:12:32.421802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:32.423490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:32.444143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.445176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.446323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.446975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.648341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:32.673232 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b1b3d58-5cd6-42e9-80ed-5eea19668c52 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1216 microversion: 2.1 time: 0.254624 Mar 29 02:12:32.673232 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 499/960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:32 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:32.677307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:32.681295 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:32.681295 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:32.682560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:32.683556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:32.689375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.689819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.704001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:32.704606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:32.811202 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c171762b-510e-4338-a019-5e3b64d4d341 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.140284 Mar 29 02:12:32.812192 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 500/961] 10.222.0.36 () {58 vars in 1229 bytes} [Tue Mar 29 02:12:32 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:12:32.823742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-875359804", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c5144d87-d7b6-4326-9ee3-ab094bc79cde"}], "security_groups": [{"name": "tempest-securitygroup--439637214"}], "key_name": "tempest-keypair-1289320101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2a430446-4def-4f9d-9b08-82cc363396c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:33.431037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] validate_networks() for [('c5144d87-d7b6-4326-9ee3-ab094bc79cde', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:12:34.753791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for project 49c2cea4684f4d06830d9a5464950077. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:12:34.760585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for user be981c23208b4fa09861adce9c9ef458 and project 49c2cea4684f4d06830d9a5464950077. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:12:34.776386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:12:34.776984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:12:34.777755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:12:34.778391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:12:34.778808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:12:34.811757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:34.814700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:34.818143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:34.821911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:34.878612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for project 49c2cea4684f4d06830d9a5464950077. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:12:34.887744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Getting quotas for user be981c23208b4fa09861adce9c9ef458 and project 49c2cea4684f4d06830d9a5464950077. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:12:35.047558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:12:35.050529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2a430446-4def-4f9d-9b08-82cc363396c4',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:12:36.771396 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cadb5756-46c6-4709-bd19-4cecbb4f0af0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.951034 Mar 29 02:12:36.771396 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 501/962] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:12:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 3952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:12:36.786276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:36.798900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:36.827006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:36.827385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:36.828187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:36.828626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:37.187855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37904829-ed44-4c00-b4dd-5fa359f321f8 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 5.900487 Mar 29 02:12:37.188461 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 462/963] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:31 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 5902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:37.213735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8afd08db-b706-4f03-b8d6-2534fbd54448 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:37.219040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8afd08db-b706-4f03-b8d6-2534fbd54448 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:37.230285 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8afd08db-b706-4f03-b8d6-2534fbd54448 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.038809 Mar 29 02:12:37.235880 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 463/964] 10.222.0.36 () {58 vars in 1181 bytes} [Tue Mar 29 02:12:37 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:12:37.242985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:37.248704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:37.272438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:37.279137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:37.283424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:37.284707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:37.830058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:37.839760 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05fd4833-9031-429f-a3a5-f8427524d4f1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 1.057227 Mar 29 02:12:37.840579 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 502/965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:36 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:37.859539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-626d1945-0c3d-4655-b590-280a15efc59c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:37.861726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-626d1945-0c3d-4655-b590-280a15efc59c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:38.028418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-626d1945-0c3d-4655-b590-280a15efc59c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:38.039907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-626d1945-0c3d-4655-b590-280a15efc59c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1121 microversion: 2.1 time: 0.188116 Mar 29 02:12:38.040493 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 503/966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:37 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1121 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:38.044747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.055220 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:38.055220 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:38.056976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:38.057967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:38.069811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.070246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.071056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.073794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.286190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:12:38.408165 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39639f95-a22c-4086-869c-741be783a8d5 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.366583 Mar 29 02:12:38.414794 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 504/967] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:38.420462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-256a5ac5-6698-4537-8b1a-5afdbc9d578d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724b8e700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.494780 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-256a5ac5-6698-4537-8b1a-5afdbc9d578d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.078242 Mar 29 02:12:38.496020 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 505/968] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:38.507807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.513523 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:38.513523 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:38.514948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:38.515571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.servers [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Removing options 'limit' from query {{(pid=103513) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1452}} Mar 29 02:12:38.516421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:38.524075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.524929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.525990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.530651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.812237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:12:38.839660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:38.853950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7452b5ff-60b5-4e11-a01b-270925806f28 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 1.616584 Mar 29 02:12:38.857183 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 464/969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:37 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:38.876245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.878046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:38.908260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.920666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.920666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:38.920666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:38.932594 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e5d4ef2-3865-42b3-aaed-975d8eafba6a tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.428820 Mar 29 02:12:38.933587 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 506/970] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:38.947325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccb435b1-0aac-4b84-8656-27e1eee9eb38 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.950887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccb435b1-0aac-4b84-8656-27e1eee9eb38 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:38.950887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ccb435b1-0aac-4b84-8656-27e1eee9eb38 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008023 Mar 29 02:12:38.955908 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 507/971] 10.222.0.36 () {58 vars in 1141 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:12:38.961663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5b82771-37dc-4cdc-889d-d9f208d88c6b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.963193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5b82771-37dc-4cdc-889d-d9f208d88c6b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:38.964141 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e5b82771-37dc-4cdc-889d-d9f208d88c6b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.007133 Mar 29 02:12:38.964952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 508/972] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:12:38.976076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e5c1989-04b5-4408-b649-3164460969ca tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:38.980483 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:38.980483 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:38.994011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e5c1989-04b5-4408-b649-3164460969ca tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:38.995430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e5c1989-04b5-4408-b649-3164460969ca tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:39.030959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.servers [None req-9e5c1989-04b5-4408-b649-3164460969ca tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Flavor 'non_existing_flavor' could not be found {{(pid=103513) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:339}} Mar 29 02:12:39.033490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e5c1989-04b5-4408-b649-3164460969ca tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.061063 Mar 29 02:12:39.043744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 509/973] 10.222.0.36 () {58 vars in 1177 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:12:39.049676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.064515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:39.064515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:39.071012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.071690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.072741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.074603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.277519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-52d9099d-873b-4b6a-bdc3-ca0ba8b5647d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.231484 Mar 29 02:12:39.287055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 510/974] 10.222.0.36 () {58 vars in 1173 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:12:39.293023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.293703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:39.302867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.306442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.306442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.306442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.462074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:39.473709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e476e69a-76f6-4c85-b5ac-a1f7f0a44264 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.615435 Mar 29 02:12:39.474777 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 465/975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:38 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:39.479278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.483140 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:39.483140 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:39.484686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:39.485679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:39.492494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.496419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.496419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.496419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.535696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:39.547413 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91f9b499-022b-43df-9290-5148e1392ba4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1171 microversion: 2.1 time: 0.258255 Mar 29 02:12:39.550289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 511/976] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1171 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:39.559830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20ef58f4-034e-47ae-a439-89618c33087a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724b8ef70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.683434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-418b7553-75f2-44a7-8d86-09e5fe0d6b57 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.207370 Mar 29 02:12:39.684147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 466/977] 10.222.0.36 () {58 vars in 1183 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:12:39.694077 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20ef58f4-034e-47ae-a439-89618c33087a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.141970 Mar 29 02:12:39.695576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 512/978] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:39.704053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.712495 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:39.712495 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:39.714200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:39.715273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:39.718919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-63604469-6844-4e8e-be26-78fde98d2d73 req-ee228b0f-6740-4e8f-8640-a6589d09f282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:39.721381 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:39.721381 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:39.738785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63604469-6844-4e8e-be26-78fde98d2d73 req-ee228b0f-6740-4e8f-8640-a6589d09f282 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.739231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63604469-6844-4e8e-be26-78fde98d2d73 req-ee228b0f-6740-4e8f-8640-a6589d09f282 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.755085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.761801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.764036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.764036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.803212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-63604469-6844-4e8e-be26-78fde98d2d73 req-ee228b0f-6740-4e8f-8640-a6589d09f282 service nova] Creating event network-changed:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h1-828148-1 Mar 29 02:12:39.826083 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-63604469-6844-4e8e-be26-78fde98d2d73 req-ee228b0f-6740-4e8f-8640-a6589d09f282 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131545 Mar 29 02:12:39.828282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 467/979] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:39.881442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:39.886343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:39.906660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.907362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:39.908317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:39.911624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:40.205571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:12:40.604813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:40.626203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:40.627986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:40.772795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:40.783766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4cc78cd-79e6-4339-989a-c8036bde251b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 0.912950 Mar 29 02:12:40.802422 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 468/980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:40.807822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:40.811682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:40.828023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:40.828606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:40.836285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:40.836285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:41.713488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:41.726838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c8233c1-1d06-411f-a0ea-bf6b47dd913d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 0.929078 Mar 29 02:12:41.729735 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 469/981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:40 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:41.738572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:41.739735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:41.765473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:41.765473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:41.765473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:41.765473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:41.892416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3ad4d7ec-ebf8-438f-a109-6cd4b1c67a37 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 2.195502 Mar 29 02:12:41.894389 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 513/982] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:12:39 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:41.911254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eff47336-93bb-41c7-9ff9-e8c61636492d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724baddc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:42.065557 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eff47336-93bb-41c7-9ff9-e8c61636492d tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.169343 Mar 29 02:12:42.067243 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 514/983] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:41 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:42.073083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:42.079747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:42.111347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.113503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.114534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.117500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.377874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:42.396087 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c20a43a-dd36-4d34-82b0-93e4aefbecb6 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1237 microversion: 2.1 time: 0.665016 Mar 29 02:12:42.400331 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 470/984] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:41 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1237 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:42.415338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-293a0668-a017-4f20-ba83-03fb25fc8c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:42.423284 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:42.423284 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:12:42.430247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-293a0668-a017-4f20-ba83-03fb25fc8c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:42.431549 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-293a0668-a017-4f20-ba83-03fb25fc8c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.020170 Mar 29 02:12:42.437152 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 471/985] 10.222.0.36 () {58 vars in 1177 bytes} [Tue Mar 29 02:12:42 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:12:42.448274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:42.454242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:42.461743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Searching by: {'deleted': False, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:12:42.467788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.471286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.472522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.476372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.690820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:12:42.859368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e61ae68-fe0f-4a39-b013-79c37606f987 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.415115 Mar 29 02:12:42.866166 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 472/986] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:12:42 2022] GET /compute/v2.1/servers => generated 681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:12:42.868870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:42.869600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:42.878101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.878615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.879924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:42.880366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:42.982813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:42.994422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8221347-4e28-48d4-a558-a1d74976b744 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 0.925704 Mar 29 02:12:43.000906 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 515/987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:42 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:43.012334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:43.013243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:43.034270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.035090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:43.036586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.037305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:43.213767 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] HTTP exception thrown: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. Mar 29 02:12:43.221435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 404 to user: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:43.223873 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-749ecfc7-e1c1-43ba-8b48-39d9fb4709a6 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 404 len: 111 microversion: 2.1 time: 0.221339 Mar 29 02:12:43.224603 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 516/988] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:12:43 2022] DELETE /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:12:43.245353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20e79692-43d1-4494-bd60-4e737b64d467 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724bad430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:43.393947 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20e79692-43d1-4494-bd60-4e737b64d467 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.162091 Mar 29 02:12:43.402759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 517/989] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:43 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:43.445162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:43.452617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:43.492678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.496281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:43.502927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.505889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:43.728776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:12:43.885556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:43.901521 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d133251-1672-4c40-a741-c61b570623f0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1497 microversion: 2.1 time: 1.038960 Mar 29 02:12:43.911987 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 473/990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:42 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1497 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:43.927534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:43.928323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:43.942701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.944646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:43.944935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:43.945533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:44.324739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-709cb1c1-860d-42b6-8114-8a9499cc8572 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "DELETE /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 204 len: 0 microversion: 2.1 time: 0.919854 Mar 29 02:12:44.325863 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 518/991] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:12:43 2022] DELETE /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:44.332655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:44.333551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:44.359547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:44.363707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:44.367362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:44.373183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:44.493748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:44.502925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01b00591-1d39-4167-86d1-19017d1092f4 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1237 microversion: 2.1 time: 0.588567 Mar 29 02:12:44.508933 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 474/992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:43 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1237 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:44.516393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:44.516922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:44.551168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:44.551629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:44.552420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:44.557089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:44.716454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:12:45.268120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-26752167-f96b-451c-b81c-32f67615406b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 204 len: 0 microversion: 2.1 time: 0.757560 Mar 29 02:12:45.272252 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 475/993] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:12:44 2022] DELETE /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 0 bytes in 760 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:12:45.278834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d53cda5-f56e-4435-971a-006f54b42708 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e55f70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:45.394721 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d53cda5-f56e-4435-971a-006f54b42708 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.121744 Mar 29 02:12:45.395309 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 476/994] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:45 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:45.404732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:45.412904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:45.444422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.444926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.445738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.446170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.571685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:45.586539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf661764-416f-4ca7-98e6-d8ab39fc13eb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 1.259192 Mar 29 02:12:45.595262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 519/995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:44 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:45.600820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:45.601859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:45.620721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.621606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.622805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.623474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.725953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] HTTP exception thrown: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. Mar 29 02:12:45.726905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 404 to user: Instance 2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:45.731126 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9cb4bf19-e2dc-49b4-8b32-95ac8babb472 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229" status: 404 len: 111 microversion: 2.1 time: 0.134563 Mar 29 02:12:45.732462 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 520/996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:45 2022] GET /compute/v2.1/servers/2ac7b2d4-f6a3-45f9-8bc2-421ab7a7c229 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:12:45.737039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:45.741579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:45.750908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:45.763689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94497fef-6ddc-401b-aa7c-d4232b071869 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 200 len: 1474 microversion: 2.1 time: 0.366868 Mar 29 02:12:45.765102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.765772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.766747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.767354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.776982 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 477/997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:45 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:45.789063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:45.799593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:45.808558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.809205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:45.810079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:45.811448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:46.313025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:46.323669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6f588de-e8cb-4de0-9110-f103f0e235f7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1304 microversion: 2.1 time: 0.589889 Mar 29 02:12:46.329329 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 521/998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:45 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1304 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:46.341785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1558691688"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:46.343037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:46.379888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:46.380797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:46.383004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:46.384082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:47.098921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:47.112605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efe174a3-6aec-4697-8640-6c9819fae19d tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1521 microversion: 2.1 time: 1.330488 Mar 29 02:12:47.146029 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 478/999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:45 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1521 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:47.185561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77f4575e-e775-42af-afaf-b45f7d432dc2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724d6d790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:47.362290 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77f4575e-e775-42af-afaf-b45f7d432dc2 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.214813 Mar 29 02:12:47.371537 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 479/1000] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:47 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:47.386351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:47.387270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:47.405220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:47.406932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:47.408332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:47.411508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:47.747030 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1fcddd2-5692-4111-a284-e2ec8209f36c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7/action" status: 202 len: 0 microversion: 2.1 time: 1.410921 Mar 29 02:12:47.754815 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 522/1001] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:12:46 2022] POST /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7/action => generated 0 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:12:47.760184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:47.760938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:47.786804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:47.787252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:47.790748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:47.794488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:48.353890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:48.376719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f094ee4-87b9-4506-af44-443d604df50c tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.620471 Mar 29 02:12:48.381661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 523/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:47 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:48.400644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4add75df-d373-4db1-aea8-29fa992ecca3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b99ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:48.493431 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4add75df-d373-4db1-aea8-29fa992ecca3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.107414 Mar 29 02:12:48.494259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 524/1003] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:48 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:48.500896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:48.505082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:48.524134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:48.525000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:48.526216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:48.526773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:48.946231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:48.961442 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dea164e9-1095-4ac8-9eaa-1f080bcf17c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 1.587532 Mar 29 02:12:48.962204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 480/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:47 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:48.966458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-068cf6d3-f20b-4c6d-92ea-19aaac017934 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87244645e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:49.071950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-068cf6d3-f20b-4c6d-92ea-19aaac017934 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.108665 Mar 29 02:12:49.078307 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 481/1005] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:48 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:49.338780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:49.364404 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa24ddd4-5a8a-4d02-ac63-91f37c781c66 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1521 microversion: 2.1 time: 0.868952 Mar 29 02:12:49.367012 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 525/1006] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:48 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1521 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:49.398925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:49.399594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:49.420372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:49.420738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:49.430217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:49.430915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:49.508234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f362d461-b713-4177-bf57-4a4fe6d2e061 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724bad1f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:49.592475 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f362d461-b713-4177-bf57-4a4fe6d2e061 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.087319 Mar 29 02:12:49.594548 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 526/1007] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:49 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:49.979298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:49.980350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:49.995081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:49.996528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:50.000027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:50.002527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:50.492213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:50.513447 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df12b825-5e46-4a2b-8a1b-e40508aaddc9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 0.527765 Mar 29 02:12:50.513447 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 527/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:49 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:50.518486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ddd7750-55dd-48a2-8e77-594585089a64 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724bad160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:50.626866 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ddd7750-55dd-48a2-8e77-594585089a64 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.121957 Mar 29 02:12:50.628069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 528/1009] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:50 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:50.635276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:50.636148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:50.645293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:50.646105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:50.647094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:50.648264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:50.873323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:50.885590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-624128c2-1814-491d-94b2-62e323163786 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1479 microversion: 2.1 time: 0.256313 Mar 29 02:12:50.897967 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 529/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:50 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1479 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:50.903289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7bbebff6-a8d4-478e-8d71-2d3de8766ed6 req-ea85f832-92ff-460d-b376-fd5fe6905d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "name": "network-vif-plugged", "status": "completed", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:50.911945 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:50.911945 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:50.914326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7bbebff6-a8d4-478e-8d71-2d3de8766ed6 req-ea85f832-92ff-460d-b376-fd5fe6905d6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:50.915025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7bbebff6-a8d4-478e-8d71-2d3de8766ed6 req-ea85f832-92ff-460d-b376-fd5fe6905d6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:50.976718 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7bbebff6-a8d4-478e-8d71-2d3de8766ed6 req-ea85f832-92ff-460d-b376-fd5fe6905d6f service nova] Creating event network-vif-plugged:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h1-828148-1 Mar 29 02:12:50.988011 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7bbebff6-a8d4-478e-8d71-2d3de8766ed6 req-ea85f832-92ff-460d-b376-fd5fe6905d6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088529 Mar 29 02:12:50.991983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 530/1011] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:51.012885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-300e54fe-52f4-4713-8ec8-bb64cbb26dcb tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b990d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:51.159194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-300e54fe-52f4-4713-8ec8-bb64cbb26dcb tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.165924 Mar 29 02:12:51.160726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 531/1012] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:50 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:51.166161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5427a7db-deb0-42ed-99a5-e1430ea3ce8e req-10e8deea-e2e8-462e-b5e0-6db8e2fa7dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "359583e9-8ed5-4f16-a82e-4bc1b6c6cac3", "name": "network-vif-deleted", "tag": "51532724-78e3-4ed8-b5dc-3f72372a05a1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:51.171934 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:51.171934 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:51.193233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5427a7db-deb0-42ed-99a5-e1430ea3ce8e req-10e8deea-e2e8-462e-b5e0-6db8e2fa7dcf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:51.197422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5427a7db-deb0-42ed-99a5-e1430ea3ce8e req-10e8deea-e2e8-462e-b5e0-6db8e2fa7dcf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:51.221273 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5427a7db-deb0-42ed-99a5-e1430ea3ce8e req-10e8deea-e2e8-462e-b5e0-6db8e2fa7dcf service nova] Creating event network-vif-deleted:51532724-78e3-4ed8-b5dc-3f72372a05a1 for instance 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 on n-h1-828148-1 Mar 29 02:12:51.227373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5427a7db-deb0-42ed-99a5-e1430ea3ce8e req-10e8deea-e2e8-462e-b5e0-6db8e2fa7dcf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064212 Mar 29 02:12:51.227986 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 532/1013] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:51.344322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:51.359516 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6dcc784-04ee-4662-92c0-7828f803d42d tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 1.964520 Mar 29 02:12:51.376945 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 482/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:49 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:51.522658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:51.524014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:51.533281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:51.534002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:51.535506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:51.536105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:51.640583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64c2d2f6-6595-4ea2-9fd4-665efde87df4 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724d6d430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:51.868008 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64c2d2f6-6595-4ea2-9fd4-665efde87df4 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1428 microversion: 2.1 time: 0.232084 Mar 29 02:12:51.868803 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 483/1015] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:51 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1428 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:51.903697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:51.904596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:51.924823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:51.927747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:51.930427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:51.934705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:52.161782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:52.162226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:52.162682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lazy-loading 'fault' on Instance uuid 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:12:52.596168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:52.607551 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c09979be-5e16-4537-9432-2cf90b251ffd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1312 microversion: 2.1 time: 1.091446 Mar 29 02:12:52.626405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62774a07593a48118dca823e480d5ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0273fd4bb30f4e4799f3d95f575d2e9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:52.640974 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 533/1016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:51 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1312 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:52.642736 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09cfe5d6-da60-46ab-a884-530a324ee903 tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 200 len: 1312 microversion: 2.1 time: 0.743290 Mar 29 02:12:52.647653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 484/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:51 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 1312 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:52.650924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e0ee804-446d-4b42-b3e8-e8b6c51af2d9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b99f70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:52.664248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:52.666276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:52.703384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:52.704111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:52.708276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:52.708965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:53.362574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:53.372605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f79dcb44-38cc-45c1-b13c-6ef6b930f70a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.723550 Mar 29 02:12:53.376380 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 485/1018] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:52 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:53.389119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aef13dbd-0baf-4707-813f-cd40dc4c8d7c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724d4d430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:55.931325 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e0ee804-446d-4b42-b3e8-e8b6c51af2d9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 3.288722 Mar 29 02:12:55.932314 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 534/1019] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:52 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 3290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:55.945258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f63f1d-d440-449c-97bc-3b353195a7df", "name": "network-vif-deleted", "tag": "693c5807-2028-4104-9515-c798153c42ac"}, {"name": "network-changed", "server_uuid": "520780dc-8aef-448a-8738-ed70f20f4d98", "tag": "1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:55.962085 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aef13dbd-0baf-4707-813f-cd40dc4c8d7c tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1437 microversion: 2.1 time: 2.583582 Mar 29 02:12:55.963473 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 486/1020] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:53 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1437 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:55.965334 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:55.965334 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:55.978179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:55.979127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:55.995592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.002169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.003003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.003857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.004911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.008955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.036707 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] Creating event network-vif-deleted:693c5807-2028-4104-9515-c798153c42ac for instance 17f63f1d-d440-449c-97bc-3b353195a7df on n-h2-828148-1 Mar 29 02:12:56.042383 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] Creating event network-changed:1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2 for instance 520780dc-8aef-448a-8738-ed70f20f4d98 on n-h1-828148-1 Mar 29 02:12:56.063579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1f6d797d-1d41-4e3a-8ce1-f2f5d84a37ef req-8fea5648-d6d0-429b-8db7-716d39a821a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.120688 Mar 29 02:12:56.063579 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 535/1021] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:56.063579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:56.063579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:56.078397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.080019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.081584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.090285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.186245 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] HTTP exception thrown: Instance 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 could not be found. Mar 29 02:12:56.190889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 404 to user: Instance 359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:56.193252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0813ceae-df16-4b4e-ae50-75780fca405f tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3" status: 404 len: 111 microversion: 2.1 time: 0.133631 Mar 29 02:12:56.197495 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 536/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:56 2022] GET /compute/v2.1/servers/359583e9-8ed5-4f16-a82e-4bc1b6c6cac3 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:12:56.209040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:56.209673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:56.234963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.237116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.238564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.239023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.786068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:56.800919 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9b27e5c-f338-4dbd-ad85-883a37a84d16 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.601746 Mar 29 02:12:56.801911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 537/1023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:56 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:56.812180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70dbe544-b2c4-4a9e-b109-569c812fdbba tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8724bad280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:56.908272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70dbe544-b2c4-4a9e-b109-569c812fdbba tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 200 len: 1437 microversion: 2.1 time: 0.102595 Mar 29 02:12:56.913972 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 538/1024] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:56 2022] GET /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 1437 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:56.927491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:56.928370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] [instance: 17f63f1d-d440-449c-97bc-3b353195a7df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:56.943438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.945263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.947468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:56.948203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:56.954059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:56.977476 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6945c5f4-0cbe-4253-9a84-ee547bea2de9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1462 microversion: 2.1 time: 1.008797 Mar 29 02:12:56.997197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 487/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:55 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1462 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:57.007487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:57.008095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:57.017009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] HTTP exception thrown: Instance 17f63f1d-d440-449c-97bc-3b353195a7df could not be found. Mar 29 02:12:57.017642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] Returning 404 to user: Instance 17f63f1d-d440-449c-97bc-3b353195a7df could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:12:57.019314 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1292c279-0f68-4829-9424-6db85985f10b tempest-ListServersNegativeTestJSON-114112689 tempest-ListServersNegativeTestJSON-114112689-project] 10.222.0.36 "GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df" status: 404 len: 111 microversion: 2.1 time: 0.103324 Mar 29 02:12:57.020421 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 539/1026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:56 2022] GET /compute/v2.1/servers/17f63f1d-d440-449c-97bc-3b353195a7df => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:12:57.038080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eacbd36b-0caf-427d-8349-590bc363cbf5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b993a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:57.052872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.058984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.061939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.065197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.131016 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eacbd36b-0caf-427d-8349-590bc363cbf5 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.109337 Mar 29 02:12:57.131944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 540/1027] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:57 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:57.138387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:57.144798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:57.170107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.170597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.171470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.171972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.337502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:57.357314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Old instance type m1.heat2, new instance type m1.heat {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:12:57.370832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:12:57.371263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:12:57.371738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:12:57.372155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:12:57.372569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:12:57.850524 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af07a871-0076-46d2-ab96-802aa165229c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d/action" status: 202 len: 0 microversion: 2.1 time: 0.717141 Mar 29 02:12:57.857859 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 541/1028] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:12:57 2022] POST /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:12:57.869896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-88485fd4-7692-421a-ad11-33b2d38e3aca req-e7397207-a120-416c-8e8b-01b7fffb2ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2c33f9-e618-4d44-88ca-1c4828670ea7", "name": "network-vif-plugged", "status": "completed", "tag": "24f54f47-ae93-4415-8b00-b834c87cc5c7"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:12:57.879166 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:12:57.879166 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:12:57.906347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-88485fd4-7692-421a-ad11-33b2d38e3aca req-e7397207-a120-416c-8e8b-01b7fffb2ec9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.906798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-88485fd4-7692-421a-ad11-33b2d38e3aca req-e7397207-a120-416c-8e8b-01b7fffb2ec9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.934550 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-88485fd4-7692-421a-ad11-33b2d38e3aca req-e7397207-a120-416c-8e8b-01b7fffb2ec9 service nova] Creating event network-vif-plugged:24f54f47-ae93-4415-8b00-b834c87cc5c7 for instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 on n-h2-828148-1 Mar 29 02:12:57.951190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-88485fd4-7692-421a-ad11-33b2d38e3aca req-e7397207-a120-416c-8e8b-01b7fffb2ec9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091725 Mar 29 02:12:57.951885 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 542/1029] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:12:57.957333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:57.958411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:57.971364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.972364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:57.973190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:57.979511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:58.486368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:58.496473 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae90b54c-c52f-4a76-9ab2-2e2c633cca02 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.543480 Mar 29 02:12:58.509586 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 543/1030] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:57 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:58.515704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:58.516336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:12:58.537101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:58.537803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:58.538752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:12:58.540000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:12:59.101557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:59.113142 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ba500dd-f92e-46f8-b713-7fd89f7d8f2a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1471 microversion: 2.1 time: 0.602124 Mar 29 02:12:59.115554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 544/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:58 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:59.120347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe9dcb28-3262-4b4e-b8db-1193d60bff88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724badb80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:12:59.126492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:12:59.144695 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9db6b0e7-ce7b-4bde-b0ed-b5f1b185daa5 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1467 microversion: 2.1 time: 2.146291 Mar 29 02:12:59.161038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 488/1032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:56 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1467 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:12:59.166364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c84371d7-5ff3-4d37-af2b-41aadb141fcd tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f8717e94dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:01.896069 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c84371d7-5ff3-4d37-af2b-41aadb141fcd tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "DELETE /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e" status: 204 len: 0 microversion: 2.1 time: 2.733559 Mar 29 02:13:01.897704 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 489/1033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:12:59 2022] DELETE /compute/v2.1/images/9742cd1a-3fb1-4c0c-a851-8d599c29ec2e => generated 0 bytes in 2736 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:01.914017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:01.934324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:01.950830 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe9dcb28-3262-4b4e-b8db-1193d60bff88 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 2.833967 Mar 29 02:13:01.952349 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 545/1034] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:12:59 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 2836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:01.970414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1452157454", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2a492824-76d3-4dc8-9d37-f81c1b4928a3"}], "block_device_mapping_v2": [{"uuid": "e8f27beb-c335-4d0a-a792-678fb267ba5b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:01.972560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:01.974782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:01.980042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:01.981993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:02.152808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] validate_networks() for [('2a492824-76d3-4dc8-9d37-f81c1b4928a3', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:13:03.051006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:13:03.051653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:13:03.052247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:13:03.054583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:13:03.054583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:13:03.054881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:03.064182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:03.064738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:03.065700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:03.066235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:03.066702 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6999ddee-fa2f-4fe0-8e3a-8436fc020824 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 1.166629 Mar 29 02:13:03.067289 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 490/1035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:01 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:03.080314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:03.085432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:03.087675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:03.099912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Getting quotas for user f540281478cf4d929afbce240e2f4c66 and project 911013484e864ba6a9a60a8d7198fb7c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:03.102251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:03.102711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:03.103511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:03.103951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:03.328776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:13:03.332545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8f27beb-c335-4d0a-a792-678fb267ba5b',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:13:03.894349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:03.915272 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18d7c17c-7b09-49d7-b621-4073665fa8b3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1471 microversion: 2.1 time: 0.845237 Mar 29 02:13:03.916116 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 491/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:03 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1471 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:03.930433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a61e3ff4-de26-4ad0-9d6f-a6a5b99c54b0 req-48c203ea-b68e-47bc-bf00-8155438c5512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-unplugged", "status": "completed", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:03.932390 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:03.932390 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:03.941186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a61e3ff4-de26-4ad0-9d6f-a6a5b99c54b0 req-48c203ea-b68e-47bc-bf00-8155438c5512 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:03.941869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a61e3ff4-de26-4ad0-9d6f-a6a5b99c54b0 req-48c203ea-b68e-47bc-bf00-8155438c5512 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:03.960931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a61e3ff4-de26-4ad0-9d6f-a6a5b99c54b0 req-48c203ea-b68e-47bc-bf00-8155438c5512 service nova] Creating event network-vif-unplugged:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:13:03.966637 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a61e3ff4-de26-4ad0-9d6f-a6a5b99c54b0 req-48c203ea-b68e-47bc-bf00-8155438c5512 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039843 Mar 29 02:13:03.972979 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 492/1037] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:03.978675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d33ada13-6c83-4593-9420-bfe497fea238 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '.version_select at 0x7f87243448b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:03.998422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00c39e3f-c81e-44e7-ad03-32537990ad23 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.043498 Mar 29 02:13:04.004617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 546/1038] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2046 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:13:04.014935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54b98833-47e3-4bd1-8143-dcb66bd340ba tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b8ef70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:04.219084 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d33ada13-6c83-4593-9420-bfe497fea238 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] HTTP exception thrown: Image not found. Mar 29 02:13:04.219898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d33ada13-6c83-4593-9420-bfe497fea238 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:04.221082 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d33ada13-6c83-4593-9420-bfe497fea238 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "DELETE /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e" status: 404 len: 62 microversion: 2.1 time: 0.246374 Mar 29 02:13:04.224734 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 493/1039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:03 2022] DELETE /compute/v2.1/images/540330fb-0192-4a7e-9366-0e7bc2eb9f2e => generated 62 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:13:04.227221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:04.231641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:04.239207 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54b98833-47e3-4bd1-8143-dcb66bd340ba tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.236531 Mar 29 02:13:04.240379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 547/1040] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:04 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:04.259356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:04.259896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:04.275891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.276351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:04.288033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.288850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:04.422133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:04.430593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:04.432097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:04.433212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b598b805-8b9e-4dcd-a118-799211cb5272 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1104 microversion: 2.25 time: 0.209957 Mar 29 02:13:04.433778 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 494/1041] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:04 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1104 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:04.448919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:04.449428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:04.467017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.467468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:04.468247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.468682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:04.599482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:13:04.734398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:04.747097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f1c8a9a-a049-4ed5-8422-abdc16fb3aa3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.505341 Mar 29 02:13:04.749865 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 548/1042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:04 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:04.932823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:04.934242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:04.956814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.958324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:04.959375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:04.960392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.040537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32d48806-d976-4c9a-9edd-41915ae45d4e tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 204 len: 0 microversion: 2.1 time: 0.605469 Mar 29 02:13:05.041169 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 495/1043] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:04 2022] DELETE /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:05.050429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:05.051150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:05.090712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.094424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.101946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.102426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.353200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:05.372019 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0223e808-1e5f-4008-bff0-016844197b61 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1471 microversion: 2.1 time: 0.443361 Mar 29 02:13:05.383185 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 549/1044] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:04 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1471 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:05.388633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65291190-bf7d-4c84-bb1d-f60107fa198e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724bad820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:05.479761 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65291190-bf7d-4c84-bb1d-f60107fa198e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.095052 Mar 29 02:13:05.480944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 550/1045] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:05 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:05.485768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:05.486578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:05.495820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.496598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.497738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.498355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.558642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:05.570752 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff0c833e-83c2-4529-b2e6-c99d0455522f tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1473 microversion: 2.1 time: 0.524361 Mar 29 02:13:05.571339 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 496/1046] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:05 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1473 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:05.699188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:05.711928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:05.717935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:05.723171 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ffbc3c89-b211-43eb-99a9-e9d50414cd36 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1185 microversion: 2.25 time: 0.240972 Mar 29 02:13:05.730836 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 551/1047] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:05 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1185 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:05.765958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:05.770661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:05.780706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.781359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:05.789202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:05.789878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.223401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.233767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a5b8f90-1678-49a0-8558-8efe66a46f84 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.471500 Mar 29 02:13:06.236113 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 497/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:05 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:06.390539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:06.391307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:06.406547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.411926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.413131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.413658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.493415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-97b37436-e700-46ff-8580-b9ef9b0792f7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717d57430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:06.597467 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-97b37436-e700-46ff-8580-b9ef9b0792f7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.107738 Mar 29 02:13:06.599023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 498/1049] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:06 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:06.604795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:06.606095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:06.620455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.622952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.624406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.627252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.757952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.770934 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eee796ec-fd70-4cd1-b4cc-0174345d38fa tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1476 microversion: 2.1 time: 0.383695 Mar 29 02:13:06.773316 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 552/1050] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:06 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1476 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:06.778448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:06.779728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:06.788261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.789098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.790592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:06.791378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:06.922240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.931791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.933471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.934596 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8663c145-99ed-4e99-8bac-b5a7e26bc2ca tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1233 microversion: 2.25 time: 0.160086 Mar 29 02:13:06.935916 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 553/1051] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:06 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1233 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:06.945340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:06.955701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a07340b6-37c4-4f42-ab14-c8dd8d51361a tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1473 microversion: 2.1 time: 0.355163 Mar 29 02:13:06.956732 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 499/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:06 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1473 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:07.250775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:07.251584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:07.305025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:07.306032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:07.307119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:07.307716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:07.613144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-75f66e2c-2617-4417-a6fe-214ece2675d8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e9ee0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:07.741708 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-75f66e2c-2617-4417-a6fe-214ece2675d8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.132710 Mar 29 02:13:07.742816 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 500/1053] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:07 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:07.790329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:07.791628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:07.807063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:07.809418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:07.810486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:07.812114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:08.188240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:08.204679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c5b59ef-dcc8-4fd6-a1a3-a0d26dfb69cc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.956056 Mar 29 02:13:08.205213 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 554/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:07 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:08.217702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:08.218159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:08.239021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:08.239505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:08.241668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:08.242019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:08.510358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:08.524885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:08.529633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:08.532482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6c74478-c371-4f2d-a829-4e265be6b313 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1251 microversion: 2.25 time: 0.323211 Mar 29 02:13:08.540349 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 555/1055] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:08 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1251 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:08.553789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:08.554579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:08.573235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:08.573924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:08.577592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:08.578257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:09.762648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:09.772801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e580eb9-56d0-46fc-b404-fcd0bfd7a176 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1473 microversion: 2.1 time: 1.229257 Mar 29 02:13:09.782179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 556/1056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:08 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1473 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:09.787278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f06ce5a6-3436-4c97-bbc7-92d0f612e4cc tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724bad3a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:09.880435 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f06ce5a6-3436-4c97-bbc7-92d0f612e4cc tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.094527 Mar 29 02:13:09.881333 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 557/1057] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:09 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:09.891224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0f78a4de-bb3e-4ffc-a6e1-805048e8f329 req-a2b98d40-b717-458d-8035-228e2144ac01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520780dc-8aef-448a-8738-ed70f20f4d98", "name": "network-vif-plugged", "status": "completed", "tag": "1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:09.896876 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:09.896876 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:09.917483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0f78a4de-bb3e-4ffc-a6e1-805048e8f329 req-a2b98d40-b717-458d-8035-228e2144ac01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:09.918160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0f78a4de-bb3e-4ffc-a6e1-805048e8f329 req-a2b98d40-b717-458d-8035-228e2144ac01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:09.955653 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0f78a4de-bb3e-4ffc-a6e1-805048e8f329 req-a2b98d40-b717-458d-8035-228e2144ac01 service nova] Creating event network-vif-plugged:1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2 for instance 520780dc-8aef-448a-8738-ed70f20f4d98 on n-h1-828148-1 Mar 29 02:13:09.967732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0f78a4de-bb3e-4ffc-a6e1-805048e8f329 req-a2b98d40-b717-458d-8035-228e2144ac01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084330 Mar 29 02:13:09.969086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 558/1058] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:09.977616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:09.981672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:09.983483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:09.990102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-879d4d33-3af0-4d78-8d73-426c529712d3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1476 microversion: 2.1 time: 2.200672 Mar 29 02:13:10.001819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 501/1059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:07 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1476 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:10.004585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:10.009815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:10.011626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.012637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.017987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.018735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.050411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.056716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.060012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.060481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.461011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:10.472327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:10.487382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:10.491284 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a572ec94-2096-46ca-9be3-5c55c66e9ee5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1251 microversion: 2.25 time: 0.497082 Mar 29 02:13:10.494622 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 502/1060] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:09 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1251 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:10.657167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:10.675348 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-357bd731-17c9-4b9c-87a5-e103f9b4024f tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1292 microversion: 2.1 time: 0.704814 Mar 29 02:13:10.678413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 559/1061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:09 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1292 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:10.788561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:10.789231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:10.808226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.808704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.809679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:10.813087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:10.896109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac84f4d2-c41b-40e4-89cd-10af9c088fce tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b09280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:11.027487 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac84f4d2-c41b-40e4-89cd-10af9c088fce tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.136719 Mar 29 02:13:11.028145 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 560/1062] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:10 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:11.040648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:11.052143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:11.099213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:11.100198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:11.105642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:11.108875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:11.366895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:13:12.238805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ac9ed4e-7b2b-4f70-9266-a0a200ffeffd tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 204 len: 0 microversion: 2.1 time: 1.208458 Mar 29 02:13:12.241789 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 561/1063] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:11 2022] DELETE /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 0 bytes in 1211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:12.260040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:12.267636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:12.277202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e9dae8006744e15b9529cbda35d9742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227324fd625649afb3baa16a37f3b4ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:12.287749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:12.288204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:12.290157 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a095a7e-ae75-4ba8-8a1a-42e9dc48cf68 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 200 len: 1431 microversion: 2.1 time: 1.505164 Mar 29 02:13:12.291557 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 503/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:10 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 1431 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:12.296457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:12.298628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:12.302600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-89ff1efb-063e-4fdd-b0d9-ffc20821ad33 req-197fe4b6-a79f-484d-a7ce-f6e79565e34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db57f5f0-fbf8-4b71-9c24-a7f603bade5b", "name": "network-vif-deleted", "tag": "5d866414-2a91-4fef-a24a-2fcd71eeac9b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:12.307285 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:12.307285 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:12.321498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-89ff1efb-063e-4fdd-b0d9-ffc20821ad33 req-197fe4b6-a79f-484d-a7ce-f6e79565e34b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:12.323570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-89ff1efb-063e-4fdd-b0d9-ffc20821ad33 req-197fe4b6-a79f-484d-a7ce-f6e79565e34b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:12.402048 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-89ff1efb-063e-4fdd-b0d9-ffc20821ad33 req-197fe4b6-a79f-484d-a7ce-f6e79565e34b service nova] Creating event network-vif-deleted:5d866414-2a91-4fef-a24a-2fcd71eeac9b for instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b on n-h1-828148-1 Mar 29 02:13:12.450708 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-89ff1efb-063e-4fdd-b0d9-ffc20821ad33 req-197fe4b6-a79f-484d-a7ce-f6e79565e34b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157506 Mar 29 02:13:12.469501 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 504/1065] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:12.505840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:12.510376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:12.585473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:12.589050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:12.590371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:12.598582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:13.743204 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:13:13.962134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:13.973202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:13.984374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:13.986808 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4389fae7-c308-483b-9cfe-06848b77b126 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1293 microversion: 2.25 time: 1.515715 Mar 29 02:13:13.995279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 505/1066] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:12 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1293 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:14.000261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:14.001627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:14.020556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:14.027240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:14.028407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:14.029090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:14.760932 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51632. Mar 29 02:13:15.092276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:15.104889 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-681fd44f-9161-4365-bc20-8a7f6d987b0a tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1483 microversion: 2.1 time: 1.107948 Mar 29 02:13:15.119094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 506/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:13 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1483 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:15.125345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b435e2a-ce1c-422a-a95a-40c92a148514 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724d4d670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:16.107563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:16.127485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-666d1914-0334-4b2a-9b16-129c4311240e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1476 microversion: 2.1 time: 3.886014 Mar 29 02:13:16.128280 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 562/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:12 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1476 bytes in 3888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:16.139890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:16.141870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:16.163178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:16.164530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:16.171514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:16.174322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:17.263603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b435e2a-ce1c-422a-a95a-40c92a148514 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 2.142951 Mar 29 02:13:17.272902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 507/1069] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:15 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:17.281382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:17.284442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] [instance: db57f5f0-fbf8-4b71-9c24-a7f603bade5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:17.299272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:17.301609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:17.303844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:17.304746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:17.399169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] HTTP exception thrown: Instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b could not be found. Mar 29 02:13:17.400731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] Returning 404 to user: Instance db57f5f0-fbf8-4b71-9c24-a7f603bade5b could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:17.402023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ceae4184-8823-4255-b35d-119e85a55776 tempest-ImagesOneServerTestJSON-1346842520 tempest-ImagesOneServerTestJSON-1346842520-project] 10.222.0.36 "GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b" status: 404 len: 111 microversion: 2.1 time: 0.127517 Mar 29 02:13:17.406177 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 508/1070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:17 2022] GET /compute/v2.1/servers/db57f5f0-fbf8-4b71-9c24-a7f603bade5b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:17.422730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:17.424593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:17.434824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:17.435559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:17.436661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:17.437273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:18.425720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:18.445646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f1bdcd7-78b1-42a5-ad22-74618436c9b1 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1713 microversion: 2.1 time: 2.315254 Mar 29 02:13:18.448608 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 563/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:16 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1713 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:18.458879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:18.467083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:18.487875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:18.497946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:18.499551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:18.501671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:18.646552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:18.667162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:18.672984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:18.675635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b10dc3c8-47b7-428e-8287-f68a554e86d1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 1.267539 Mar 29 02:13:18.686221 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 509/1072] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:17 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:18.698509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:18.700738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:18.723851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:18.724586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:18.727133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:18.727766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:19.521114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:19.549764 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51538f30-c8ec-4bb0-8819-f286d9ea9caf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1476 microversion: 2.1 time: 0.862169 Mar 29 02:13:19.551335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 510/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:18 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1476 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:19.556762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8a1e1992-36c3-470a-bc55-8f3d4eedc1bf req-6245b9e6-0ef2-48d0-aa58-b221fd588f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7db09098-69b0-495f-86a0-79d8872dda7a", "tag": "7edd29b1-467e-4ce7-86eb-abe21b84f0ad"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:19.560799 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:19.560799 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:19.570788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8a1e1992-36c3-470a-bc55-8f3d4eedc1bf req-6245b9e6-0ef2-48d0-aa58-b221fd588f1b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:19.573186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8a1e1992-36c3-470a-bc55-8f3d4eedc1bf req-6245b9e6-0ef2-48d0-aa58-b221fd588f1b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:19.599901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8a1e1992-36c3-470a-bc55-8f3d4eedc1bf req-6245b9e6-0ef2-48d0-aa58-b221fd588f1b service nova] Creating event network-changed:7edd29b1-467e-4ce7-86eb-abe21b84f0ad for instance 7db09098-69b0-495f-86a0-79d8872dda7a on n-h2-828148-1 Mar 29 02:13:19.606502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8a1e1992-36c3-470a-bc55-8f3d4eedc1bf req-6245b9e6-0ef2-48d0-aa58-b221fd588f1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053396 Mar 29 02:13:19.611114 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 511/1074] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:19.618549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad61b3f3-c68b-42df-8495-84f71056c4b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87242e9280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:19.695861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad61b3f3-c68b-42df-8495-84f71056c4b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1412 microversion: 2.1 time: 0.082530 Mar 29 02:13:19.707397 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 512/1075] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:19 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:19.710463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:19.711534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:19.723013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:19.724280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:19.725353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:19.726548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:19.745692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e821f224-c249-445d-a502-0bc93cae6ccc tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.295664 Mar 29 02:13:19.746873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 564/1076] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:13:18 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98/os-interface => generated 284 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:19.751772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:19.752554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:19.778645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:19.779467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:19.787582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:19.787582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:20.180651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:20.197530 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47eec2d8-8ef3-4050-90a7-1c70342e3625 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1645 microversion: 2.1 time: 0.487181 Mar 29 02:13:20.205256 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 513/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:19 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1645 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:20.570867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:20.571484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:20.582830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:20.583670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:20.584696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:20.585376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:21.540081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:21.561808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:21.566300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:21.582530 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8672909e-0c9f-40ec-a93a-becea360f05c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 1.833094 Mar 29 02:13:21.589619 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 565/1078] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:19 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:21.593120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82c9cf6a-e001-4222-9f48-4d69619025cf tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b8e3a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:21.711544 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82c9cf6a-e001-4222-9f48-4d69619025cf tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1421 microversion: 2.1 time: 0.124317 Mar 29 02:13:21.712408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 566/1079] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:21 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:21.725552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:21.727988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:21.752468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:21.753255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:21.758672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:21.759366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:22.116276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b089ffbf4fe383c220193a34341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce6234d4e0a44db988a8b7e7cef1cc16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:22.125465 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5b718c3-2c52-4055-abef-dcadfa64932c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 200 len: 1645 microversion: 2.1 time: 0.410000 Mar 29 02:13:22.141803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 567/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:21 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 1645 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:22.150492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6210473d-4935-453a-928d-dc2507d5cfaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b99d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:22.294094 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6210473d-4935-453a-928d-dc2507d5cfaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 200 len: 1421 microversion: 2.1 time: 0.150568 Mar 29 02:13:22.295094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 568/1081] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:22 2022] GET /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:22.306957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d7edc12-9a15-404d-9e91-6323d2a09e3f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724bad280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:22.571397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:22.588382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e5971db-808b-476c-9c94-f37552121601 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1476 microversion: 2.1 time: 2.021354 Mar 29 02:13:22.603086 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 514/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:20 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1476 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:22.635247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ae16fec0-2a66-4cba-871b-02690885c5d4 req-8b80b58d-91a4-4364-bf97-46ecb4ef668d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea0b0148-e275-4810-9e65-e920f042fb19", "name": "network-vif-deleted", "tag": "ed935824-c6c3-495d-b51c-95809d05e46c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:22.643646 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:22.643646 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:22.721205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ae16fec0-2a66-4cba-871b-02690885c5d4 req-8b80b58d-91a4-4364-bf97-46ecb4ef668d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:22.725164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ae16fec0-2a66-4cba-871b-02690885c5d4 req-8b80b58d-91a4-4364-bf97-46ecb4ef668d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:22.838430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ae16fec0-2a66-4cba-871b-02690885c5d4 req-8b80b58d-91a4-4364-bf97-46ecb4ef668d service nova] Creating event network-vif-deleted:ed935824-c6c3-495d-b51c-95809d05e46c for instance ea0b0148-e275-4810-9e65-e920f042fb19 on n-h2-828148-1 Mar 29 02:13:22.910368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ae16fec0-2a66-4cba-871b-02690885c5d4 req-8b80b58d-91a4-4364-bf97-46ecb4ef668d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279678 Mar 29 02:13:22.921295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 515/1083] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:22.949649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:22.952258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:22.974770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:22.976715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:22.977770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:22.979651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:24.132974 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:13:25.012673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d7edc12-9a15-404d-9e91-6323d2a09e3f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 204 len: 0 microversion: 2.1 time: 2.709966 Mar 29 02:13:25.014717 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 569/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:22 2022] DELETE /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 0 bytes in 2711 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:13:25.018362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:25.019299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:25.050833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.050833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.052603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.053138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.170862 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51798. Mar 29 02:13:25.276727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. Mar 29 02:13:25.276727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:25.276727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ae598f6-e98a-43c1-a106-efcc13a50c3c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 404 len: 111 microversion: 2.1 time: 0.255025 Mar 29 02:13:25.276727 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 570/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:25 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:25.284326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:25.289487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:25.305727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.306144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.307039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.313769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.362690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:25.399701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:25.403020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:25.407028 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9a875fb-49e2-44c8-a0bd-6070e9b479dd tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 2.482087 Mar 29 02:13:25.411522 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 516/1086] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:22 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:25.416766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fa30792e-f54c-431f-9c57-6f6bb76cab4f req-64740125-7b74-4e27-9fa6-549cbc3694a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2c33f9-e618-4d44-88ca-1c4828670ea7", "name": "network-vif-unplugged", "status": "completed", "tag": "24f54f47-ae93-4415-8b00-b834c87cc5c7"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:25.419716 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:25.419716 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:25.433571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fa30792e-f54c-431f-9c57-6f6bb76cab4f req-64740125-7b74-4e27-9fa6-549cbc3694a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.434610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fa30792e-f54c-431f-9c57-6f6bb76cab4f req-64740125-7b74-4e27-9fa6-549cbc3694a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.458567 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fa30792e-f54c-431f-9c57-6f6bb76cab4f req-64740125-7b74-4e27-9fa6-549cbc3694a3 service nova] Creating event network-vif-unplugged:24f54f47-ae93-4415-8b00-b834c87cc5c7 for instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 on n-h2-828148-1 Mar 29 02:13:25.464443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fa30792e-f54c-431f-9c57-6f6bb76cab4f req-64740125-7b74-4e27-9fa6-549cbc3694a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051294 Mar 29 02:13:25.465908 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 517/1087] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:25.474035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:25.474635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:25.483488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.483987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.484827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:25.485301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:25.592424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:13:25.899435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:25.912096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5fec40b3-1f09-490f-990a-874461c40379 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1475 microversion: 2.1 time: 0.632224 Mar 29 02:13:25.914438 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 571/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:25 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1475 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:26.108647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c578976-4ba3-4366-bcc0-fe3dbb76abad tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 204 len: 0 microversion: 2.1 time: 0.639804 Mar 29 02:13:26.110076 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 518/1089] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:25 2022] DELETE /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:26.118923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:26.120315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:26.137811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:26.137811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:26.137811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:26.138070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:26.195195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8724b995e0>, body: {"keypair": {"name": "tempest-keypair-1205373168"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:26.280314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:26.302677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:26.322958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. Mar 29 02:13:26.323539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:26.324378 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94ff11e5-5883-438c-9c4d-9b663e7fc4bb tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 404 len: 111 microversion: 2.1 time: 0.211365 Mar 29 02:13:26.331868 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 519/1090] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:26 2022] DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:26.338564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1683424446", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "f0bf6988-5c26-404c-85f6-c1676da0daf5"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:26.497955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] validate_networks() for [('f0bf6988-5c26-404c-85f6-c1676da0daf5', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:13:27.494719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:27.513213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:27.551044 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc7d07c3-a23a-4c5f-bc5e-699b24df6899 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.635010 Mar 29 02:13:27.556725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 572/1091] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:25 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:27.571758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:27.572552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:27.586558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.587202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.588116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.588766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.691619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. Mar 29 02:13:27.693479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:27.696254 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b1c3078-0b9e-481f-8334-ede45e58b809 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 404 len: 111 microversion: 2.1 time: 0.138131 Mar 29 02:13:27.700995 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 573/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:27 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:27.708258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:27.709250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:27.721393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.723003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.724078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.724760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.928655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:13:27.929239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:13:27.929711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:13:27.930214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:13:27.930699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:13:27.946471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.947423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.948302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:27.948815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:27.989651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:28.004194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for user 530e622216e14b4daae0ea35922590c9 and project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:28.034908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:13:28.042930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:13:28.218203 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80a26071-83a5-4dd4-b9f9-0e15e0e23919 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871422 Mar 29 02:13:28.245786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 520/1093] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:13:28.410672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: .version_select at 0x7f8717e94160>, body: {"keypair": {"name": "tempest-keypair-747483895"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:28.483008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:28.501867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:28.834396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:28.852804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:28.854265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:28.889937 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e60552ef-0a3f-4fd5-b758-4df2fd25b48b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 1.185203 Mar 29 02:13:28.890549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 574/1094] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:27 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:28.923569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:28.924441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:28.951581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:28.956012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:28.959023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:28.966552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:29.239097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:29.272715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:29.321028 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ace7960a-3898-4001-8628-0d832a85b79d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 1.062875 Mar 29 02:13:29.322144 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 521/1095] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:28 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:29.343293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:29.353288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:29.382078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:29.386684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:29.391756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:29.393551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:29.918379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:29.945691 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fee4e6d7-0652-4e12-90d4-c2e1b3ab3edf tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1475 microversion: 2.1 time: 1.041809 Mar 29 02:13:29.945691 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 575/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:28 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1475 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:30.035884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7f7dcccd-35aa-4a13-9c7c-4489c1e6cc69 req-64d84bd9-098c-4ab7-a7a2-3349de3423f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "520780dc-8aef-448a-8738-ed70f20f4d98", "tag": "1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:30.038122 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:30.038122 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:30.048459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7f7dcccd-35aa-4a13-9c7c-4489c1e6cc69 req-64d84bd9-098c-4ab7-a7a2-3349de3423f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:30.049475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7f7dcccd-35aa-4a13-9c7c-4489c1e6cc69 req-64d84bd9-098c-4ab7-a7a2-3349de3423f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:30.078896 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7f7dcccd-35aa-4a13-9c7c-4489c1e6cc69 req-64d84bd9-098c-4ab7-a7a2-3349de3423f1 service nova] Creating event network-changed:1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2 for instance 520780dc-8aef-448a-8738-ed70f20f4d98 on n-h1-828148-1 Mar 29 02:13:30.088620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7f7dcccd-35aa-4a13-9c7c-4489c1e6cc69 req-64d84bd9-098c-4ab7-a7a2-3349de3423f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147303 Mar 29 02:13:30.088620 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 576/1097] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:30.097445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07c021b6-f721-404e-98b6-bdb38d9003ed tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8724b99ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:30.116489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07c021b6-f721-404e-98b6-bdb38d9003ed tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs/tempest-keypair-1205373168" status: 200 len: 692 microversion: 2.1 time: 0.020348 Mar 29 02:13:30.116489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 577/1098] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:13:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1205373168 => generated 692 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:30.122444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "name": "network-vif-unplugged", "status": "completed", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:30.127731 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:30.127731 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:30.177890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:30.178530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:30.220020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] Creating event network-vif-unplugged:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h2-828148-1 Mar 29 02:13:30.238197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] Instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:13:30.255974 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-044bd359-809b-445d-a1bc-9bd0ba534b8e req-edf7cb35-d52f-48d3-904b-6837d9780473 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143773 Mar 29 02:13:30.257492 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 578/1099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:30.263073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd7721c5-b1bc-4912-8b1d-2a3e7e2ee41c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '.version_select at 0x7f8724badd30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:30.350014 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd7721c5-b1bc-4912-8b1d-2a3e7e2ee41c tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380048371" status: 202 len: 0 microversion: 2.1 time: 0.091047 Mar 29 02:13:30.353205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 579/1100] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380048371 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:30.357340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:30.369958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:30.393336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:30.395865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:30.398019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:30.402494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:31.185949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:31.208931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30850a92-7a9b-476a-892c-afaf9f3c0a39 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1483 microversion: 2.1 time: 1.882742 Mar 29 02:13:31.237207 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 522/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:29 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1483 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:31.269134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:31.310016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:31.394798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:31.394798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:31.394798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:31.394798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:31.859264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:31.880655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5dffcad5-e1c7-4b4a-8096-585f6273ec35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1212 microversion: 2.1 time: 1.525251 Mar 29 02:13:31.897389 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 580/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:30 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1212 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:31.922830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d27916f-55ae-4a59-8a13-d02a7e410d78 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8724bad160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:32.082504 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d27916f-55ae-4a59-8a13-d02a7e410d78 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205373168" status: 202 len: 0 microversion: 2.1 time: 0.189070 Mar 29 02:13:32.082504 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 581/1103] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:13:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205373168 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:32.245907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f0aea3a4-2515-4cf9-9386-4c0c6ca7da94 req-7a3157ff-c2b3-4378-a35a-51c47a5a0bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc2c33f9-e618-4d44-88ca-1c4828670ea7", "name": "network-vif-deleted", "tag": "24f54f47-ae93-4415-8b00-b834c87cc5c7"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:32.264121 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:32.264121 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:32.328271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f0aea3a4-2515-4cf9-9386-4c0c6ca7da94 req-7a3157ff-c2b3-4378-a35a-51c47a5a0bd8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:32.328705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f0aea3a4-2515-4cf9-9386-4c0c6ca7da94 req-7a3157ff-c2b3-4378-a35a-51c47a5a0bd8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:32.454291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f0aea3a4-2515-4cf9-9386-4c0c6ca7da94 req-7a3157ff-c2b3-4378-a35a-51c47a5a0bd8 service nova] Creating event network-vif-deleted:24f54f47-ae93-4415-8b00-b834c87cc5c7 for instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 on n-h2-828148-1 Mar 29 02:13:32.476526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f0aea3a4-2515-4cf9-9386-4c0c6ca7da94 req-7a3157ff-c2b3-4378-a35a-51c47a5a0bd8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399071 Mar 29 02:13:32.492550 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 582/1104] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:32.533182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:32.538316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:32.571563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:32.573618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:32.577061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:32.577782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:33.714401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:33.729230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:33.731150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:33.739767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4be62ad6-8beb-4902-b4c5-d3462b0f99eb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 2.501224 Mar 29 02:13:33.741011 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 523/1105] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:31 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 2503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:33.752671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8717d57ee0>, body: {"keypair": {"name": "tempest-keypair-1816510542"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:33.818389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:33.826251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:33.935971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:33.949770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b065c8e-5b36-461a-be78-3a04060950c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1475 microversion: 2.1 time: 1.452794 Mar 29 02:13:33.950618 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 583/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:32 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1475 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:33.956342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:33.962499 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:33.962499 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:33.980962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:33.981405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:34.043097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] Creating event network-changed:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h2-828148-1 Mar 29 02:13:34.046606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] Instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:13:34.070861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ab27e92b-4e32-43a7-9536-2059f60c0ea8 req-b97867aa-799e-4734-a5a1-c98bc2fbcc24 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118623 Mar 29 02:13:34.078657 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 584/1107] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:34.094055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:34.095286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:34.128038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:34.128682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:34.129709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:34.130845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:34.299193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:34.310922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:34.363506 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c6226e43-a59c-4ea9-a9a1-88601ec40088 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.615906 Mar 29 02:13:34.371922 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 524/1108] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:33 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:34.386857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6e4dc47d-30b0-4189-8e7b-58bb2f5e88ce req-86ada436-b31a-4ba3-ad96-6d7bb34b2843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db09098-69b0-495f-86a0-79d8872dda7a", "name": "network-vif-plugged", "status": "completed", "tag": "7edd29b1-467e-4ce7-86eb-abe21b84f0ad"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:34.388043 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:34.388043 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:34.463370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6e4dc47d-30b0-4189-8e7b-58bb2f5e88ce req-86ada436-b31a-4ba3-ad96-6d7bb34b2843 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:34.463811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6e4dc47d-30b0-4189-8e7b-58bb2f5e88ce req-86ada436-b31a-4ba3-ad96-6d7bb34b2843 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:34.484011 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6e4dc47d-30b0-4189-8e7b-58bb2f5e88ce req-86ada436-b31a-4ba3-ad96-6d7bb34b2843 service nova] Creating event network-vif-plugged:7edd29b1-467e-4ce7-86eb-abe21b84f0ad for instance 7db09098-69b0-495f-86a0-79d8872dda7a on n-h2-828148-1 Mar 29 02:13:34.489688 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6e4dc47d-30b0-4189-8e7b-58bb2f5e88ce req-86ada436-b31a-4ba3-ad96-6d7bb34b2843 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115483 Mar 29 02:13:34.490898 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 525/1109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:34.497898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-897021b0-83f0-4542-8093-ca9494fc0dd4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8724464820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:34.652651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-897021b0-83f0-4542-8093-ca9494fc0dd4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816510542" status: 202 len: 0 microversion: 2.1 time: 0.154069 Mar 29 02:13:34.652651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 526/1110] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:13:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1816510542 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:34.691360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5ae992b-3ab1-4cc8-b3d6-037f0c4d136f tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8717d57af0>, body: {"keypair": {"name": "tempest-keypair-1180786083", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:34.747537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b5ae992b-3ab1-4cc8-b3d6-037f0c4d136f tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:34.761818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b5ae992b-3ab1-4cc8-b3d6-037f0c4d136f tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:34.876506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:34.880238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e7fda3a-f842-4156-8459-58eda621829f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.806979 Mar 29 02:13:34.880322 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 585/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:34 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:34.894375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:34.895266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:34.904625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:34.905393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:34.906464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:34.907087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:35.354555 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5ae992b-3ab1-4cc8-b3d6-037f0c4d136f tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.686038 Mar 29 02:13:35.359737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 527/1112] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Mar 29 02:13:34 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:35.361123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:35.362679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:35.397550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:35.400770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:35.401840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:35.402683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:35.987020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:36.025720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:36.037748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:36.045379 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-225d8778-4e9c-406b-bbfe-8c9685196680 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1281 microversion: 2.25 time: 1.158128 Mar 29 02:13:36.048934 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 586/1113] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:34 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1281 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:36.082301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2804502-14a1-4289-8a82-96f3af89e7d6 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8724b99160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:36.200860 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2804502-14a1-4289-8a82-96f3af89e7d6 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180786083" status: 202 len: 0 microversion: 2.1 time: 0.148337 Mar 29 02:13:36.200860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 587/1114] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:13:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180786083 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:36.213994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:36.213994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:36.227631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:36.228081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:36.228879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:36.229323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:36.476238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:36.494470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ced0ad91-cbc6-46a1-993b-bb5d15800176 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1473 microversion: 2.1 time: 1.137696 Mar 29 02:13:36.495393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 528/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:35 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1473 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:36.499966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8717e8b820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1055226561"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:36.552414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:36.558400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:36.940325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:36.949191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:36.962036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:36.970415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44e0b8df-5dfb-4f95-af1b-ceac7c73502e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.761509 Mar 29 02:13:36.971292 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 588/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:36 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:36.986842 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b46e6346-1a67-47aa-9e62-e321c3fcfe02 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.490171 Mar 29 02:13:36.991723 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 529/1117] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:36 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:36.997110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8724b8e3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-760824954"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:37.028046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:37.036546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:37.073284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:37.074404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:37.083768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:37.084629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:37.085884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:37.086504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:37.514011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:37.541910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:37.570360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93aee1c8-46f0-42a6-8bfd-cb21b0131b23 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.577266 Mar 29 02:13:37.580094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 589/1118] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:36 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:37.598275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7d31ec1f-78b0-4cdd-8880-339dfb54595d req-f1a0123b-97b9-48b1-9f88-1f8c3e1e7a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46826a93-f066-407b-b9f1-91786295f54a", "tag": "7eea672d-f5cf-4dbf-8cc1-7a4f4905518a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:37.600443 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:37.600443 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:37.622592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7d31ec1f-78b0-4cdd-8880-339dfb54595d req-f1a0123b-97b9-48b1-9f88-1f8c3e1e7a52 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:37.628015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7d31ec1f-78b0-4cdd-8880-339dfb54595d req-f1a0123b-97b9-48b1-9f88-1f8c3e1e7a52 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:37.671131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7d31ec1f-78b0-4cdd-8880-339dfb54595d req-f1a0123b-97b9-48b1-9f88-1f8c3e1e7a52 service nova] Creating event network-changed:7eea672d-f5cf-4dbf-8cc1-7a4f4905518a for instance 46826a93-f066-407b-b9f1-91786295f54a on n-h2-828148-1 Mar 29 02:13:37.677172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7d31ec1f-78b0-4cdd-8880-339dfb54595d req-f1a0123b-97b9-48b1-9f88-1f8c3e1e7a52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093393 Mar 29 02:13:37.683796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 590/1119] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:37.697074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:37.697866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:37.714743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:37.716426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:37.718539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:37.719907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.057524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:38.066513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:38.068817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:38.069894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-89f49f81-ebdc-44bd-8482-c27faec50673 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1476 microversion: 2.25 time: 1.008281 Mar 29 02:13:38.082817 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 530/1120] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:37 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1476 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:13:38.087964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Action: 'create', calling method: .version_select at 0x7f8717e8bb80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1895060255"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:38.117633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:38.130587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:38.290362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:38.301816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Getting quotas for user 35ffcc7d06e04ac7a0f5f7fd7f92836d and project 98f82fb772cf4de6ba03e8ade0bdd43f. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:38.313757 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd903225-2dcb-45a5-a8ad-63676a146a07 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.229490 Mar 29 02:13:38.314672 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 531/1121] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:38 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:38.319494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c2354666-4a8c-4df5-9c13-52171ab679d9 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:38.320619 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:38.320619 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:38.400587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:38.403783 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c2354666-4a8c-4df5-9c13-52171ab679d9 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1731229315" status: 202 len: 0 microversion: 2.1 time: 0.087954 Mar 29 02:13:38.404479 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 532/1122] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:13:38 2022] DELETE /compute/v2.1/flavors/1731229315 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:38.412136 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7878e341-5cb7-425b-8ad7-96637ab8be5b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1470 microversion: 2.1 time: 0.723964 Mar 29 02:13:38.412767 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 591/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:37 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1470 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:38.414106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:38.414973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:38.421761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:38.422375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:38.427507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.428192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.429203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.429838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.440967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.446946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.448655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.449227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.753022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:38.757970 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fc337e7-8d68-49b2-b0aa-8d0f159a1b18 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.349067 Mar 29 02:13:38.758919 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 533/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:38 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:38.764788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fa195ab-91d4-4219-a3b1-4cb6835d03b4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8717e8b820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:38.768519 n-d-828148-1 devstack@n-api.service[103514]: WARNING oslo_db.sqlalchemy.utils [None req-8fa195ab-91d4-4219-a3b1-4cb6835d03b4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:13:38.776566 n-d-828148-1 devstack@n-api.service[103514]: WARNING oslo_db.sqlalchemy.utils [None req-8fa195ab-91d4-4219-a3b1-4cb6835d03b4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:13:38.784381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fa195ab-91d4-4219-a3b1-4cb6835d03b4 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.023747 Mar 29 02:13:38.786451 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 534/1125] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:13:38 2022] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:38.797943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d05ba7a9-b7eb-433d-afd6-89c32ccf00e8 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:38.838586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d05ba7a9-b7eb-433d-afd6-89c32ccf00e8 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.045088 Mar 29 02:13:38.843450 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 535/1126] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:13:38 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:38.844273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:38.844831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:38.859030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.860539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:38.861404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:38.861849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.145888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38d72a03-1f9b-415b-bd7f-d4afe880d14e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d/action" status: 204 len: 0 microversion: 2.1 time: 0.304939 Mar 29 02:13:39.153308 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 536/1127] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:13:38 2022] POST /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d/action => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:39.164314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-499541df-1e8a-4653-81bd-6efaec6b356d tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8717e7ca60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.282332 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-499541df-1e8a-4653-81bd-6efaec6b356d tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1895060255" status: 202 len: 0 microversion: 2.1 time: 0.124660 Mar 29 02:13:39.282332 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 537/1128] 10.222.0.36 () {58 vars in 1277 bytes} [Tue Mar 29 02:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1895060255 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:39.295330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 7db09098-69b0-495f-86a0-79d8872dda7a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:13:39.352802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "name": "network-vif-plugged", "status": "completed", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:39.354321 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:39.354321 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:39.365371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:39.365813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.396389 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d68a7ec5-1def-4e69-b853-c5da6e56c1cd tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1969 microversion: 2.25 time: 0.979698 Mar 29 02:13:39.408806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 592/1129] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:38 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1969 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:39.408806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f18d2be-30ca-4d6e-b363-0708d4bb12e9 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.408806 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:39.408806 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:39.425719 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] Creating event network-vif-plugged:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h2-828148-1 Mar 29 02:13:39.439939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] Instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:13:39.464241 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-95558398-ebe2-4d56-942c-61904b226bf9 req-f27f5f69-2c36-4b77-8321-38741143a68a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175410 Mar 29 02:13:39.472238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 538/1130] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:39.479132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.479829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:39.502068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:39.502068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.502289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f18d2be-30ca-4d6e-b363-0708d4bb12e9 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1181097416" status: 202 len: 0 microversion: 2.1 time: 0.098426 Mar 29 02:13:39.502289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 593/1131] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:13:39 2022] DELETE /compute/v2.1/flavors/1181097416 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:39.504691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27afb2d1-3189-472f-873f-4facec755057 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8724bad160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.505436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:39.505907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.675548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27afb2d1-3189-472f-873f-4facec755057 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-760824954" status: 202 len: 0 microversion: 2.1 time: 0.177276 Mar 29 02:13:39.676617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 594/1132] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-760824954 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:39.687698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.688536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:39.718590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:39.719037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.720363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:39.727012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:39.897562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:39.911280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae583de4-796b-452c-a2dd-4f5df35bab4b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1470 microversion: 2.1 time: 0.441915 Mar 29 02:13:39.923968 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 539/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:39 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:39.931049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4972705-10f5-4d11-8165-9ec080e3cdb5 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:39.980804 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4972705-10f5-4d11-8165-9ec080e3cdb5 tempest-ServersWithSpecificFlavorTestJSON-2084926539 tempest-ServersWithSpecificFlavorTestJSON-2084926539-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054106 Mar 29 02:13:39.981494 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 540/1134] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:13:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:39.997595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4833c5c4-7d61-4681-8179-2e2462beb293 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] Calling method '.version_select at 0x7f8717d57790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:40.119397 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4833c5c4-7d61-4681-8179-2e2462beb293 tempest-KeyPairsV2TestJSON-727029714 tempest-KeyPairsV2TestJSON-727029714-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1055226561" status: 202 len: 0 microversion: 2.1 time: 0.126695 Mar 29 02:13:40.120439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 541/1135] 10.222.0.36 () {58 vars in 1277 bytes} [Tue Mar 29 02:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1055226561 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:40.136903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:40.139495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:40.159643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.159643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.163646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.165096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.506436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 7db09098-69b0-495f-86a0-79d8872dda7a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:13:40.602632 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1596749d-8e57-4d71-9f08-f0620e930604 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1969 microversion: 2.25 time: 0.921521 Mar 29 02:13:40.617062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 595/1136] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:39 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1969 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:40.625201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:40.626307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:40.647742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.648207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.662524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.662524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.768901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. Mar 29 02:13:40.779313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:40.780749 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ff7e959-d7c5-46a7-82f0-b63b5bc7ec77 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 404 len: 111 microversion: 2.1 time: 0.162290 Mar 29 02:13:40.782667 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 596/1137] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:40 2022] DELETE /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:40.792221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:40.794372 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:40.794372 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:40.803317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.803857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.804883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.805217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.853421 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-131f135a-aa40-4879-bf13-2bff533a526f tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.069245 Mar 29 02:13:40.854802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 597/1138] 10.222.0.36 () {60 vars in 1216 bytes} [Tue Mar 29 02:13:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:13:40.861123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:40.862945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: ea0b0148-e275-4810-9e65-e920f042fb19] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:40.874566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.876567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.877873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:40.880018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:40.950415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. Mar 29 02:13:41.006986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance ea0b0148-e275-4810-9e65-e920f042fb19 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:41.006986 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-848d5640-7075-4400-971d-dce3f1ff9cca tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19" status: 404 len: 111 microversion: 2.1 time: 0.096660 Mar 29 02:13:41.006986 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 598/1139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:40 2022] GET /compute/v2.1/servers/ea0b0148-e275-4810-9e65-e920f042fb19 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:41.006986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-828148-1", "block_migration": "auto"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:41.007544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:41.007544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.007544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.007544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.007882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.007985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:41.007985 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a12a6173-c54e-439f-8e0b-d16b69b63461 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.877701 Mar 29 02:13:41.007985 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 542/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:40 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:41.007985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:41.008351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:41.020404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.021130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.022275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.022710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.039859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'flavor' on Instance uuid 7db09098-69b0-495f-86a0-79d8872dda7a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:13:41.112476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Going to try to live migrate instance to n-h1-828148-1 {{(pid=103513) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:13:41.324591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:41.349754 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-229dc708-c3ca-4cd8-9fab-d83cfd66d230 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1470 microversion: 2.1 time: 0.348172 Mar 29 02:13:41.370631 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 543/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:41 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:41.375627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:41.381939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:41.399005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.401563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.402815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:41.402815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:41.491970 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. Mar 29 02:13:41.493040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:41.494023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d47e62b-432e-4248-9cd2-7306d898bba6 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 404 len: 111 microversion: 2.1 time: 0.122206 Mar 29 02:13:41.497506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 544/1142] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:13:41 2022] DELETE /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:41.503769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1847380462", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9222f6f3-d189-4e16-8c8f-3078bec78258"}], "security_groups": [{"name": "tempest-securitygroup--1460740220"}], "key_name": "tempest-keypair-747483895", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:41.656064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] validate_networks() for [('9222f6f3-d189-4e16-8c8f-3078bec78258', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:13:42.730514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:13:42.731655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:13:42.732410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:13:42.733108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:13:42.733827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:13:42.749315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:42.750109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:42.751669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:42.752325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:42.777305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:42.784611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:42.805451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:13:42.814997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:13:43.048829 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c77832b-4ba3-4cfb-b259-86ca87517a31 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.546961 Mar 29 02:13:43.048829 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 545/1143] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:13:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:13:43.071024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:43.071024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] [instance: e975f936-623a-42eb-ba11-283950a60665] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:43.101791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:43.101791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:43.103136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:43.104202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:43.211986 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] HTTP exception thrown: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. Mar 29 02:13:43.213115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] Returning 404 to user: Instance e975f936-623a-42eb-ba11-283950a60665 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:13:43.214368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bfaac28-97ea-45d5-b4d0-d4ed37c76ea7 tempest-ServersWithSpecificFlavorTestJSON-816089308 tempest-ServersWithSpecificFlavorTestJSON-816089308-project] 10.222.0.36 "GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665" status: 404 len: 111 microversion: 2.1 time: 0.166982 Mar 29 02:13:43.219114 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 546/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:43 2022] GET /compute/v2.1/servers/e975f936-623a-42eb-ba11-283950a60665 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:13:43.225465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:43.226391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:43.234801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:43.235668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:43.237014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:43.237677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:43.939022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:43.954361 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a1d521b-4950-4430-ba08-0c1d7b3b20a4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.732886 Mar 29 02:13:43.969576 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 547/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:43 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:43.978903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:43.988125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:44.010378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:44.013285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:44.014324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:44.015751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:44.577863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:44.597305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9383c2f9-cee6-4e04-989d-120cc2409be2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1462 microversion: 2.1 time: 0.626313 Mar 29 02:13:44.601381 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 548/1146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:43 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1462 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:44.612508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-de86cce5-e5f4-4645-8cef-a7ed903d0ec1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:44.614567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de86cce5-e5f4-4645-8cef-a7ed903d0ec1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:44.811598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-de86cce5-e5f4-4645-8cef-a7ed903d0ec1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:44.827406 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-de86cce5-e5f4-4645-8cef-a7ed903d0ec1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1238 microversion: 2.1 time: 0.224367 Mar 29 02:13:44.827559 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 549/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:44 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1238 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:44.832453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:44.833088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:44.857959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:44.865924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:44.865924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:44.865924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:45.369131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad578468-deef-4b51-ba53-c8d5256de848 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a/action" status: 202 len: 0 microversion: 2.25 time: 4.413504 Mar 29 02:13:45.374713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 599/1148] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:13:40 2022] POST /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a/action => generated 0 bytes in 4416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:13:45.375362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b04a597b-f3f5-4c09-9742-15342f702104 req-388d814b-45e9-4e8d-b732-0293aee5e266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46826a93-f066-407b-b9f1-91786295f54a", "name": "network-vif-plugged", "status": "completed", "tag": "7eea672d-f5cf-4dbf-8cc1-7a4f4905518a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:45.378507 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:45.378507 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:45.412932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b04a597b-f3f5-4c09-9742-15342f702104 req-388d814b-45e9-4e8d-b732-0293aee5e266 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:45.414280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b04a597b-f3f5-4c09-9742-15342f702104 req-388d814b-45e9-4e8d-b732-0293aee5e266 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:45.444380 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b04a597b-f3f5-4c09-9742-15342f702104 req-388d814b-45e9-4e8d-b732-0293aee5e266 service nova] Creating event network-vif-plugged:7eea672d-f5cf-4dbf-8cc1-7a4f4905518a for instance 46826a93-f066-407b-b9f1-91786295f54a on n-h2-828148-1 Mar 29 02:13:45.451706 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b04a597b-f3f5-4c09-9742-15342f702104 req-388d814b-45e9-4e8d-b732-0293aee5e266 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080652 Mar 29 02:13:45.452598 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 600/1149] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:45.466023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:45.467625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:45.479367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:45.480071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:45.481226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:45.491908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:45.664030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:45.675175 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7cea3120-b7d1-4a7e-90e0-02d89927a885 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1462 microversion: 2.1 time: 0.846493 Mar 29 02:13:45.681383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 550/1150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:44 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1462 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:45.689912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:45.692582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:45.709923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:45.710597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:45.719454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:45.720173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:46.095306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:46.108699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aab144c9-3be1-4651-ae3c-6c8bfd8fc2ff tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 0.650704 Mar 29 02:13:46.111200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 601/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:45 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:46.119421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86278484-7bb4-4a86-84ee-73880c78028e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '.version_select at 0x7f8724c6d0d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:46.122983 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:46.122983 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:13:46.130450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86278484-7bb4-4a86-84ee-73880c78028e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:46.131008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86278484-7bb4-4a86-84ee-73880c78028e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:46.156138 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86278484-7bb4-4a86-84ee-73880c78028e tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.044957 Mar 29 02:13:46.158045 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 602/1152] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:13:46 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:46.167655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:46.168705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:46.182396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:46.182936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:46.184132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:46.184693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:46.346126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:46.373870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:46.377364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:46.380198 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4007489d-9043-4e99-a40c-473171a928fe tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.695902 Mar 29 02:13:46.382998 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 551/1153] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:45 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:46.393161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f30b6e8-4b9a-478e-80c5-08732f85dc25 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:46.427528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f30b6e8-4b9a-478e-80c5-08732f85dc25 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043184 Mar 29 02:13:46.429457 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 552/1154] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:13:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:46.439880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a42f7a0-3e0d-4593-b1c3-f96471362bb7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1428498202", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:46.442456 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:46.442456 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:46.501245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:46.511576 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c982e98c-a537-4bec-9603-40697af4b585 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1290 microversion: 2.1 time: 0.350307 Mar 29 02:13:46.512660 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 603/1155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:46 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1290 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:46.550213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a42f7a0-3e0d-4593-b1c3-f96471362bb7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.114581 Mar 29 02:13:46.551166 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 553/1156] 10.222.0.36 () {60 vars in 1145 bytes} [Tue Mar 29 02:13:46 2022] POST /compute/v2.1/flavors => generated 499 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:13:46.562023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21f2672b-2639-424e-abb3-a986bd224754 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:46.583215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21f2672b-2639-424e-abb3-a986bd224754 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024967 Mar 29 02:13:46.593531 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 604/1157] 10.222.0.36 () {58 vars in 1181 bytes} [Tue Mar 29 02:13:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:13:46.721541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1171173859", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "b54bd94a-9b9f-41bd-b7cb-37d6b4b82451"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:46.794908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:13:47.128795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:47.128795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:47.152549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:47.161850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:47.161850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:47.161850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.213102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:48.215253 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-729ed41d-218a-4bd4-95c5-21d6a626959b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1308 microversion: 2.1 time: 1.092502 Mar 29 02:13:48.225934 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 605/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:47 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1308 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:48.225934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:48.225934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:48.236199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.236199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.236199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.236199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.632391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:13:48.632391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:13:48.632391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:13:48.632391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:13:48.632391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:13:48.645276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.647182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.651727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.652025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.697272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:48.710001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for user 035be210e94e4072b31cb011a5189ee4 and project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:48.738321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:13:48.748142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:13:48.945726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd2d4faa-87c7-426b-adb3-272a621bc1ad tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.227767 Mar 29 02:13:48.949209 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 554/1159] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:13:48.956960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:48.958345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:48.970563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.971691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:48.974822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:48.978661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:49.164542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:49.199044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:49.209966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:49.212587 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c99355fd-a91a-4d2e-9135-ab61775342bb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.995723 Mar 29 02:13:49.215741 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 606/1160] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:48 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:49.652444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Action: 'create', calling method: .version_select at 0x7f8724c6dd30>, body: {"keypair": {"name": "tempest-keypair-2115345199"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:49.684446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:49.684446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for user 7349ebfc977a4c78b752221fa7ac41da and project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:49.783209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:49.792465 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-846b0dd1-ee0d-435e-9d0b-3493112a8fe0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1296 microversion: 2.1 time: 0.841635 Mar 29 02:13:49.799877 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 555/1161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:48 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1296 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:49.813160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f975071-73e2-43b5-8ae5-034a8cce5e37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:49.825624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4f975071-73e2-43b5-8ae5-034a8cce5e37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:50.123363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:13:50.126438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for user 7349ebfc977a4c78b752221fa7ac41da and project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:13:50.144952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4f975071-73e2-43b5-8ae5-034a8cce5e37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:50.146461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f975071-73e2-43b5-8ae5-034a8cce5e37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1279 microversion: 2.1 time: 0.340244 Mar 29 02:13:50.148872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 556/1162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:49 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1279 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:50.159524 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-697b4e7d-97bc-476a-88e5-7212ef42fa11 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.941333 Mar 29 02:13:50.160935 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 607/1163] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:13:49 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:50.169348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:50.169348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:50.182331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:50.182331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:50.183071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:50.183500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:50.247341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:50.248079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:50.295287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:50.295749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:50.296558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:50.297066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.280108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.291486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.293527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.295018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86f6ebec-c135-4289-986e-a0ef8a393045 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 1.065207 Mar 29 02:13:51.306077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 608/1164] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:50 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:51.316791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:51.316791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:51.322949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.323846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.324814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.325511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.456926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.466849 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c2efd2cb-e1ac-4e82-986b-1c054e216337 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1487 microversion: 2.1 time: 1.317845 Mar 29 02:13:51.478646 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 557/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:50 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1487 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:51.503151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:51.503690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:51.516287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.517013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.517913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.518979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.886188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.898035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-977e314c-b37f-49af-9836-4ed3699c51a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1296 microversion: 2.1 time: 0.587685 Mar 29 02:13:51.905008 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 609/1166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:51 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1296 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:51.910548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:51.911327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:51.920804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.921555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.923188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:51.923780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:51.956034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:51.965557 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a1fa71b5-d6ff-4ef7-94a0-8f1e9850bfa2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1331 microversion: 2.1 time: 0.495075 Mar 29 02:13:51.989181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lazy-loading 'flavor' on Instance uuid 46826a93-f066-407b-b9f1-91786295f54a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:13:51.990868 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 558/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:51 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1331 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:52.317434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:52.318335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:52.327104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.327931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:52.329012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.329630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:52.424971 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcbc7217-da36-4dc3-b016-84a3696629c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a/action" status: 202 len: 0 microversion: 2.1 time: 0.518203 Mar 29 02:13:52.428943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 610/1168] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:13:51 2022] POST /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:13:52.434345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:52.435042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:52.456750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.457220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:52.457989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.461504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:52.785859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:52.795822 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15de60b3-88f6-4c28-894a-14c911db6aec tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1495 microversion: 2.1 time: 0.365574 Mar 29 02:13:52.796712 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 611/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:52 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1495 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:52.912342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:52.913095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:52.921834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.926587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:52.927358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:52.929044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:53.114501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:53.123275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:53.125199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:53.128349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6dc9d83-3009-4f0b-9183-9a18b0f8f376 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.814883 Mar 29 02:13:53.143342 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 559/1170] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:52 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:53.148397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:53.149196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:53.167594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:53.167594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:53.167594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:53.167594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:53.357871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:53.381580 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b5d2356-28c9-4e00-84cd-5c63a359fbb6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1337 microversion: 2.1 time: 0.236857 Mar 29 02:13:53.382209 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 560/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:53 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1337 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:53.757347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:53.780813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4f38a5b-cb88-4b07-a16b-6b674f876084 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 0.858205 Mar 29 02:13:53.781970 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 612/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:52 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:53.813800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:53.814599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:53.832230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:53.832932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:53.833871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:53.834460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:54.148345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:54.149181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:54.166316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:54.170585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:54.172314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:54.172885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:54.915337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:54.945452 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed38b05a-8f61-41a5-b4ad-e2c320278b9f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 200 len: 1478 microversion: 2.1 time: 1.135668 Mar 29 02:13:54.955299 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 561/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:53 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 1478 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:54.960797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:54.962369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:54.975620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:54.976395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:54.977727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:54.978226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:55.165647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:55.168167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:55.177793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:55.177793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:55.180821 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-33b7a4df-8639-4082-82ab-c9968e59e39d tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 1.037063 Mar 29 02:13:55.181428 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 613/1174] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:54 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:55.186225 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ed684a8-19c6-42f1-aa91-90c35d48680e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1337 microversion: 2.1 time: 0.226622 Mar 29 02:13:55.199879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:55.199879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:55.200234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 562/1175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:54 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1337 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:55.207942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1844083023"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:55.208952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:55.209279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:55.210138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:55.210996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:55.211499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:55.218484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:55.219175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:55.222929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:55.222929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:56.022690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:56.043315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1fb003b3-5e5d-48e9-b602-65b7603eabf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 0.859163 Mar 29 02:13:56.044104 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 614/1176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:55 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:56.115441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfa8adb3-bfb3-4b05-b04d-3472f2eb2105 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a/action" status: 202 len: 0 microversion: 2.1 time: 0.913698 Mar 29 02:13:56.116378 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 563/1177] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:13:55 2022] POST /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a/action => generated 0 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:13:56.125875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-695f7315-9c40-4f54-a177-b10e4b5767c1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b09dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:56.191100 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-695f7315-9c40-4f54-a177-b10e4b5767c1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.068830 Mar 29 02:13:56.196099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 615/1178] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:56 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:56.210046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:56.213047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:56.216774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:56.217771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:56.231985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:56.233426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:56.236259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:56.236888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:56.239518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:56.240474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:56.241438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:56.242811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:56.807956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:56.812338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b8e85daf-46d0-473b-afa3-6091f75e567f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 0.602930 Mar 29 02:13:56.812338 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 616/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:56 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:56.999591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:57.025455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:57.025455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:57.025455 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6f345eb-5d5d-45c1-bd62-fc7a7aef8abb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.823231 Mar 29 02:13:57.029888 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 564/1180] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:56 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:57.076568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:57.076568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:57.094663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:57.094663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:57.094663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:57.094663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:57.214965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d6e35b3-895b-4626-85a8-00fcfeaba15b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717d579d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:57.331768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d6e35b3-895b-4626-85a8-00fcfeaba15b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.129397 Mar 29 02:13:57.333900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 565/1181] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:57 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:57.343183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5e901204-4995-4d80-9c8f-e137881cb6e7 req-48aa8247-13ae-4c90-b21f-57e3f07ad096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:57.349482 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:13:57.349482 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:13:57.379942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5e901204-4995-4d80-9c8f-e137881cb6e7 req-48aa8247-13ae-4c90-b21f-57e3f07ad096 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:57.380705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5e901204-4995-4d80-9c8f-e137881cb6e7 req-48aa8247-13ae-4c90-b21f-57e3f07ad096 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:57.398759 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5e901204-4995-4d80-9c8f-e137881cb6e7 req-48aa8247-13ae-4c90-b21f-57e3f07ad096 service nova] Creating event network-changed:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:13:57.404316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5e901204-4995-4d80-9c8f-e137881cb6e7 req-48aa8247-13ae-4c90-b21f-57e3f07ad096 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069052 Mar 29 02:13:57.405815 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 566/1182] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:13:57.827304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:57.828047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:57.837260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:57.841334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:57.841334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:57.841334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:57.913937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:57.938881 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b4dd81f-a21a-4012-8307-4dc0b1775904 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 0.872874 Mar 29 02:13:57.940050 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 617/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:57 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:58.042246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:58.042868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:58.055257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:58.057486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:58.058154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:58.058603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:58.868360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:58.875853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:58.875853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:58.875853 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3bbaea5-9bf3-469b-815c-c98ce05822f8 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.835978 Mar 29 02:13:58.880649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 618/1184] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:13:58 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:13:58.893129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1524401755", "imageRef": "96cbc029-ea28-489d-9331-b493a23d58dd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "03f1d446-f65a-40df-a529-389b6d326cd1"}], "security_groups": [{"name": "tempest-securitygroup--233027081"}], "key_name": "tempest-keypair-2115345199", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:13:59.354227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:13:59.368829 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2364bdc-63fe-41da-b926-1fadd45d4a06 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 1.539184 Mar 29 02:13:59.378527 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 567/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:57 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:13:59.378527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3bcf6891-5c1a-4dac-b763-86c6a6559cf6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87243500d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:59.429977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] validate_networks() for [('03f1d446-f65a-40df-a529-389b6d326cd1', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:13:59.461416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3bcf6891-5c1a-4dac-b763-86c6a6559cf6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.086592 Mar 29 02:13:59.465826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 568/1186] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:13:59 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:13:59.480001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:13:59.480122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:13:59.505968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:59.505968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:13:59.505968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:13:59.505968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:01.092450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:01.096636 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e604190-c59f-495a-a664-cfc3f6d51fa5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 1.629034 Mar 29 02:14:01.102282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 569/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:13:59 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:01.109956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:01.110563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:01.130619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:01.130955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:01.131738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:01.132252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:01.793262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:14:01.793739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:14:01.794466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:14:01.794870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:14:01.795288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:14:01.825583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:01.829476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:01.830442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:01.833076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:01.905174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:14:01.966638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Getting quotas for user 7349ebfc977a4c78b752221fa7ac41da and project 60e5017ae7974b11bb7cce9497ad69a4. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:14:01.966638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:14:01.966638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='96cbc029-ea28-489d-9331-b493a23d58dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:14:02.371719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:02.386552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:02.388322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:02.389544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ef321bc-e638-460e-b9c1-d3409e2a608c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 1.286252 Mar 29 02:14:02.390417 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 570/1188] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:01 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:02.395496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:02.396435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:02.407438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:02.408186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:02.409210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:02.410300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:02.549009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-abe8aeb9-c2b8-42e5-a783-56efe917987b tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.667646 Mar 29 02:14:02.557684 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 619/1189] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:13:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 3677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:14:02.563232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e32c2ff-86d8-459b-8705-0f47d8fbc21b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724c6d9d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:02.723078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e32c2ff-86d8-459b-8705-0f47d8fbc21b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.149832 Mar 29 02:14:02.723078 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 620/1190] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:02 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:02.734522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ec9a0f6c-6a44-4eec-b6dc-c380e9631cfd req-1dbdf41c-a3ab-4acb-a27d-27cbb838819c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:02.736377 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:02.736377 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:02.759654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec9a0f6c-6a44-4eec-b6dc-c380e9631cfd req-1dbdf41c-a3ab-4acb-a27d-27cbb838819c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:02.760140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec9a0f6c-6a44-4eec-b6dc-c380e9631cfd req-1dbdf41c-a3ab-4acb-a27d-27cbb838819c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:02.780403 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ec9a0f6c-6a44-4eec-b6dc-c380e9631cfd req-1dbdf41c-a3ab-4acb-a27d-27cbb838819c service nova] Creating event network-changed:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:14:02.785930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ec9a0f6c-6a44-4eec-b6dc-c380e9631cfd req-1dbdf41c-a3ab-4acb-a27d-27cbb838819c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071237 Mar 29 02:14:02.786518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 621/1191] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:02.801346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:02.802822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:02.825384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:02.828276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:02.831057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:02.832215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:03.418847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:03.456971 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-128a8b9f-2ffe-4527-80a2-32cad07e2ea1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 0.664492 Mar 29 02:14:03.459027 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 622/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:02 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:03.477997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe8c26f5-a39e-46f8-9a00-0f2efa518afb tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:03.481277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe8c26f5-a39e-46f8-9a00-0f2efa518afb tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:03.613666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe8c26f5-a39e-46f8-9a00-0f2efa518afb tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:03.653349 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe8c26f5-a39e-46f8-9a00-0f2efa518afb tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1246 microversion: 2.1 time: 0.181696 Mar 29 02:14:03.659902 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 623/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:03 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1246 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:03.666378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d9e2b041-c533-4347-be83-c4dcd377eb2e req-a81c6385-1656-4666-9334-98370ab1df92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46826a93-f066-407b-b9f1-91786295f54a", "name": "network-vif-plugged", "status": "completed", "tag": "7eea672d-f5cf-4dbf-8cc1-7a4f4905518a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:03.668322 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:03.668322 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:03.691223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d9e2b041-c533-4347-be83-c4dcd377eb2e req-a81c6385-1656-4666-9334-98370ab1df92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:03.691223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d9e2b041-c533-4347-be83-c4dcd377eb2e req-a81c6385-1656-4666-9334-98370ab1df92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:03.716473 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d9e2b041-c533-4347-be83-c4dcd377eb2e req-a81c6385-1656-4666-9334-98370ab1df92 service nova] Creating event network-vif-plugged:7eea672d-f5cf-4dbf-8cc1-7a4f4905518a for instance 46826a93-f066-407b-b9f1-91786295f54a on n-h2-828148-1 Mar 29 02:14:03.741591 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d9e2b041-c533-4347-be83-c4dcd377eb2e req-a81c6385-1656-4666-9334-98370ab1df92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076289 Mar 29 02:14:03.741591 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 624/1194] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:03.747874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:03.749629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:03.760551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:03.761112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:03.761963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:03.762641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:04.455255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:04.476314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:04.478009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:04.479315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-09bdfd64-eb3b-49e6-b82f-e2af16ac4add tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.735535 Mar 29 02:14:04.485372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 625/1195] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:03 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:04.496571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b123624b-39e3-448d-8fa1-349197867e6c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b09ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:04.577433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b123624b-39e3-448d-8fa1-349197867e6c tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.090338 Mar 29 02:14:04.579469 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 626/1196] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:04 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:04.585410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:04.586183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:04.608488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:04.608488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:04.608488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:04.608488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.078473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:05.115380 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03c99c35-36f6-4be6-af2e-f51f6dcfe9d1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 2.721365 Mar 29 02:14:05.123679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 571/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:02 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:05.142036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:05.142739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:05.155395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:05.155532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.156294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:05.156722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.514752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:05.526231 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e3bae77-b49c-423d-9787-0239ce6386ac tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1298 microversion: 2.1 time: 0.399936 Mar 29 02:14:05.527020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 572/1198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:05 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1298 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:05.545159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-113ccaf5-c36f-4e50-b3d9-cc7f247d6320 req-f19c1da9-5827-48ca-b1e8-df3d30b672e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db09098-69b0-495f-86a0-79d8872dda7a", "name": "network-vif-unplugged", "status": "completed", "tag": "7edd29b1-467e-4ce7-86eb-abe21b84f0ad"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:05.545159 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:05.545159 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:05.576230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-113ccaf5-c36f-4e50-b3d9-cc7f247d6320 req-f19c1da9-5827-48ca-b1e8-df3d30b672e0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:05.579581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-113ccaf5-c36f-4e50-b3d9-cc7f247d6320 req-f19c1da9-5827-48ca-b1e8-df3d30b672e0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.615854 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-113ccaf5-c36f-4e50-b3d9-cc7f247d6320 req-f19c1da9-5827-48ca-b1e8-df3d30b672e0 service nova] Creating event network-vif-unplugged:7edd29b1-467e-4ce7-86eb-abe21b84f0ad for instance 7db09098-69b0-495f-86a0-79d8872dda7a on n-h2-828148-1 Mar 29 02:14:05.627073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-113ccaf5-c36f-4e50-b3d9-cc7f247d6320 req-f19c1da9-5827-48ca-b1e8-df3d30b672e0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097274 Mar 29 02:14:05.627852 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 573/1199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:05.643113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:05.643815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:05.662917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:05.662917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.671779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:05.671779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:05.900582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:05.932003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-023e8e28-a2a7-4113-a01b-886f8049c39a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 1.347337 Mar 29 02:14:05.933206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 627/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:04 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:05.950628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55265827-03ee-40b0-9b44-f5021fc1827f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b093a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:06.142446 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55265827-03ee-40b0-9b44-f5021fc1827f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1438 microversion: 2.1 time: 0.208043 Mar 29 02:14:06.143254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 628/1201] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:05 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1438 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:06.154377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:06.155299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:06.176768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.177261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:06.178057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.178496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:06.516626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:06.533992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:06.536471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:06.541331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a91a77a4-cd8c-4131-b990-bdbe8e9232ef tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 0.908819 Mar 29 02:14:06.566408 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 574/1202] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:05 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:06.583713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:06.583713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:06.613752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.613752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:06.613752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.613752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:06.833771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:06.847676 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4cde349c-97bd-4be4-a63f-46c5b0041fab tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1316 microversion: 2.1 time: 0.278965 Mar 29 02:14:06.849407 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 575/1203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:06 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:06.955449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:06.956121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:06.975278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.975278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:06.975278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:06.976496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:07.295385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:07.307286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f816bfe0-6642-4c32-9817-cc93cd89628d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 1.160773 Mar 29 02:14:07.313427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 629/1204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:06 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:07.334874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8deb8ef2-f8dd-4437-8bc8-cab6752c2548 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724c6d550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:08.409767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:08.424325 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60c73bba-58ef-4d97-bbae-f472d68e2bae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 1.473332 Mar 29 02:14:08.427373 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 576/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:06 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:08.435353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:08.446623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:08.462439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:08.464317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:08.467860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:08.468024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:10.183136 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:14:11.193592 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52460. Mar 29 02:14:11.492989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:11.513427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:11.516039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:11.517400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-68615f19-1a03-43ca-8a5c-18a02edc858f tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 3.088711 Mar 29 02:14:11.533267 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 577/1206] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:08 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 3105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:11.538201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3ed56810-a649-48fa-a296-791f971e0698 req-6032f2e8-7b30-4202-aae3-76cdeb7fabc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7db09098-69b0-495f-86a0-79d8872dda7a", "tag": "7edd29b1-467e-4ce7-86eb-abe21b84f0ad"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:11.540053 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:11.540053 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:11.574512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3ed56810-a649-48fa-a296-791f971e0698 req-6032f2e8-7b30-4202-aae3-76cdeb7fabc0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:11.574512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3ed56810-a649-48fa-a296-791f971e0698 req-6032f2e8-7b30-4202-aae3-76cdeb7fabc0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:11.604544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3ed56810-a649-48fa-a296-791f971e0698 req-6032f2e8-7b30-4202-aae3-76cdeb7fabc0 service nova] Creating event network-changed:7edd29b1-467e-4ce7-86eb-abe21b84f0ad for instance 7db09098-69b0-495f-86a0-79d8872dda7a on n-h2-828148-1 Mar 29 02:14:11.624054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3ed56810-a649-48fa-a296-791f971e0698 req-6032f2e8-7b30-4202-aae3-76cdeb7fabc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086663 Mar 29 02:14:11.624054 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 578/1207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:11.627296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:11.646232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:11.659606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:11.659606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:11.660902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:11.666561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:13.254903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:13.275792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e017b385-ab1d-49ed-bb0b-bfd799a44d2f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 1.645962 Mar 29 02:14:13.275792 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 579/1208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:11 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:13.282264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:13.282896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:13.306070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:13.308006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:13.311420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:13.312954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:14.932660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:14.957997 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8129af88-a1d5-4446-ad4d-e26c21496c18 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 1.677552 Mar 29 02:14:14.971993 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 580/1209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:13 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:14.985697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:14.992001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:15.017456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:15.018065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:15.029140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:15.033027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:15.787077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:15.812999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0fb4689d-2c7c-4033-b0c6-df18f8f3a494 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1364 microversion: 2.1 time: 0.833919 Mar 29 02:14:15.821295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 581/1210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:14 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1364 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:15.847262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-879079f9-18f6-4478-b6cc-04088a234b5c req-a9d37ddd-e3d7-4d38-a6c9-e85180f8ed29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-plugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:15.860520 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:15.860520 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:15.918805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-879079f9-18f6-4478-b6cc-04088a234b5c req-a9d37ddd-e3d7-4d38-a6c9-e85180f8ed29 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:15.925445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-879079f9-18f6-4478-b6cc-04088a234b5c req-a9d37ddd-e3d7-4d38-a6c9-e85180f8ed29 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:16.084191 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-879079f9-18f6-4478-b6cc-04088a234b5c req-a9d37ddd-e3d7-4d38-a6c9-e85180f8ed29 service nova] Creating event network-vif-plugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:14:16.114771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-879079f9-18f6-4478-b6cc-04088a234b5c req-a9d37ddd-e3d7-4d38-a6c9-e85180f8ed29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291134 Mar 29 02:14:16.144522 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 582/1211] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:16.159208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:16.159930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:16.181737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:16.188089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:16.191671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:16.192153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:17.770649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:17.784459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:17.791551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:17.798363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c245d3fa-5841-4457-8641-6c4897c8fc85 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1486 microversion: 2.25 time: 1.655680 Mar 29 02:14:17.809678 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 583/1212] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:16 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1486 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:17.822259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:17.823209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:17.841902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:17.844562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:17.853413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:17.853413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:20.298162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:20.318307 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af9da3d6-7590-4f01-9d0c-855847e5eb19 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 2.506932 Mar 29 02:14:20.329716 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 584/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:17 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 2519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:20.376340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:20.381516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:20.462303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:20.462303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:20.462303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:20.467351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.231879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:21.231879 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd7363df-60ec-4e1d-8f2d-7879bfa1df19 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 0.701105 Mar 29 02:14:21.231879 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 585/1214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:20 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:21.231879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:21.234202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:21.234202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.234202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.234202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.235298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.321097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:21.330020 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-037d0d49-5a80-4011-bbbc-cbd891b47f3a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1551 microversion: 2.1 time: 0.282299 Mar 29 02:14:21.330590 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 586/1215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:21 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1551 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:21.335150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6dedb7dc-25eb-4a57-a559-61648ed0c04c req-a840eee7-77db-443b-ae41-83725246b86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4c01fd-5c30-428e-8e62-f9209c626c87", "tag": "409a672e-4186-495e-87aa-4bbf92afe7b4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:21.337094 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:21.337094 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:21.346700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6dedb7dc-25eb-4a57-a559-61648ed0c04c req-a840eee7-77db-443b-ae41-83725246b86b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.347135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6dedb7dc-25eb-4a57-a559-61648ed0c04c req-a840eee7-77db-443b-ae41-83725246b86b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.363861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6dedb7dc-25eb-4a57-a559-61648ed0c04c req-a840eee7-77db-443b-ae41-83725246b86b service nova] Creating event network-changed:409a672e-4186-495e-87aa-4bbf92afe7b4 for instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 on n-h2-828148-1 Mar 29 02:14:21.369020 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6dedb7dc-25eb-4a57-a559-61648ed0c04c req-a840eee7-77db-443b-ae41-83725246b86b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037043 Mar 29 02:14:21.369865 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 587/1216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:21.378424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:21.379213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:21.387093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.387641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.388481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.389028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.603576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:21.614900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:21.616390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:21.617678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-732a0567-78bd-4f12-933c-b7fb866bfad6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1476 microversion: 2.25 time: 0.246217 Mar 29 02:14:21.618536 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 588/1217] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:21 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:21.632197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:21.632197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:21.634838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.635090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:21.636062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:21.636547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:22.006635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-375ab099-7329-4222-9351-12d205f901bd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.383531 Mar 29 02:14:22.008625 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 589/1218] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:14:21 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/os-interface => generated 284 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:22.014067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:22.015476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:22.030598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:22.033782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:22.039251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:22.039905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:23.142601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:23.152489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b32a0e5-b2d2-4d81-81f1-7ec8356ee6be tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 1.142349 Mar 29 02:14:23.164359 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 590/1219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:22 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:23.177145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-afb7dd37-9c15-4fb3-bcde-719794d77020 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '.version_select at 0x7f8717e8bd30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:23.178837 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:23.178837 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:23.180686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afb7dd37-9c15-4fb3-bcde-719794d77020 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:23.185863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afb7dd37-9c15-4fb3-bcde-719794d77020 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:23.210186 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-afb7dd37-9c15-4fb3-bcde-719794d77020 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.044298 Mar 29 02:14:23.211826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 591/1220] 10.222.0.36 () {60 vars in 1183 bytes} [Tue Mar 29 02:14:23 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:23.216137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:23.217014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:23.226516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:23.227237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:23.236479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:23.237229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:23.782377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:23.806355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16f56994-3a7d-41da-8a9f-7fe9252e9fca tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 0.583999 Mar 29 02:14:23.806355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 592/1221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:23 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:23.814562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:23.815657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:23.831719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:23.832480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:23.835050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:23.835651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:24.021855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8deb8ef2-f8dd-4437-8bc8-cab6752c2548 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1447 microversion: 2.1 time: 16.706996 Mar 29 02:14:24.023693 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 630/1222] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:07 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1447 bytes in 16708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:24.031501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d5ab5c79-359b-43c9-8c7b-c5fe26a7d8a7 req-7e648444-c619-4806-b779-fc8f029f4d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-plugged", "status": "completed", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:24.041049 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:24.041049 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:24.075946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d5ab5c79-359b-43c9-8c7b-c5fe26a7d8a7 req-7e648444-c619-4806-b779-fc8f029f4d15 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:24.081030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d5ab5c79-359b-43c9-8c7b-c5fe26a7d8a7 req-7e648444-c619-4806-b779-fc8f029f4d15 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:24.118572 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d5ab5c79-359b-43c9-8c7b-c5fe26a7d8a7 req-7e648444-c619-4806-b779-fc8f029f4d15 service nova] Creating event network-vif-plugged:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:14:24.124732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d5ab5c79-359b-43c9-8c7b-c5fe26a7d8a7 req-7e648444-c619-4806-b779-fc8f029f4d15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100340 Mar 29 02:14:24.125969 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 631/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:24.143658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2684ef41-542f-4d80-8b01-41bab7157247 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b09670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:24.224952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2684ef41-542f-4d80-8b01-41bab7157247 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 200 len: 1447 microversion: 2.1 time: 0.096332 Mar 29 02:14:24.228289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 632/1224] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:24 2022] GET /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 1447 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:24.255689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:24.255689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:24.277432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:24.278356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:24.279535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:24.280531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:24.951867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] Lazy-loading 'services' on Instance uuid 7db09098-69b0-495f-86a0-79d8872dda7a {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:14:25.030938 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd553013-e4e0-420b-bd2d-8911c341c820 tempest-LiveAutoBlockMigrationV225Test-278487198 tempest-LiveAutoBlockMigrationV225Test-278487198-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1969 microversion: 2.25 time: 1.231753 Mar 29 02:14:25.040945 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 593/1225] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:23 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1969 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:25.040945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd23b34d-c8a8-4909-81e7-cc05ba50dcaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724350c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:25.368571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:25.377952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03e35961-c792-47d6-81d8-8f1a16c8d2dd tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 1.145710 Mar 29 02:14:25.390980 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 633/1226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:24 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:25.395947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:25.396558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:25.433755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:25.433755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:25.433755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:25.433755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:26.020093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:26.029786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cec6a069-5eb3-404e-a81d-56a71a9dbfef tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1379 microversion: 2.1 time: 0.637596 Mar 29 02:14:26.044968 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 634/1227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:25 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1379 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:26.050375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:26.053406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:26.071955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:26.074312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:26.078500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:26.078500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:26.231920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:14:27.660130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11c1e08c-8b19-4712-ab78-eb4e86f483fb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 204 len: 0 microversion: 2.25 time: 1.613546 Mar 29 02:14:27.661303 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 635/1228] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:14:26 2022] DELETE /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 0 bytes in 1615 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:14:27.669037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:27.673310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:27.720829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:27.736389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:27.737556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:27.743196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:28.585162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:28.598959 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd23b34d-c8a8-4909-81e7-cc05ba50dcaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 204 len: 0 microversion: 2.1 time: 3.565955 Mar 29 02:14:28.599525 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 594/1229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:25 2022] DELETE /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 0 bytes in 3567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:14:28.608323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:28.608983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:28.629045 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc2e10f0-e516-4e49-808a-d1c162b83ad9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.962619 Mar 29 02:14:28.637844 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 636/1230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:27 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:28.642632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0291d409-dfd2-49ce-88ca-3c5395e7a95d req-f4857a12-a128-4502-9b89-7567422cff68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:28.652963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:28.653582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:28.658823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:28.659486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:28.661099 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:28.661099 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:28.693472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0291d409-dfd2-49ce-88ca-3c5395e7a95d req-f4857a12-a128-4502-9b89-7567422cff68 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:28.693920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0291d409-dfd2-49ce-88ca-3c5395e7a95d req-f4857a12-a128-4502-9b89-7567422cff68 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:28.743847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0291d409-dfd2-49ce-88ca-3c5395e7a95d req-f4857a12-a128-4502-9b89-7567422cff68 service nova] Creating event network-changed:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:14:28.755303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0291d409-dfd2-49ce-88ca-3c5395e7a95d req-f4857a12-a128-4502-9b89-7567422cff68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112821 Mar 29 02:14:28.760253 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 637/1231] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:28.784809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:28.785859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:28.799997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:28.799997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:28.800665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:28.801354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:29.721258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:29.734970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1208403-c988-471f-b2a1-a1f987d7062d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1528 microversion: 2.1 time: 0.968727 Mar 29 02:14:29.735797 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 638/1232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:28 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1528 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:29.751670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:29.752595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:29.763951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:29.763951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:29.765210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:29.766012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.268161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:30.278730 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50b5944f-cc31-490f-9734-4eee7838bc90 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1551 microversion: 2.1 time: 1.673978 Mar 29 02:14:30.284032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:30.290587 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 595/1233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:28 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1551 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:30.300358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:30.300908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:30.314587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.316332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.319716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.319716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.320584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:30.327636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:30.355230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f8a57a3-da93-4b41-8f16-4c5cf4220c19 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1482 microversion: 2.25 time: 0.589837 Mar 29 02:14:30.355230 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 639/1234] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:29 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1482 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:30.355230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0dcecdac-38ba-4aa4-8dff-75b350fec489 req-71b6178c-0849-4c0d-a735-1511a541ad26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46826a93-f066-407b-b9f1-91786295f54a", "name": "network-vif-unplugged", "status": "completed", "tag": "7eea672d-f5cf-4dbf-8cc1-7a4f4905518a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:30.355230 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:30.355230 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:30.382258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0dcecdac-38ba-4aa4-8dff-75b350fec489 req-71b6178c-0849-4c0d-a735-1511a541ad26 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.382258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0dcecdac-38ba-4aa4-8dff-75b350fec489 req-71b6178c-0849-4c0d-a735-1511a541ad26 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.396808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:14:30.412914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0dcecdac-38ba-4aa4-8dff-75b350fec489 req-71b6178c-0849-4c0d-a735-1511a541ad26 service nova] Creating event network-vif-unplugged:7eea672d-f5cf-4dbf-8cc1-7a4f4905518a for instance 46826a93-f066-407b-b9f1-91786295f54a on n-h2-828148-1 Mar 29 02:14:30.418023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0dcecdac-38ba-4aa4-8dff-75b350fec489 req-71b6178c-0849-4c0d-a735-1511a541ad26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077707 Mar 29 02:14:30.418952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 640/1235] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:30.424067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:30.424768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:30.443646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.444331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.445346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.445938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.830512 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30a86896-95e3-4bea-9045-013ed5816485 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 204 len: 0 microversion: 2.1 time: 0.538493 Mar 29 02:14:30.831110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 596/1236] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:14:30 2022] DELETE /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:14:30.836717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:30.837583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:30.856325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.856986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.857674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.858118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.879795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:30.896198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7ca3029-6177-415b-acce-8de54785d294 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.472042 Mar 29 02:14:30.897171 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 641/1237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:30 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:30.905522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:30.913741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:30.934382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.935206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:30.936495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:30.937486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:31.302329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:31.313057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-711bcfa6-de50-4c22-bc92-47f33eda3dc9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1551 microversion: 2.1 time: 0.414613 Mar 29 02:14:31.313734 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 642/1238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:30 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1551 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:31.347605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:31.362399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01592a32-3f59-46e3-80bd-e967c6a15188 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1528 microversion: 2.1 time: 0.529717 Mar 29 02:14:31.374659 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 597/1239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:30 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1528 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:31.379888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1867451333", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "f0bf6988-5c26-404c-85f6-c1676da0daf5"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:31.470615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8482224-7d2b-48a6-bee7-4ce982430429 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-953785255", "id": 1341062476, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:31.473267 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:31.473267 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:31.475676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] validate_networks() for [('f0bf6988-5c26-404c-85f6-c1676da0daf5', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:14:31.581245 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8482224-7d2b-48a6-bee7-4ce982430429 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.266173 Mar 29 02:14:31.590003 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 643/1240] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:31 2022] POST /compute/v2.1/flavors => generated 429 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:31.595178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2484c030-4299-49ca-bb40-63bacd42f581 req-82fef54d-8088-469a-993b-6582d2a90061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db09098-69b0-495f-86a0-79d8872dda7a", "name": "network-vif-deleted", "tag": "7edd29b1-467e-4ce7-86eb-abe21b84f0ad"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:31.597108 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:31.597108 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:31.611419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2484c030-4299-49ca-bb40-63bacd42f581 req-82fef54d-8088-469a-993b-6582d2a90061 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:31.625850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2484c030-4299-49ca-bb40-63bacd42f581 req-82fef54d-8088-469a-993b-6582d2a90061 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:31.680910 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2484c030-4299-49ca-bb40-63bacd42f581 req-82fef54d-8088-469a-993b-6582d2a90061 service nova] Creating event network-vif-deleted:7edd29b1-467e-4ce7-86eb-abe21b84f0ad for instance 7db09098-69b0-495f-86a0-79d8872dda7a on n-h1-828148-1 Mar 29 02:14:31.689425 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2484c030-4299-49ca-bb40-63bacd42f581 req-82fef54d-8088-469a-993b-6582d2a90061 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098056 Mar 29 02:14:31.694471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 644/1241] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:31.703722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:31.704639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:31.714124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:31.714768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:31.715946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:31.716537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:31.906044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:31.922770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:31.926223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:31.927383 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d7ea580-f029-462f-a890-a0c6d325197c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 200 len: 1266 microversion: 2.25 time: 0.231564 Mar 29 02:14:31.927926 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 645/1242] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:31 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:31.947815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db085858-c686-487c-a4ba-98edd81d7665 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:31.949025 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:31.949025 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:32.024956 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db085858-c686-487c-a4ba-98edd81d7665 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/b54bd94a-9b9f-41bd-b7cb-37d6b4b82451" status: 202 len: 0 microversion: 2.1 time: 0.083540 Mar 29 02:14:32.024956 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 646/1243] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:14:31 2022] DELETE /compute/v2.1/flavors/b54bd94a-9b9f-41bd-b7cb-37d6b4b82451 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:32.031085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e49cd32-b28f-4c27-8b1a-8ba1a24b37d5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:32.127236 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e49cd32-b28f-4c27-8b1a-8ba1a24b37d5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1341062476" status: 202 len: 0 microversion: 2.1 time: 0.101273 Mar 29 02:14:32.127810 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 647/1244] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:32 2022] DELETE /compute/v2.1/flavors/1341062476 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:32.135959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:32.136765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:32.148780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.149559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.150518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.153898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.442318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:32.452876 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-514b4703-ca3b-4f44-a31c-f0c226493183 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.320703 Mar 29 02:14:32.453669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 648/1245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:32 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:32.465083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbb9d55c-6ae1-4f5c-b20d-b09a58c625a2 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:32.472178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:14:32.473241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:14:32.473916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:14:32.474511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:14:32.474926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:14:32.484241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.484925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.485737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.486164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.492335 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbb9d55c-6ae1-4f5c-b20d-b09a58c625a2 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030946 Mar 29 02:14:32.505299 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 649/1246] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:32.505299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a055e37e-3033-4397-8d04-7cb023d69a54 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:32.507724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:14:32.514364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Getting quotas for user 530e622216e14b4daae0ea35922590c9 and project c2396365e7b94fba89f2d80d46e01af4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:14:32.551286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a055e37e-3033-4397-8d04-7cb023d69a54 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056693 Mar 29 02:14:32.552223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:14:32.559578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:14:32.566561 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 650/1247] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:32.574580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:32.576317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:32.585988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.587090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.588070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.588662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.820027 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f42c4b5f-8c12-4194-a599-61e1fd4e2d00 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.443670 Mar 29 02:14:32.824348 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 598/1248] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:14:32.844556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:32.846698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:32.856504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.857340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:32.858978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:32.859637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.075086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:33.106399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Old instance type tempest-test_resize_flavor_-1428498202, new instance type m1.heat {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:14:33.145693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:14:33.149981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:14:33.150640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:14:33.153475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:14:33.158992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:14:33.462341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:33.475949 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c15a67a-23f4-419f-880e-5265c3b5d169 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.906322 Mar 29 02:14:33.487009 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 651/1249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:32 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:33.501817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-430bec9e-864c-4fb1-a220-5aa611f4196d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1405835416", "id": 1291959714, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:33.501817 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:33.501817 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:33.684284 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9b8a6a04-c94c-4f58-9826-6c0209911125 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8/action" status: 202 len: 0 microversion: 2.1 time: 0.846641 Mar 29 02:14:33.690499 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 599/1250] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:14:32 2022] POST /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8/action => generated 0 bytes in 855 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:33.698424 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-430bec9e-864c-4fb1-a220-5aa611f4196d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.217624 Mar 29 02:14:33.712231 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 652/1251] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:33 2022] POST /compute/v2.1/flavors => generated 417 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:33.712348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1047afeb-c467-41ed-98a1-f94e19427822 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:33.712772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1047afeb-c467-41ed-98a1-f94e19427822 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:33.718553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:33.719520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 7db09098-69b0-495f-86a0-79d8872dda7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:33.738927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.739375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.740157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.740579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.888895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1047afeb-c467-41ed-98a1-f94e19427822 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:33.901584 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] HTTP exception thrown: Instance 7db09098-69b0-495f-86a0-79d8872dda7a could not be found. Mar 29 02:14:33.902509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1047afeb-c467-41ed-98a1-f94e19427822 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1208 microversion: 2.1 time: 0.209186 Mar 29 02:14:33.902868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Returning 404 to user: Instance 7db09098-69b0-495f-86a0-79d8872dda7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:33.903871 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd4aaa4f-5e74-453e-8b6b-072128adb00c tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a" status: 404 len: 111 microversion: 2.25 time: 0.196117 Mar 29 02:14:33.922754 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 653/1253] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:33 2022] GET /compute/v2.1/servers/7db09098-69b0-495f-86a0-79d8872dda7a => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:14:33.923128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 600/1253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:33 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1208 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:33.937895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:33.938843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:33.939898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:33.941416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:33.963050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.963050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.965662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.965662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.965662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.965662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:33.976773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:33.979989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:34.501055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:34.514258 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c155ad53-184c-4a52-8c91-c0f88f1dca9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.587618 Mar 29 02:14:34.515754 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 601/1254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:33 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:34.525652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:34.529105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:34.550379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:34.550379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:34.550379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:34.550379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:34.839837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:34.845436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9e51f47-05ed-4995-9354-5791af792929 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.918934 Mar 29 02:14:34.850108 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 654/1255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:33 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:34.861361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-427eeefc-bf18-4f33-bee8-9770b9913138 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:34.945130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-427eeefc-bf18-4f33-bee8-9770b9913138 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.093332 Mar 29 02:14:34.949533 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 655/1256] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:34 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:34.965779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-221870668"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:34.970198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:35.018759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.031665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.035827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.038949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.067772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:35.092863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39c4d5d8-0de0-46e3-b533-7306af01c1f7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1537 microversion: 2.1 time: 0.570479 Mar 29 02:14:35.099150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 602/1257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:34 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1537 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:35.121609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:35.122789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:35.166268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.168298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.172271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.182157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.553921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:35.564873 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a993b9e8-c7d0-4c88-8418-43752599f7f2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1204 microversion: 2.1 time: 0.460923 Mar 29 02:14:35.582068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 603/1258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:35 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1204 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:35.608144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3b3caeb8-8498-425e-bb95-ff483935a538 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:35.609269 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:35.609269 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:35.723073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3b3caeb8-8498-425e-bb95-ff483935a538 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1291959714" status: 202 len: 0 microversion: 2.1 time: 0.136490 Mar 29 02:14:35.726823 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 604/1259] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:35 2022] DELETE /compute/v2.1/flavors/1291959714 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:35.731258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9dc77629-67a2-45d3-98a9-52f481a99ec4 req-560d041b-43e7-4d94-b7ca-16b95cf08bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46826a93-f066-407b-b9f1-91786295f54a", "name": "network-vif-deleted", "tag": "7eea672d-f5cf-4dbf-8cc1-7a4f4905518a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:35.734698 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:35.734698 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:35.763847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9dc77629-67a2-45d3-98a9-52f481a99ec4 req-560d041b-43e7-4d94-b7ca-16b95cf08bbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.764727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9dc77629-67a2-45d3-98a9-52f481a99ec4 req-560d041b-43e7-4d94-b7ca-16b95cf08bbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.792561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9dc77629-67a2-45d3-98a9-52f481a99ec4 req-560d041b-43e7-4d94-b7ca-16b95cf08bbe service nova] Creating event network-vif-deleted:7eea672d-f5cf-4dbf-8cc1-7a4f4905518a for instance 46826a93-f066-407b-b9f1-91786295f54a on n-h2-828148-1 Mar 29 02:14:35.804177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9dc77629-67a2-45d3-98a9-52f481a99ec4 req-560d041b-43e7-4d94-b7ca-16b95cf08bbe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077724 Mar 29 02:14:35.805619 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 605/1260] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:35.820597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f18bf040-e8fb-4c85-ba22-2ff11935ceb5 req-c15c9eb2-7c50-4827-9cba-3237ff26e833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4c01fd-5c30-428e-8e62-f9209c626c87", "name": "network-vif-plugged", "status": "completed", "tag": "409a672e-4186-495e-87aa-4bbf92afe7b4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:35.822475 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:35.822475 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:35.832623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f18bf040-e8fb-4c85-ba22-2ff11935ceb5 req-c15c9eb2-7c50-4827-9cba-3237ff26e833 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:35.833453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f18bf040-e8fb-4c85-ba22-2ff11935ceb5 req-c15c9eb2-7c50-4827-9cba-3237ff26e833 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:35.856366 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f18bf040-e8fb-4c85-ba22-2ff11935ceb5 req-c15c9eb2-7c50-4827-9cba-3237ff26e833 service nova] Creating event network-vif-plugged:409a672e-4186-495e-87aa-4bbf92afe7b4 for instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 on n-h2-828148-1 Mar 29 02:14:35.867327 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f18bf040-e8fb-4c85-ba22-2ff11935ceb5 req-c15c9eb2-7c50-4827-9cba-3237ff26e833 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059046 Mar 29 02:14:35.868354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 606/1261] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:35.910047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-52864770-27ef-4836-b59e-904f440f3d71 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:35.994916 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-52864770-27ef-4836-b59e-904f440f3d71 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124726 Mar 29 02:14:36.011480 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 607/1262] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:36.021413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:36.027446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:36.050670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.051376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:36.053365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.053990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:36.504660 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30634a08-0be8-4dac-86e8-ea04b5ae29c6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 1.542337 Mar 29 02:14:36.506468 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 656/1263] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:14:34 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 29 02:14:36.512676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df14c184-9eb5-45cd-a8d0-5394b6e1140d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-815130508", "id": 1325024616, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:36.519202 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:36.519202 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:36.582627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:36.594721 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c534599-ef27-4dd6-b63c-aeb2b21088ef tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.578217 Mar 29 02:14:36.606820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 608/1264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:35 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:36.606820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:36.606820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:36.629003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.629538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:36.630421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.630946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:36.698275 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df14c184-9eb5-45cd-a8d0-5394b6e1140d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.184841 Mar 29 02:14:36.698275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 657/1265] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:36 2022] POST /compute/v2.1/flavors => generated 428 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:36.704012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:36.725668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:36.743806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.744268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:36.745105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:36.745544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:37.111343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:37.132105 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a16a68b-fdaa-4837-a655-b896d237b9c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1537 microversion: 2.1 time: 0.530103 Mar 29 02:14:37.139430 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 609/1266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:36 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1537 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:37.144801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43181b18-b527-4fc2-9ac1-a71d186eb619 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:37.146046 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:37.146046 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:37.287479 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43181b18-b527-4fc2-9ac1-a71d186eb619 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1325024616" status: 202 len: 0 microversion: 2.1 time: 0.146740 Mar 29 02:14:37.288697 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 610/1267] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:37 2022] DELETE /compute/v2.1/flavors/1325024616 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:37.327498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e1680ca9-cb7b-472b-a5dc-52d340661774 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:37.391037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e1680ca9-cb7b-472b-a5dc-52d340661774 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.088434 Mar 29 02:14:37.392161 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 611/1268] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:37.413306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1228f96f-7aea-41b1-a79b-9fcb94993fc3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-713803761", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:37.415625 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:37.415625 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:37.431995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:37.441488 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3c3724e-65b3-4af4-8065-3004fa1b78b9 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1268 microversion: 2.1 time: 0.741526 Mar 29 02:14:37.442101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 658/1269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:36 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1268 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:37.582939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1228f96f-7aea-41b1-a79b-9fcb94993fc3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.172675 Mar 29 02:14:37.596981 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 612/1270] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:14:37.597112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7136ad9e-dc43-4d53-8aae-5936321d261e tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:37.597112 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:37.597112 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:37.628125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:37.630093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:37.658840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:37.659884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:37.663369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:37.665612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:37.740419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7136ad9e-dc43-4d53-8aae-5936321d261e tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1e67e446-41a5-47f5-b2b3-7176aa0e86d2" status: 202 len: 0 microversion: 2.1 time: 0.149052 Mar 29 02:14:37.746833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 659/1271] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:14:37 2022] DELETE /compute/v2.1/flavors/1e67e446-41a5-47f5-b2b3-7176aa0e86d2 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:14:37.752682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b1aedfe-eb69-4383-b6d4-66dcc50ee02b tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:37.850713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b1aedfe-eb69-4383-b6d4-66dcc50ee02b tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.102345 Mar 29 02:14:37.852273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 660/1272] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:37.893253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5face834-576f-434d-96c7-0374146b6d56 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1854295417", "id": "1a5f6848-0916-46b5-beae-6ec319b8a1ac", "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:37.895237 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:37.895237 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:38.075340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5face834-576f-434d-96c7-0374146b6d56 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.208347 Mar 29 02:14:38.078743 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 661/1273] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:37 2022] POST /compute/v2.1/flavors => generated 507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:38.096481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54196800-10b8-4247-90a9-2a06f702cabe tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.146690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:38.162338 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0684e0ef-c8f7-40e4-8b40-379ac7c360a1 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1371 microversion: 2.1 time: 0.544255 Mar 29 02:14:38.162338 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 613/1274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:37 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1371 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:38.165954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.166792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:38.175626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:38.177125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:38.181327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:38.182620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:38.212360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54196800-10b8-4247-90a9-2a06f702cabe tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1a5f6848-0916-46b5-beae-6ec319b8a1ac" status: 202 len: 0 microversion: 2.1 time: 0.116089 Mar 29 02:14:38.212360 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 662/1275] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:14:38 2022] DELETE /compute/v2.1/flavors/1a5f6848-0916-46b5-beae-6ec319b8a1ac => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:14:38.218929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85c45db6-a749-4ec3-bbd7-5e15035f4e7a tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.247995 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85c45db6-a749-4ec3-bbd7-5e15035f4e7a tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033779 Mar 29 02:14:38.258651 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 663/1276] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:38.265296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d390dde-84d2-4087-b71b-e86f1f7a4cb6 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1071705039", "id": 1877875534, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:38.390723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d390dde-84d2-4087-b71b-e86f1f7a4cb6 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.130416 Mar 29 02:14:38.397133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 664/1277] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:38 2022] POST /compute/v2.1/flavors => generated 414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:38.412719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-77e4889c-4e89-4cdc-b311-710ed8c76ce5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.447497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-77e4889c-4e89-4cdc-b311-710ed8c76ce5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/1877875534" status: 200 len: 414 microversion: 2.1 time: 0.048535 Mar 29 02:14:38.454706 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 665/1278] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/flavors/1877875534 => generated 414 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:38.472232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:38.494222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-25f7c7b3-fcd8-45ee-a9d8-299606960790 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1537 microversion: 2.1 time: 0.322320 Mar 29 02:14:38.494222 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 614/1279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1537 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:38.494222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.494222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:38.506994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:38.508047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:38.512674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:38.512674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:38.675535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b02ac0f9-afc8-46d5-b21d-359be2ff0d19 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.680604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:38.692760 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1260b117-4226-4bfe-b3e7-00499c9724f6 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1266 microversion: 2.1 time: 0.204919 Mar 29 02:14:38.696313 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 615/1280] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:38.727127 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b02ac0f9-afc8-46d5-b21d-359be2ff0d19 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.271656 Mar 29 02:14:38.728782 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 666/1281] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:38.746589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36252428-f250-482f-a84b-6d5186aac02f tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.746589 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:38.746589 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:38.865221 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36252428-f250-482f-a84b-6d5186aac02f tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1877875534" status: 202 len: 0 microversion: 2.1 time: 0.126050 Mar 29 02:14:38.866958 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 616/1282] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:38 2022] DELETE /compute/v2.1/flavors/1877875534 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:38.873919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3277b828-72d2-498a-90d6-1a214e83e8c8 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:38.906673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3277b828-72d2-498a-90d6-1a214e83e8c8 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036370 Mar 29 02:14:38.907806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 667/1283] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:38.924769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a204f193-c6f7-4c53-a2d1-36da68934751 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1307802391", "id": 445151299, "os-flavor-access:is_public": "False"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:38.926591 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:38.926591 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:39.037040 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a204f193-c6f7-4c53-a2d1-36da68934751 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.116140 Mar 29 02:14:39.038661 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 617/1284] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:38 2022] POST /compute/v2.1/flavors => generated 427 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:39.048481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12991524-ded5-4861-aea8-7c7e118b1c9c tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "445151299"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:39.093440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-12991524-ded5-4861-aea8-7c7e118b1c9c tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] HTTP exception thrown: Flavor 445151299 could not be found. Mar 29 02:14:39.094064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12991524-ded5-4861-aea8-7c7e118b1c9c tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] Returning 400 to user: Flavor 445151299 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:39.094902 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12991524-ded5-4861-aea8-7c7e118b1c9c tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.050218 Mar 29 02:14:39.095474 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 668/1285] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:39 2022] POST /compute/v2.1/servers => generated 80 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:14:39.104831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-882e6751-7a49-46c6-b7ef-5ef292f27dd0 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:39.180712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:39.182273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:39.207621 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-882e6751-7a49-46c6-b7ef-5ef292f27dd0 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/445151299" status: 202 len: 0 microversion: 2.1 time: 0.107497 Mar 29 02:14:39.208580 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 618/1286] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:14:39 2022] DELETE /compute/v2.1/flavors/445151299 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:39.218520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:39.222567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:39.224292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:39.225625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-794351bc-8682-4b80-aabd-f1c2f77e409d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:39.227096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:39.300164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-794351bc-8682-4b80-aabd-f1c2f77e409d tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087353 Mar 29 02:14:39.325669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 619/1287] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:39.325669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba0e7206-76bd-4008-aac7-15a7de948a84 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1739248529", "id": 134488116, "os-flavor-access:is_public": "False"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:39.421482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba0e7206-76bd-4008-aac7-15a7de948a84 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.102896 Mar 29 02:14:39.421482 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 620/1288] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:39 2022] POST /compute/v2.1/flavors => generated 412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:14:39.426567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:39.427493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:39.438684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:39.447373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:39.450385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:39.450385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:39.554375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:14:39.832463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:39.841735 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58e5be0c-a9ee-4b16-a44f-dab7dd5cd4c8 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1556 microversion: 2.1 time: 0.666561 Mar 29 02:14:39.842308 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 669/1289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:39 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1556 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:39.861149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89619fec-5fe0-4988-92a6-4b99180e939f tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1576602584", "id": 2134850381, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:39.861149 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:39.861149 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:39.973035 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-564ab002-a6c8-425a-bbbb-ec3757409ebc tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "DELETE /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 204 len: 0 microversion: 2.25 time: 0.552137 Mar 29 02:14:39.974012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 621/1290] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:14:39 2022] DELETE /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:14:39.980069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:39.983207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:40.001661 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89619fec-5fe0-4988-92a6-4b99180e939f tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.155545 Mar 29 02:14:40.001661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 670/1291] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:39 2022] POST /compute/v2.1/flavors => generated 414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:40.007720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.008190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.009022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.009464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.012481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:40.013272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:40.024437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.024437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.025055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.025653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.474933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:40.484771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71efbe0c-4740-40f5-b066-b1fa74e6cb36 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1537 microversion: 2.1 time: 0.508966 Mar 29 02:14:40.494223 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 622/1292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:39 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1537 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:40.494223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:40.494223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:40.510263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.510263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.510263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.510263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.704317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0763540-8ee2-48cc-9ddf-d9b5bcf021d6 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.216326 Mar 29 02:14:40.705127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 623/1293] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:14:40 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:40.713194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:40.715498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:40.738899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.738899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:40.738899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:40.738899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:41.248239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:41.257762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3e8c903-549e-498b-b94a-20b91cf25b1d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 1.249731 Mar 29 02:14:41.262008 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 671/1294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:39 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:41.267369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f2d68900-bcc0-43da-9fbc-88df1b18e0ea tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.300498 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f2d68900-bcc0-43da-9fbc-88df1b18e0ea tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.037105 Mar 29 02:14:41.301961 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 672/1295] 10.222.0.36 () {58 vars in 1168 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:41.308268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a0c44911-3aec-4d97-9acc-730d8a5a931b req-275a8752-23ea-4bc1-a28c-84d9ef60afa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159164cc-2212-48ea-99c6-04dd73bbfcc2", "tag": "45f70068-e7e7-417f-928e-f809fd258f1e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:41.308499 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:41.308499 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:41.317554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a0c44911-3aec-4d97-9acc-730d8a5a931b req-275a8752-23ea-4bc1-a28c-84d9ef60afa6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:41.317997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a0c44911-3aec-4d97-9acc-730d8a5a931b req-275a8752-23ea-4bc1-a28c-84d9ef60afa6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:41.342639 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a0c44911-3aec-4d97-9acc-730d8a5a931b req-275a8752-23ea-4bc1-a28c-84d9ef60afa6 service nova] Creating event network-changed:45f70068-e7e7-417f-928e-f809fd258f1e for instance 159164cc-2212-48ea-99c6-04dd73bbfcc2 on n-h2-828148-1 Mar 29 02:14:41.353949 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a0c44911-3aec-4d97-9acc-730d8a5a931b req-275a8752-23ea-4bc1-a28c-84d9ef60afa6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049878 Mar 29 02:14:41.355169 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 673/1296] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:41.361079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cb297e17-dbdf-426f-8786-79c909082a03 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.381931 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cb297e17-dbdf-426f-8786-79c909082a03 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.025280 Mar 29 02:14:41.384175 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 674/1297] 10.222.0.36 () {58 vars in 1176 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:41.409042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6a3b68a7-8b9d-4bc1-95f2-eeab0ae47e82 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.433392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6a3b68a7-8b9d-4bc1-95f2-eeab0ae47e82 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.039063 Mar 29 02:14:41.441443 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 675/1298] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:41.448255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-59efa2ab-fd80-415f-a345-a5b8f9f38c47 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.486719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-59efa2ab-fd80-415f-a345-a5b8f9f38c47 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.023938 Mar 29 02:14:41.486719 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 676/1299] 10.222.0.36 () {58 vars in 1168 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:41.490994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c683fdc7-38d9-44bd-b0f3-69aef15e1626 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.520060 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c683fdc7-38d9-44bd-b0f3-69aef15e1626 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.033208 Mar 29 02:14:41.521335 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 677/1300] 10.222.0.36 () {58 vars in 1168 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:41.528003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.530417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:41.544860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:41.546025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:41.547351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:41.548180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:41.689688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:41.699729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:41.701936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:41.703209 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81b579ac-5d80-4a90-bc41-255e36eebfd5 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1563 microversion: 2.25 time: 0.996736 Mar 29 02:14:41.709550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 624/1301] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:40 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1563 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:41.709550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d22a00e-35fa-4d99-92fd-ff49c5e1c0e1 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.740414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d22a00e-35fa-4d99-92fd-ff49c5e1c0e1 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.034912 Mar 29 02:14:41.741034 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 625/1302] 10.222.0.36 () {58 vars in 1174 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:41.755224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-046e7002-a4b8-4cbd-9cea-cedba49350c3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.795193 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-046e7002-a4b8-4cbd-9cea-cedba49350c3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.042984 Mar 29 02:14:41.796268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 626/1303] 10.222.0.36 () {58 vars in 1172 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:41.819741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-889b3461-b3a9-4ee1-a574-6af60571c5af tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.892561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-889b3461-b3a9-4ee1-a574-6af60571c5af tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.085134 Mar 29 02:14:41.893303 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 627/1304] 10.222.0.36 () {58 vars in 1168 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:41.907877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-490b251e-7ee0-404a-afc9-69aa797f78ef tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:41.908788 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:41.908788 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:42.019193 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-490b251e-7ee0-404a-afc9-69aa797f78ef tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2134850381" status: 202 len: 0 microversion: 2.1 time: 0.115311 Mar 29 02:14:42.024113 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 628/1305] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:41 2022] DELETE /compute/v2.1/flavors/2134850381 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:14:42.036532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b87a765e-4b83-4f89-be93-74e3620d69a5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.088066 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b87a765e-4b83-4f89-be93-74e3620d69a5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061959 Mar 29 02:14:42.097677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 629/1306] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.116673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7f49dbd-42e1-482e-9d08-bffb8237a538 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.218651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7f49dbd-42e1-482e-9d08-bffb8237a538 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/134488116" status: 202 len: 0 microversion: 2.1 time: 0.115266 Mar 29 02:14:42.219226 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 630/1307] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:14:42 2022] DELETE /compute/v2.1/flavors/134488116 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:42.224691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cc14db20-3831-46ac-90b4-f67567231254 req-3c393fa3-9c05-418b-a018-a651ef6d2ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-plugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:42.226136 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:42.226136 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:42.245557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cc14db20-3831-46ac-90b4-f67567231254 req-3c393fa3-9c05-418b-a018-a651ef6d2ba0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:42.246607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cc14db20-3831-46ac-90b4-f67567231254 req-3c393fa3-9c05-418b-a018-a651ef6d2ba0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:42.292827 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cc14db20-3831-46ac-90b4-f67567231254 req-3c393fa3-9c05-418b-a018-a651ef6d2ba0 service nova] Creating event network-vif-plugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:14:42.299125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cc14db20-3831-46ac-90b4-f67567231254 req-3c393fa3-9c05-418b-a018-a651ef6d2ba0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078628 Mar 29 02:14:42.300426 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 631/1308] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:42.309123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51594e2e-0990-4427-8423-add82face1be tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.311725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:42.330087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-507f4cae-bde4-4adf-9d5d-8b4bab923133 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.804688 Mar 29 02:14:42.343053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 678/1309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:41 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.349933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.352083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:42.352216 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51594e2e-0990-4427-8423-add82face1be tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049199 Mar 29 02:14:42.363190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:42.364477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:42.365048 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 632/1310] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.365734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:42.366489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:42.369708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4dfd7b8-4ef2-4999-9b13-5238ca3b9ee1 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1481839235", "id": 1071964526, "os-flavor-access:is_public": "False"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:42.371289 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:42.371289 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:42.483188 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4dfd7b8-4ef2-4999-9b13-5238ca3b9ee1 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.116953 Mar 29 02:14:42.483786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 633/1311] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:42 2022] POST /compute/v2.1/flavors => generated 415 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:42.494113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fe0aae9-b150-421d-a1e5-7b27a139a3e5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.523629 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0fe0aae9-b150-421d-a1e5-7b27a139a3e5 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033036 Mar 29 02:14:42.534024 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 634/1312] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.538914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71815a56-6586-4643-bf5f-fc6bcc069591 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.567557 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71815a56-6586-4643-bf5f-fc6bcc069591 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032154 Mar 29 02:14:42.577025 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 635/1313] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.587448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78fc166c-41b2-4118-b886-04866cdcfc85 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.588218 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:42.588218 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:42.664018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78fc166c-41b2-4118-b886-04866cdcfc85 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1071964526" status: 202 len: 0 microversion: 2.1 time: 0.083330 Mar 29 02:14:42.667030 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 636/1314] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:42 2022] DELETE /compute/v2.1/flavors/1071964526 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:14:42.672746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf54d536-53ae-49de-b44f-193007135105 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.729268 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf54d536-53ae-49de-b44f-193007135105 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056696 Mar 29 02:14:42.729268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 637/1315] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:42.752413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:42.752413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:42.752413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:42.753379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:42.754690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:42.755330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:42.974281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:42.984057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-538b8cc9-a5b1-4d4d-a1cb-d8a3e4b90e45 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.639804 Mar 29 02:14:42.995031 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 679/1316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:43.000395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-465fe7c2-b7ac-401a-97ae-3258a189c943 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1152033297", "id": 1599843606, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:43.002247 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:43.002247 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:43.024941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:43.047880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:43.049638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:43.051292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca0d3be5-8ef9-4ca4-90a2-1c34b2a5c0fa tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1521 microversion: 2.25 time: 0.323648 Mar 29 02:14:43.059097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 638/1317] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:42 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:43.123914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-465fe7c2-b7ac-401a-97ae-3258a189c943 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.121617 Mar 29 02:14:43.130107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 680/1318] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:14:42 2022] POST /compute/v2.1/flavors => generated 414 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:43.136457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2bea90f1-e84b-4dac-b706-c4cf43285111 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:43.197855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2bea90f1-e84b-4dac-b706-c4cf43285111 tempest-FlavorsAdminTestJSON-1268645817 tempest-FlavorsAdminTestJSON-1268645817-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.064389 Mar 29 02:14:43.202136 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 639/1319] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:43 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:43.227900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f2aff6d0-ce56-4166-876d-438cb9aa8ef3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:43.231768 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:43.231768 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:43.283272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f2aff6d0-ce56-4166-876d-438cb9aa8ef3 tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/1599843606" status: 202 len: 0 microversion: 2.1 time: 0.064606 Mar 29 02:14:43.285532 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 681/1320] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:14:43 2022] DELETE /compute/v2.1/flavors/1599843606 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:14:43.293493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a66f1099-8d8a-4969-9094-234d38b8119e tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:43.351420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5f24b638-0b96-4610-be80-9b5e225cd8b3 req-e547ca4d-6dde-479a-aff3-e6a5a2b2e45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4c01fd-5c30-428e-8e62-f9209c626c87", "tag": "409a672e-4186-495e-87aa-4bbf92afe7b4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:43.352293 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a66f1099-8d8a-4969-9094-234d38b8119e tempest-FlavorsAdminTestJSON-522613027 tempest-FlavorsAdminTestJSON-522613027-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059574 Mar 29 02:14:43.353619 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 640/1321] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:43.355728 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:43.355728 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:43.361442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:43.362665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:43.379238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5f24b638-0b96-4610-be80-9b5e225cd8b3 req-e547ca4d-6dde-479a-aff3-e6a5a2b2e45a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:43.380754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5f24b638-0b96-4610-be80-9b5e225cd8b3 req-e547ca4d-6dde-479a-aff3-e6a5a2b2e45a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:43.403182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:43.404589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:43.405539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:43.407912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:43.430747 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5f24b638-0b96-4610-be80-9b5e225cd8b3 req-e547ca4d-6dde-479a-aff3-e6a5a2b2e45a service nova] Creating event network-changed:409a672e-4186-495e-87aa-4bbf92afe7b4 for instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 on n-h2-828148-1 Mar 29 02:14:43.449833 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5f24b638-0b96-4610-be80-9b5e225cd8b3 req-e547ca4d-6dde-479a-aff3-e6a5a2b2e45a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108931 Mar 29 02:14:43.462421 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 682/1322] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:14:43.626146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3ebcea28-3cab-431f-bbec-d8c8bb423346 req-a7fb2a6f-7cf4-403f-8ca4-3c7731617c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "314c9d8f-a6a4-4bc1-bcc4-9a48b6235598", "name": "network-vif-deleted", "tag": "3f5634f6-fe04-45d7-b5ec-b32dc63c8872"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:43.628741 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:43.628741 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:43.666824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3ebcea28-3cab-431f-bbec-d8c8bb423346 req-a7fb2a6f-7cf4-403f-8ca4-3c7731617c7a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:43.667263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3ebcea28-3cab-431f-bbec-d8c8bb423346 req-a7fb2a6f-7cf4-403f-8ca4-3c7731617c7a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:43.730553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3ebcea28-3cab-431f-bbec-d8c8bb423346 req-a7fb2a6f-7cf4-403f-8ca4-3c7731617c7a service nova] Creating event network-vif-deleted:3f5634f6-fe04-45d7-b5ec-b32dc63c8872 for instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 on n-h2-828148-1 Mar 29 02:14:43.752435 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3ebcea28-3cab-431f-bbec-d8c8bb423346 req-a7fb2a6f-7cf4-403f-8ca4-3c7731617c7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130343 Mar 29 02:14:43.754548 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 683/1323] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:44.004828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:44.005566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:44.026987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:44.038683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:44.038683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:44.038683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:44.147881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:44.161065 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fd9fa15-2098-447a-a93a-961de735aab4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.806050 Mar 29 02:14:44.164234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 641/1324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:43 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:44.170832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:44.171840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:44.182082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:44.183101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:44.184390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:44.185391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:44.332705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:44.336684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:44.338147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lazy-loading 'fault' on Instance uuid 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:14:44.422101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:44.434421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:44.438197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:44.439733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb98a2c6-3380-42c3-94c5-fe31347d10cb tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 200 len: 1351 microversion: 2.25 time: 0.274053 Mar 29 02:14:44.452410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 642/1325] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:44 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 1351 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:44.754040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:44.767574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dc379a2-f42b-4d9b-b22d-3d77fb56d543 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.769871 Mar 29 02:14:44.770798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 684/1326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:43 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:45.180741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:45.182167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:45.192504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.194754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.197384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.199466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.463339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:45.463339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:45.473585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.474772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.476075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.476821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.544178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:45.561594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86c682fc-8949-4001-a2c6-d53d567d45d8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.382317 Mar 29 02:14:45.562073 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 643/1327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:45 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:45.591725 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] HTTP exception thrown: Instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 could not be found. Mar 29 02:14:45.592669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Returning 404 to user: Instance 314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:45.593901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-52791fd0-a0e5-4749-925e-db70485f5961 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598" status: 404 len: 111 microversion: 2.25 time: 0.138975 Mar 29 02:14:45.597610 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 685/1328] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:45 2022] GET /compute/v2.1/servers/314c9d8f-a6a4-4bc1-bcc4-9a48b6235598 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:14:45.603061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:45.603558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:45.613701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.614032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.614814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.615245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.744231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:14:45.785419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:45.785926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:45.799489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.799826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:45.801653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:45.802222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:46.066273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:46.076291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5eed1905-b971-43f7-91fc-1b95ca08628f tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.295066 Mar 29 02:14:46.086151 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 686/1329] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:45 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:46.183790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-009ab3a2-d86d-4076-9c0f-9407a8586162 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 204 len: 0 microversion: 2.25 time: 0.584271 Mar 29 02:14:46.184383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 644/1330] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:14:45 2022] DELETE /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:14:46.192790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:46.197057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:46.216634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:46.217313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:46.218280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:46.219028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:46.580528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:46.581452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:46.611888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:46.612346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:46.613971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:46.614824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:46.782809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:46.794549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:46.796042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:46.797213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5dc0593b-3b8f-42bd-9645-540f1b5325d9 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1548 microversion: 2.25 time: 0.608317 Mar 29 02:14:46.811372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 687/1331] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:46 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1548 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:47.041629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:47.062518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-695f5021-6c80-4b2d-9730-453ee91047d7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.487408 Mar 29 02:14:47.074193 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 645/1332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:46 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:47.094243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:47.094850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:47.116959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:47.117776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:47.118599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:47.119081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:47.830022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:47.831700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:47.847150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:47.849375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:47.858588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:47.859055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:47.961502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:47.996618 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7961430c-330c-418f-86ae-25f6d0b65be7 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.899728 Mar 29 02:14:47.999803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 688/1333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:47 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:48.082155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:48.082768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:48.093011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:48.093737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:48.094699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:48.095131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:48.427840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:48.441465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:48.445635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:48.447256 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4cffa2eb-d760-43a5-961a-8cf5a3396f1b tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1548 microversion: 2.25 time: 0.621864 Mar 29 02:14:48.461231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 646/1334] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:47 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1548 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:14:48.983956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:49.002326 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b199c09-7095-48ec-8993-8d8f357093a8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.925389 Mar 29 02:14:49.011841 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 689/1335] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:48 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:49.017735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:49.018665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:49.031126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:49.031905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:49.033329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:49.033922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:49.090245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3840a679-e7a0-4340-89e3-d4ea534abec5 req-20ebed1f-3dbb-4ad1-8cbe-c50f778d4ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7b90c86-71ca-4d35-9054-c7ecd9b1378e", "name": "network-vif-deleted", "tag": "e139874d-b1f4-4d8a-8c23-436287526c98"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:49.090245 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:49.090245 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:49.092106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3840a679-e7a0-4340-89e3-d4ea534abec5 req-20ebed1f-3dbb-4ad1-8cbe-c50f778d4ea8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:49.092730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3840a679-e7a0-4340-89e3-d4ea534abec5 req-20ebed1f-3dbb-4ad1-8cbe-c50f778d4ea8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:49.129219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3840a679-e7a0-4340-89e3-d4ea534abec5 req-20ebed1f-3dbb-4ad1-8cbe-c50f778d4ea8 service nova] Creating event network-vif-deleted:e139874d-b1f4-4d8a-8c23-436287526c98 for instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e on n-h2-828148-1 Mar 29 02:14:49.155670 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3840a679-e7a0-4340-89e3-d4ea534abec5 req-20ebed1f-3dbb-4ad1-8cbe-c50f778d4ea8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079227 Mar 29 02:14:49.158112 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 690/1336] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:49.469657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:49.470511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:49.512584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:49.512584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:49.512584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:49.512584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:49.592641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:49.602723 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c49ef5a3-ab2d-4c88-80eb-3e1f85a43ed4 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.589507 Mar 29 02:14:49.603308 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 647/1337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:49 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:50.019457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:50.020025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:50.041390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:50.041390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:50.041390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:50.041390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:50.206780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:50.220319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:50.228437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:50.233919 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b403b56-0f6a-490e-9d79-3270583e3324 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 200 len: 1506 microversion: 2.25 time: 0.769582 Mar 29 02:14:50.241172 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 691/1338] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:49 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 1506 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:14:50.253551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f0d13761-c98a-4580-9347-cf06cb406251 req-b5a69104-b481-4456-a33e-fff42a73b432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159164cc-2212-48ea-99c6-04dd73bbfcc2", "name": "network-vif-plugged", "status": "completed", "tag": "45f70068-e7e7-417f-928e-f809fd258f1e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:50.255559 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:50.255559 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:50.271142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f0d13761-c98a-4580-9347-cf06cb406251 req-b5a69104-b481-4456-a33e-fff42a73b432 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:50.280508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f0d13761-c98a-4580-9347-cf06cb406251 req-b5a69104-b481-4456-a33e-fff42a73b432 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:50.299397 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f0d13761-c98a-4580-9347-cf06cb406251 req-b5a69104-b481-4456-a33e-fff42a73b432 service nova] Creating event network-vif-plugged:45f70068-e7e7-417f-928e-f809fd258f1e for instance 159164cc-2212-48ea-99c6-04dd73bbfcc2 on n-h2-828148-1 Mar 29 02:14:50.310273 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f0d13761-c98a-4580-9347-cf06cb406251 req-b5a69104-b481-4456-a33e-fff42a73b432 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058048 Mar 29 02:14:50.311523 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 692/1339] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:50.566696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:50.576824 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31bf5d87-6ce9-405e-ab7c-d51dbde2aabd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.561481 Mar 29 02:14:50.586731 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 648/1340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:50 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:50.649721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:50.652142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:50.667266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:50.667713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:50.670425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:50.670425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.178366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:51.189829 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-068b392e-5b58-4b4e-86b9-7393c2e7aab8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1308 microversion: 2.1 time: 0.564210 Mar 29 02:14:51.200909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 693/1341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:50 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1308 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:51.259467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:51.260627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: a7b90c86-71ca-4d35-9054-c7ecd9b1378e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:51.288328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.288328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.288328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.288328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.371089 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] HTTP exception thrown: Instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e could not be found. Mar 29 02:14:51.371763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Returning 404 to user: Instance a7b90c86-71ca-4d35-9054-c7ecd9b1378e could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:51.373298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fab05404-0f4e-4851-9468-284b92ace970 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e" status: 404 len: 111 microversion: 2.25 time: 0.119120 Mar 29 02:14:51.373882 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 649/1342] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:51 2022] GET /compute/v2.1/servers/a7b90c86-71ca-4d35-9054-c7ecd9b1378e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:14:51.386471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:51.387735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:51.397323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.410237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.410237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.410237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.521643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:14:51.687980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1d0f1a0-e795-4b03-b3de-c1c38ae9b653 tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1580262631", "id": 132232341, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:51.689911 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:51.689911 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:51.790004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1d0f1a0-e795-4b03-b3de-c1c38ae9b653 tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.86 time: 0.327605 Mar 29 02:14:51.791119 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 650/1343] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:14:51 2022] POST /compute/v2.1/flavors => generated 468 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:14:51.797589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:51.798830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:51.807784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.817314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:51.817314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:51.817314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.010158 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-310ee96c-c574-4fe4-82da-b55ba06b93a6 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "DELETE /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 204 len: 0 microversion: 2.25 time: 0.627825 Mar 29 02:14:52.010158 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 694/1344] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:14:51 2022] DELETE /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 29 02:14:52.015493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f85f349-8e56-4bdf-ae92-996ea2a0df9d tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:52.016739 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:52.016739 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:52.147238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:52.156959 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c46b86a-7d9a-446d-a914-39177bd5aba9 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.362922 Mar 29 02:14:52.158227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 651/1345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:51 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:52.163164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:52.164248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:52.180971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.180971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.180971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.180971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.354168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f85f349-8e56-4bdf-ae92-996ea2a0df9d tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors/132232341/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.345691 Mar 29 02:14:52.354762 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 695/1346] 10.222.0.36 () {62 vars in 1261 bytes} [Tue Mar 29 02:14:52 2022] POST /compute/v2.1/flavors/132232341/os-extra_specs => generated 62 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:52.368405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:52.369244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:52.476398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.476398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.476398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.476398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.477910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:52.477910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:52.478422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:52.478422 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0dd0d21b-7c2e-4f2c-8d0b-d7fc01ab9717 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1562 microversion: 2.25 time: 0.287503 Mar 29 02:14:52.478422 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 652/1347] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:52 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1562 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:52.478422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d4215ddc-ba2f-44e8-b167-9cb694818d64 tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:52.478715 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:52.478715 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:52.764863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:52.773323 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-035e9c09-1648-46dd-8ef6-abacdf5530d0 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1487 microversion: 2.1 time: 0.415509 Mar 29 02:14:52.774205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 696/1348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:52 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1487 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:52.789625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1825196424"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:52.790648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:52.799222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.799954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.800727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:52.801338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:52.960664 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d4215ddc-ba2f-44e8-b167-9cb694818d64 tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/132232341" status: 202 len: 0 microversion: 2.86 time: 0.511413 Mar 29 02:14:52.965102 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 653/1349] 10.222.0.36 () {60 vars in 1198 bytes} [Tue Mar 29 02:14:52 2022] DELETE /compute/v2.1/flavors/132232341 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:14:52.970223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6edfa492-07db-4463-9e0f-b029dc5a044c tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:53.014187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6edfa492-07db-4463-9e0f-b029dc5a044c tempest-FlavorMetadataValidation-2106674757 tempest-FlavorMetadataValidation-2106674757-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.032308 Mar 29 02:14:53.014187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 654/1350] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:14:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:53.175797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:53.177200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:53.197118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:53.197118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:53.201571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:53.202208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:53.501008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:53.516648 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b87eb20-2fd7-4ef1-bd72-c39af72d483a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.345404 Mar 29 02:14:53.517783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 655/1351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:53 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:53.531823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:53.534179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:53.546603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:53.547704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:53.549506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:53.550321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:53.808550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:53.819778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:53.822011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:53.823599 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f4c788c6-0f58-490f-be35-1a15e9d8d1b1 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1520 microversion: 2.25 time: 0.304443 Mar 29 02:14:53.824317 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 656/1352] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:53 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:53.829310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e5bc79e1-3b38-4c36-9165-d80afd4e63c9 req-1a58a0d0-e2f7-4fc6-8417-81429a86e4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e8a0c5-a941-47af-b28c-c046992c73c3", "name": "network-vif-deleted", "tag": "41aa3791-d19b-4bc0-ab29-529b6db14c53"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:14:53.830942 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:53.830942 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:53.847481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e5bc79e1-3b38-4c36-9165-d80afd4e63c9 req-1a58a0d0-e2f7-4fc6-8417-81429a86e4d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:53.848198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e5bc79e1-3b38-4c36-9165-d80afd4e63c9 req-1a58a0d0-e2f7-4fc6-8417-81429a86e4d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:53.869942 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e5bc79e1-3b38-4c36-9165-d80afd4e63c9 req-1a58a0d0-e2f7-4fc6-8417-81429a86e4d1 service nova] Creating event network-vif-deleted:41aa3791-d19b-4bc0-ab29-529b6db14c53 for instance 28e8a0c5-a941-47af-b28c-c046992c73c3 on n-h2-828148-1 Mar 29 02:14:53.883179 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e5bc79e1-3b38-4c36-9165-d80afd4e63c9 req-1a58a0d0-e2f7-4fc6-8417-81429a86e4d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057006 Mar 29 02:14:53.884264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 657/1353] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:54.535734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:54.536452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:54.550517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:54.551252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:54.552268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:54.553158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:54.854788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:54.865034 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba8ff991-dc4c-4ad1-9851-5c4c4f3082ec tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.333598 Mar 29 02:14:54.866709 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 658/1354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:54 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:54.872237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:54.873171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:54.882565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:54.883669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:54.885201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:54.886120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:54.992092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:54.992092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:54.992092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lazy-loading 'fault' on Instance uuid 28e8a0c5-a941-47af-b28c-c046992c73c3 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:14:55.047252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:55.062850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:55.065041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f540281478cf4d929afbce240e2f4c66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '911013484e864ba6a9a60a8d7198fb7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:55.066878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-751e2322-b0bf-4c28-ac39-253f897c13a4 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 200 len: 1351 microversion: 2.25 time: 0.198692 Mar 29 02:14:55.080822 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 659/1355] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:54 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 1351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:14:55.883132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:55.884128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:55.892534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:55.893215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:55.894463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:55.895158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:56.216948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:56.225898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8146afc6-c6b8-4452-a879-da1d6e44cdf0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.346476 Mar 29 02:14:56.235279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 660/1356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:55 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:56.243501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:56.252456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] [instance: 28e8a0c5-a941-47af-b28c-c046992c73c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:56.254311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:56.255314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:56.256322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:56.256947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:56.342501 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] HTTP exception thrown: Instance 28e8a0c5-a941-47af-b28c-c046992c73c3 could not be found. Mar 29 02:14:56.343111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] Returning 404 to user: Instance 28e8a0c5-a941-47af-b28c-c046992c73c3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:56.344147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5e1f19d6-582c-4bcc-b618-8db3a7a30867 tempest-LiveAutoBlockMigrationV225Test-1006997331 tempest-LiveAutoBlockMigrationV225Test-1006997331-project] 10.222.0.36 "GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3" status: 404 len: 111 microversion: 2.25 time: 0.104947 Mar 29 02:14:56.344710 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 661/1357] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:14:56 2022] GET /compute/v2.1/servers/28e8a0c5-a941-47af-b28c-c046992c73c3 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:14:56.789548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65d2a1fa-d5ac-4650-a13a-15c918dc8d2b tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "POST /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2/action" status: 202 len: 0 microversion: 2.1 time: 4.003190 Mar 29 02:14:56.801493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed9b39c9-40b0-4f02-beb1-7b280e336493 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f872405d3a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:56.806461 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 697/1358] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:14:52 2022] POST /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2/action => generated 0 bytes in 4017 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 29 02:14:56.901856 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed9b39c9-40b0-4f02-beb1-7b280e336493 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362" status: 200 len: 1412 microversion: 2.1 time: 0.104366 Mar 29 02:14:56.902880 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 662/1359] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:56 2022] GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:56.916176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-047ef5e3-c491-4294-8e2b-1adf99044b38 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f87241370d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:57.160401 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-047ef5e3-c491-4294-8e2b-1adf99044b38 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362" status: 200 len: 1412 microversion: 2.1 time: 0.248609 Mar 29 02:14:57.161276 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 698/1360] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:56 2022] GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362 => generated 1412 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:57.180239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b988394d-90b2-4556-8a2e-1b7f03a69673 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724d41820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:57.251390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:57.252446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:57.265545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:57.266255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:57.267337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:57.268032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:57.584530 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b988394d-90b2-4556-8a2e-1b7f03a69673 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362" status: 204 len: 0 microversion: 2.1 time: 0.406143 Mar 29 02:14:57.584530 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 663/1361] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:57 2022] DELETE /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:14:57.585482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4fc0098d-7b92-4214-a3d2-7aad8b526eaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724d418b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:57.637092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4fc0098d-7b92-4214-a3d2-7aad8b526eaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Image not found. Mar 29 02:14:57.637804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4fc0098d-7b92-4214-a3d2-7aad8b526eaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:14:57.639404 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4fc0098d-7b92-4214-a3d2-7aad8b526eaa tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362" status: 404 len: 62 microversion: 2.1 time: 0.059052 Mar 29 02:14:57.640479 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 664/1362] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:14:57 2022] GET /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:14:57.655848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:57.657469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:57.679202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:57.682528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:57.687786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:57.688920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:58.039802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:58.052406 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb005c7c-821b-4502-8077-19d8cf95cc13 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.805136 Mar 29 02:14:58.052406 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 699/1363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:57 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:58.364273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:58.368797 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fef20785-ba3a-4b83-a018-cd1c023730da tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1499 microversion: 2.1 time: 0.723935 Mar 29 02:14:58.369862 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 665/1364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:57 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1499 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:14:58.933631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:58.956997 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:58.956997 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:14:58.978266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:58.978266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Searching by: {'deleted': False, 'project_id': '49c2cea4684f4d06830d9a5464950077'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:14:59.013761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.022783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.028574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.031533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.068619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:59.072563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:59.091939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.092458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.093379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.093806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.300636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:14:59.460560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e869b96-70f9-4456-84ba-c39f65bd5981 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.540223 Mar 29 02:14:59.461781 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 700/1365] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:14:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:14:59.466429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:59.467357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:14:59.482235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.482694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.483815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.483959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.595367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:59.606273 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29fac182-7ad9-4287-a6aa-0703297b0d66 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.541881 Mar 29 02:14:59.610197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 666/1366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:59 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:14:59.639896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:14:59.657550 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:14:59.657550 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:14:59.666422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:14:59.666422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Searching by: {'deleted': False, 'project_id': '49c2cea4684f4d06830d9a5464950077'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:14:59.679124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.679578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.680388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:14:59.680822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:14:59.819586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:15:00.071905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:00.082138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:00.083320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:00.383446 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cde8d9c7-8485-4095-a3a2-e4ad2186b76e tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.747299 Mar 29 02:15:00.383446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 667/1367] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:14:59 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:00.402002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a22ddda2-66f8-4193-af1c-d39fdd01bbe7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:00.428555 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a22ddda2-66f8-4193-af1c-d39fdd01bbe7 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030988 Mar 29 02:15:00.429761 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 668/1368] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:15:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:00.470310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:00.476121 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fc49ba62-a08d-4543-882b-d245e70f4bb3 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1505 microversion: 2.1 time: 1.013226 Mar 29 02:15:00.477255 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 701/1369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:14:59 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1505 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:00.631394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:00.632013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:00.647714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:00.659740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:00.660598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:00.661135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:00.761104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:00.761903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:00.785532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:00.786769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:00.787912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:00.788677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:00.879413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:15:01.086180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:01.098435 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-278ae4bc-fd5d-40dd-8323-109aad8c8d0a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.473437 Mar 29 02:15:01.099016 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 669/1370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:00 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:01.489534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d84066f-759d-4ed6-8eb9-37dcb70fc189 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "DELETE /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 204 len: 0 microversion: 2.1 time: 0.732730 Mar 29 02:15:01.495627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 702/1371] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:00 2022] DELETE /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:15:01.504009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:01.504917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:01.520716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:01.525830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:01.549243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.553139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:01.557700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.560534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:01.567067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.567763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:01.574466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.574943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:01.914917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:01.927264 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9407736-be73-43dd-bc19-a62165195e57 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1487 microversion: 2.1 time: 0.425918 Mar 29 02:15:01.947683 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 703/1372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:01 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1487 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:01.959553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:01.960200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:01.968045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.968791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:01.969732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:01.970267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.044108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:15:02.069514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:02.083520 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e25c7fc8-9b18-4664-b7f4-8b970f0b7589 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1608 microversion: 2.1 time: 0.588478 Mar 29 02:15:02.089720 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 670/1373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:01 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1608 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:02.304938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8725e6ce50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.306128 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:02.306128 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:02.307774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.308218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.309151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.311477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.391814 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-049c5255-3e20-4352-871a-f4fb1e7b796a tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.267258 Mar 29 02:15:02.391814 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 671/1374] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:02.394890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.397651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:02.408314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.409030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.410197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.411027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.774805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:02.793003 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41ae1d81-15bf-4e7f-bf80-5c00e8731ca3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1542 microversion: 2.1 time: 0.418283 Mar 29 02:15:02.809607 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 672/1375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1542 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:02.820494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f87240d5b80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.826854 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:02.826854 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:02.828962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.829614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.830688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.831312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.863654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e63f6a79-9e81-4fc4-8809-bdc4ec1d1d88 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.048760 Mar 29 02:15:02.864267 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 673/1376] 10.222.0.36 () {58 vars in 1138 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:02.875910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8717e555e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.877139 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:02.877139 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:02.878578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.879224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.880032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.880912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.908202 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-011ba535-66ea-478f-94f4-31e2ac819e3c tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.035360 Mar 29 02:15:02.908462 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 674/1377] 10.222.0.36 () {58 vars in 1144 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:15:02.918957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8724d41c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.920330 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:02.920330 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:02.921796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.922245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.923038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.923471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.951164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f97447a-5a87-4f67-b3db-5d68cfdc84e8 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.035609 Mar 29 02:15:02.951756 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 675/1378] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:02.960476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8717e55670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:02.961719 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:02.961719 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:02.963127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.963570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.964381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:02.964794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:02.990740 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1548018f-1b23-4269-9d52-0867f6aa2d55 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.033466 Mar 29 02:15:02.991300 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 676/1379] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:03.001702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8717d57c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.002813 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:03.002813 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:03.004226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.004669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.005493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.005923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.032006 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29e8d47a-0da2-4b0a-ae6f-f2213bb2a7f7 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.033447 Mar 29 02:15:03.032576 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 677/1380] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:15:02 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:03.041278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f8717e55d30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.042044 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:03.042044 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:03.049557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.050006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.065604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.066050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.095667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21382321-87a2-4cb4-a9e5-312bc26ea442 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h2-828148-1" status: 200 len: 729 microversion: 2.1 time: 0.057518 Mar 29 02:15:03.096547 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 678/1381] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:15:03 2022] GET /compute/v2.1/os-hosts/n-h2-828148-1 => generated 729 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:03.102238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.102901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:03.111383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.111828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.112584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.113036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe5d6742-18c8-427b-805b-85d8d6261bbd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 204 len: 0 microversion: 2.1 time: 1.326081 Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 704/1382] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:01 2022] DELETE /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 0 bytes in 1328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Calling method '.version_select at 0x7f87242e8670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hosts:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:03.292467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.293616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.309947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.310537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.349825 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcfb8cc1-5c00-46d0-a94f-d48affff54b2 tempest-HostsAdminTestJSON-8340783 tempest-HostsAdminTestJSON-8340783-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hosts/n-h1-828148-1" status: 200 len: 729 microversion: 2.1 time: 0.072668 Mar 29 02:15:03.350758 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 705/1383] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:15:03 2022] GET /compute/v2.1/os-hosts/n-h1-828148-1 => generated 729 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:03.356790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2aad4e86-c068-42b0-a573-312828d00e40 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b99d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.419762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:03.434398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2aad4e86-c068-42b0-a573-312828d00e40 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Image not found. Mar 29 02:15:03.435022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2aad4e86-c068-42b0-a573-312828d00e40 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:03.435853 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2aad4e86-c068-42b0-a573-312828d00e40 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362" status: 404 len: 62 microversion: 2.1 time: 0.083941 Mar 29 02:15:03.436413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 706/1384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:03 2022] DELETE /compute/v2.1/images/e5d160b5-a88b-496f-b40f-bedc70631362 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:15:03.444670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.445514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:03.460162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.460936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.461953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.462546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.467092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-846390a4-662b-42a7-a4ab-d3763391ee08 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1608 microversion: 2.1 time: 0.368069 Mar 29 02:15:03.480003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 679/1385] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:03 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1608 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:03.561135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:15:03.817390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.818524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:03.844574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.846186 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Instance is already in deleting state, ignoring this request Mar 29 02:15:03.847001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-445ea7ef-b65d-4e21-87aa-8817d7ece574 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 204 len: 0 microversion: 2.1 time: 0.406189 Mar 29 02:15:03.847758 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 707/1386] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:03 2022] DELETE /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:15:03.848630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.850055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.850648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.858851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:03.865500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:03.892951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.893532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:03.894591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:03.897967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:04.249915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:04.266215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8017ec4c-5634-4b6d-a682-48117233f9c2 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1493 microversion: 2.1 time: 0.413290 Mar 29 02:15:04.273927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 708/1387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:03 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1493 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:04.495545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:04.497740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:04.505262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:04.506127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:04.507460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:04.508093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:04.595001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:04.604735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1cf4127b-f608-4972-9f44-46e8ffe9a203 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1541 microversion: 2.1 time: 0.797080 Mar 29 02:15:04.607302 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 680/1388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:03 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1541 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:04.901144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:04.911217 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9511958d-fd77-4b1e-bf35-78bf60113bf0 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1608 microversion: 2.1 time: 0.418809 Mar 29 02:15:04.911923 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 709/1389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:04 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1608 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:05.283837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:05.284504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:05.297835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:05.298668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:05.299618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:05.300336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:05.622928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:05.623556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:05.637873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:05.644895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:05.644895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:05.644895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:05.967181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:05.983905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c975a162-9e91-4ed2-af0b-bb8536b2204d tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1493 microversion: 2.1 time: 0.703748 Mar 29 02:15:05.986370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 681/1390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:05 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1493 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:05.999699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:06.001183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:06.014048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.015092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.016895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.017501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.071022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:06.083037 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f97c0cd7-e48d-4944-b351-61438793dff6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1541 microversion: 2.1 time: 0.463721 Mar 29 02:15:06.084997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 710/1391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:05 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1541 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:06.099230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:06.099230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:06.099230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.099230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.099622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.099622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.262046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:06.270600 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cfbd3b26-d5aa-4608-b53d-d1d1622a6cfa tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1541 microversion: 2.1 time: 0.185542 Mar 29 02:15:06.271193 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 711/1392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:06 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1541 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:06.391441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b4bad11d-2d7d-493a-a2fc-b671d60dd6dc req-720850da-f21e-41e4-8090-15e84e791d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159164cc-2212-48ea-99c6-04dd73bbfcc2", "name": "network-vif-deleted", "tag": "45f70068-e7e7-417f-928e-f809fd258f1e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:06.393118 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:06.393118 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:06.404740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b4bad11d-2d7d-493a-a2fc-b671d60dd6dc req-720850da-f21e-41e4-8090-15e84e791d25 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.406475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b4bad11d-2d7d-493a-a2fc-b671d60dd6dc req-720850da-f21e-41e4-8090-15e84e791d25 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.427135 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b4bad11d-2d7d-493a-a2fc-b671d60dd6dc req-720850da-f21e-41e4-8090-15e84e791d25 service nova] Creating event network-vif-deleted:45f70068-e7e7-417f-928e-f809fd258f1e for instance 159164cc-2212-48ea-99c6-04dd73bbfcc2 on n-h2-828148-1 Mar 29 02:15:06.432578 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b4bad11d-2d7d-493a-a2fc-b671d60dd6dc req-720850da-f21e-41e4-8090-15e84e791d25 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047514 Mar 29 02:15:06.433705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 712/1393] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:06.756396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:06.766112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ba85616-8c23-4e93-9677-43fce293353f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.778504 Mar 29 02:15:06.767252 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 682/1394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:05 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:06.783569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1261078957"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:06.796629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:06.820302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.820864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.821717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.822221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.908198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3680f43a-580e-4c92-a116-5e7c2218fd7d req-0eee8bc8-23d0-4340-84c7-f6645ac3f5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "520780dc-8aef-448a-8738-ed70f20f4d98", "name": "network-vif-deleted", "tag": "1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:06.910801 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:06.910801 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:06.923349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3680f43a-580e-4c92-a116-5e7c2218fd7d req-0eee8bc8-23d0-4340-84c7-f6645ac3f5c7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:06.924331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3680f43a-580e-4c92-a116-5e7c2218fd7d req-0eee8bc8-23d0-4340-84c7-f6645ac3f5c7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:06.947270 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3680f43a-580e-4c92-a116-5e7c2218fd7d req-0eee8bc8-23d0-4340-84c7-f6645ac3f5c7 service nova] Creating event network-vif-deleted:1f5bbbdc-799f-41a9-8f28-7aff5d3ff2f2 for instance 520780dc-8aef-448a-8738-ed70f20f4d98 on n-h1-828148-1 Mar 29 02:15:06.953691 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3680f43a-580e-4c92-a116-5e7c2218fd7d req-0eee8bc8-23d0-4340-84c7-f6645ac3f5c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048635 Mar 29 02:15:06.954532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 683/1395] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:15:07.004633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:07.005536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:07.020142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.020656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.021481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.021918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.128675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.129103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.129553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lazy-loading 'fault' on Instance uuid 159164cc-2212-48ea-99c6-04dd73bbfcc2 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:15:07.232984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '530e622216e14b4daae0ea35922590c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2396365e7b94fba89f2d80d46e01af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:07.242988 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f41da981-4be0-4c2f-b68d-43f489d7d8fd tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 200 len: 1298 microversion: 2.1 time: 0.243775 Mar 29 02:15:07.244173 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 684/1396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:06 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:07.250260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:07.251253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:07.260209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.261010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.267272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.267272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.515327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:07.526748 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5e3823bd-7ef6-4e17-ae9d-a7356d0b37c4 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1473 microversion: 2.1 time: 0.279659 Mar 29 02:15:07.527362 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 685/1397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:07 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1473 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:07.542375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:07.542375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:07.551939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.557889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.560287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:07.560736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:07.919063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:07.930965 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-55a0dae3-2aa3-41d5-aa43-f0b43e5edd15 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1252 microversion: 2.1 time: 0.399535 Mar 29 02:15:07.932098 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 686/1398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:07 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1252 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:07.955037 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9178c8ef-2bcc-42a8-a411-908f63512bf1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 1.175106 Mar 29 02:15:07.956747 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 713/1399] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:15:06 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 29 02:15:08.197593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aeb9074b-1df4-479d-b2c1-498a4a096091 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] Action: 'create', calling method: .version_select at 0x7f8724d41790>, body: {"security_group": {"name": "tempest-securitygroup-2132676867", "description": "tempest-description-1189826193"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:08.262907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:08.263612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 159164cc-2212-48ea-99c6-04dd73bbfcc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:08.273342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.273797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.274591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.275028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.332106 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance 159164cc-2212-48ea-99c6-04dd73bbfcc2 could not be found. Mar 29 02:15:08.333008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance 159164cc-2212-48ea-99c6-04dd73bbfcc2 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:08.333535 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f4d4e9f-f9aa-4039-9f42-ad65b6eb0ac1 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2" status: 404 len: 111 microversion: 2.1 time: 0.075927 Mar 29 02:15:08.334372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 714/1400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:08 2022] GET /compute/v2.1/servers/159164cc-2212-48ea-99c6-04dd73bbfcc2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:08.342539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fcc36e86-1c7c-43e2-a6cc-c18de555fe1e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8724b99040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:08.370617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-fcc36e86-1c7c-43e2-a6cc-c18de555fe1e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Image not found. Mar 29 02:15:08.371741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fcc36e86-1c7c-43e2-a6cc-c18de555fe1e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:08.372667 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fcc36e86-1c7c-43e2-a6cc-c18de555fe1e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17" status: 404 len: 62 microversion: 2.1 time: 0.034164 Mar 29 02:15:08.373862 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 715/1401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:08 2022] DELETE /compute/v2.1/images/7bc6b71e-ffea-42c2-b1a4-834e83470e17 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:15:08.392232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-unplugged", "status": "completed", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:08.394883 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:08.394883 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:08.406293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.407032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.429099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] Creating event network-vif-unplugged:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:15:08.438569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] Instance 3219f754-4bc7-4c6c-990d-69861ad335e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:15:08.450120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1f796c63-06e4-4fa7-b312-d6b96f4038d8 req-14b60584-1a0b-4910-9f56-c5e2ff76911e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074412 Mar 29 02:15:08.453312 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 716/1402] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:08.458897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:08.462324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:08.468049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.468529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.469326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.469764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.531507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance 46826a93-f066-407b-b9f1-91786295f54a could not be found. Mar 29 02:15:08.532327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance 46826a93-f066-407b-b9f1-91786295f54a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:08.538745 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ab94f55a-0b2f-435c-b834-dab194055671 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 404 len: 111 microversion: 2.1 time: 0.078675 Mar 29 02:15:08.538745 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 717/1403] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:08 2022] DELETE /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:08.553930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:08.554743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: 46826a93-f066-407b-b9f1-91786295f54a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:08.564434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.565212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.567858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.568551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.688417 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance 46826a93-f066-407b-b9f1-91786295f54a could not be found. Mar 29 02:15:08.689364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance 46826a93-f066-407b-b9f1-91786295f54a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:08.690577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1e0fa40-3b23-49c9-aba6-96343183adc8 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a" status: 404 len: 111 microversion: 2.1 time: 0.150219 Mar 29 02:15:08.697399 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 718/1404] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:08 2022] GET /compute/v2.1/servers/46826a93-f066-407b-b9f1-91786295f54a => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:08.709258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:08.710175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:08.724232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.729347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:08.733889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:08.734537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.176419 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aeb9074b-1df4-479d-b2c1-498a4a096091 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.243130 Mar 29 02:15:09.186149 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 687/1405] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:15:07 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:09.187348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:09.205240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ac790585-3b46-4485-afda-808ece05521e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717e55d30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.207886 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74cc8fd1-e984-4b30-857b-cf4d85ff1639 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1473 microversion: 2.1 time: 0.508698 Mar 29 02:15:09.218229 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 719/1406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:08 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1473 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:09.218229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.218229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:09.223654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.224188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.225004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.225437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.257780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-ac790585-3b46-4485-afda-808ece05521e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Image not found. Mar 29 02:15:09.258379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ac790585-3b46-4485-afda-808ece05521e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.259190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ac790585-3b46-4485-afda-808ece05521e tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6" status: 404 len: 62 microversion: 2.1 time: 0.069834 Mar 29 02:15:09.259761 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 688/1407] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:09 2022] DELETE /compute/v2.1/images/dcf928e5-2291-4816-94ef-5b15810dafa6 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:15:09.265771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4b8841f-1f11-400e-90df-bea19de9b793 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] Action: 'create', calling method: .version_select at 0x7f8724344550>, body: {"security_group": {"name": "tempest-securitygroup-1254312434", "description": "tempest-description-206929238"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:09.315456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.315912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.316374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lazy-loading 'fault' on Instance uuid 520780dc-8aef-448a-8738-ed70f20f4d98 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:15:09.401053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be981c23208b4fa09861adce9c9ef458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2cea4684f4d06830d9a5464950077', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:09.412870 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9177d422-f480-4bb8-ac7d-6f1bf49fc6e3 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 200 len: 1257 microversion: 2.1 time: 0.199969 Mar 29 02:15:09.412870 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 720/1408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:09 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 1257 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:09.415902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.416595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:09.425060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.425738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.426778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.427405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.483819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 could not be found. Mar 29 02:15:09.484765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.485809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b82e0e7e-0112-454e-93b6-530d22e2653a tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 404 len: 111 microversion: 2.1 time: 0.073612 Mar 29 02:15:09.486893 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 721/1409] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:09 2022] DELETE /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:09.497650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.498987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: cc2c33f9-e618-4d44-88ca-1c4828670ea7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:09.506217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.506916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.507792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.508418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.560460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 could not be found. Mar 29 02:15:09.561088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance cc2c33f9-e618-4d44-88ca-1c4828670ea7 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.561920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db7b1c76-2ead-4c56-804f-82b79c2c5769 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7" status: 404 len: 111 microversion: 2.1 time: 0.071190 Mar 29 02:15:09.567895 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 722/1410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:09 2022] GET /compute/v2.1/servers/cc2c33f9-e618-4d44-88ca-1c4828670ea7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:09.570744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2968f0e8-5266-4653-8c82-29b661d17e56 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '.version_select at 0x7f8717fbd4c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.598673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2968f0e8-5266-4653-8c82-29b661d17e56 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Image not found. Mar 29 02:15:09.605458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2968f0e8-5266-4653-8c82-29b661d17e56 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.605458 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2968f0e8-5266-4653-8c82-29b661d17e56 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8" status: 404 len: 62 microversion: 2.1 time: 0.034272 Mar 29 02:15:09.605458 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 723/1411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:09 2022] DELETE /compute/v2.1/images/b865e24e-d289-418f-90f8-ee703bc92cf8 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:15:09.613965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.614474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:09.627702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.628154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.628989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.629527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.693168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 could not be found. Mar 29 02:15:09.693777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.694834 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91c8b4d1-0de7-49a4-8322-5154d50e9d35 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 404 len: 111 microversion: 2.1 time: 0.084530 Mar 29 02:15:09.695383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 724/1412] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:09 2022] DELETE /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:09.705683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:09.706557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] [instance: a93b65e2-c37b-434a-8d78-1ebae6ffca02] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:09.714837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.715320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.716147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:09.716610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:09.769865 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] HTTP exception thrown: Instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 could not be found. Mar 29 02:15:09.770466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] Returning 404 to user: Instance a93b65e2-c37b-434a-8d78-1ebae6ffca02 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:09.771290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f378f961-6110-4925-936a-45c7bb01ce69 tempest-ImagesTestJSON-349412525 tempest-ImagesTestJSON-349412525-project] 10.222.0.36 "GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02" status: 404 len: 111 microversion: 2.1 time: 0.070544 Mar 29 02:15:09.771842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 725/1413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:09 2022] GET /compute/v2.1/servers/a93b65e2-c37b-434a-8d78-1ebae6ffca02 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:09.848517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4b8841f-1f11-400e-90df-bea19de9b793 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.587485 Mar 29 02:15:09.852699 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 689/1414] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:15:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:10.139288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b5ae29f-40a1-408f-8a6c-66fef89747ef tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Action: 'create', calling method: .version_select at 0x7f8724bad160>, body: {"security_group": {"name": "tempest-securitygroup-1195297584", "description": "tempest-description-180347566"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:10.225674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:10.226964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:10.241632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:10.243280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:10.246596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:10.248760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:10.842031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:10.850402 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-935e33b4-de6d-4080-9939-1b23b2d19105 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1473 microversion: 2.1 time: 0.628341 Mar 29 02:15:10.850967 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 690/1415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:10 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1473 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:10.984868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e60e2f4a-3a1e-4417-8de1-b43ae4c4c4b4 tempest-InstanceUsageAuditLogTestJSON-975928901 tempest-InstanceUsageAuditLogTestJSON-975928901-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:10.985712 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:10.985712 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:11.001459 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e60e2f4a-3a1e-4417-8de1-b43ae4c4c4b4 tempest-InstanceUsageAuditLogTestJSON-975928901 tempest-InstanceUsageAuditLogTestJSON-975928901-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log/2022-03-29 02:15:10" status: 200 len: 318 microversion: 2.1 time: 0.149446 Mar 29 02:15:11.002029 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 691/1416] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:15:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-03-29%2002%3A15%3A10 => generated 318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:11.006801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:11.008773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] [instance: 520780dc-8aef-448a-8738-ed70f20f4d98] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:11.018238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:11.018692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:11.019856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:11.019959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:11.049003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8b5ae29f-40a1-408f-8a6c-66fef89747ef tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.191441 Mar 29 02:15:11.049740 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 726/1417] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:15:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:11.061113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5863d361-fae2-436c-aa8e-3d1c99c1bc06 req-c57a0800-184d-4bc1-8b62-f4f2f503ca9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-unplugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:11.062808 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:11.062808 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:11.071302 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] HTTP exception thrown: Instance 520780dc-8aef-448a-8738-ed70f20f4d98 could not be found. Mar 29 02:15:11.071917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Returning 404 to user: Instance 520780dc-8aef-448a-8738-ed70f20f4d98 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:11.072405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5863d361-fae2-436c-aa8e-3d1c99c1bc06 req-c57a0800-184d-4bc1-8b62-f4f2f503ca9a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:11.072747 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6784665-987e-489f-ad7b-5c542b6f69cd tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98" status: 404 len: 111 microversion: 2.1 time: 0.069629 Mar 29 02:15:11.073081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5863d361-fae2-436c-aa8e-3d1c99c1bc06 req-c57a0800-184d-4bc1-8b62-f4f2f503ca9a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:11.073446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 692/1418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:11 2022] GET /compute/v2.1/servers/520780dc-8aef-448a-8738-ed70f20f4d98 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:11.080650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2793ee18-7a00-45fb-bc3a-53fe7e1004db tempest-InstanceUsageAuditLogTestJSON-975928901 tempest-InstanceUsageAuditLogTestJSON-975928901-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:11.081424 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-instance-usage-audit-log:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:11.081424 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:11.092631 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5863d361-fae2-436c-aa8e-3d1c99c1bc06 req-c57a0800-184d-4bc1-8b62-f4f2f503ca9a service nova] Creating event network-vif-unplugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:15:11.094451 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2793ee18-7a00-45fb-bc3a-53fe7e1004db tempest-InstanceUsageAuditLogTestJSON-975928901 tempest-InstanceUsageAuditLogTestJSON-975928901-project-admin] 10.222.0.36 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.019727 Mar 29 02:15:11.095050 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 693/1419] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:15:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:11.099668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8be8ce95-30b1-4ea6-998f-b3a6fc535705 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Action: 'create', calling method: .version_select at 0x7f8717ed3670>, body: {"security_group": {"name": "tempest-securitygroup-1272009857", "description": "tempest-description-1300985571"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:11.104809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5863d361-fae2-436c-aa8e-3d1c99c1bc06 req-c57a0800-184d-4bc1-8b62-f4f2f503ca9a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047381 Mar 29 02:15:11.106002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 727/1420] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:11.127050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4045353-973c-4380-8d48-652266904967 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] Calling method '.version_select at 0x7f8724172b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:11.304574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4045353-973c-4380-8d48-652266904967 tempest-ServersTestBootFromVolume-474836678 tempest-ServersTestBootFromVolume-474836678-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289320101" status: 202 len: 0 microversion: 2.1 time: 0.197291 Mar 29 02:15:11.305535 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 728/1421] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:15:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1289320101 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:11.868583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:11.869392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:11.879363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:11.879808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:11.880756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:11.881241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:11.896466 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8be8ce95-30b1-4ea6-998f-b3a6fc535705 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.799936 Mar 29 02:15:11.898852 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 694/1422] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:15:11 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:11.909214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Calling method '.version_select at 0x7f87244645e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:12.357982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:12.368225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-506eaf23-fe65-4b7b-92dc-2a0c702475c2 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1470 microversion: 2.1 time: 0.504527 Mar 29 02:15:12.369119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 729/1423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:11 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:12.386067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:12.387325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:12.395691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:12.398452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:12.398452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:12.398452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:12.476813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:12.477591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:12.478576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:12.479193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:12.512211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:12.517921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for user 035be210e94e4072b31cb011a5189ee4 and project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:13.207216 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b39fc99-ac21-4621-b5c1-8ca373b09e99 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8/action" status: 202 len: 0 microversion: 2.1 time: 0.825572 Mar 29 02:15:13.208863 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 730/1424] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:15:12 2022] POST /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8/action => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:13.218712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:13.219895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:13.229572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:13.231444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:13.232418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:13.232870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:13.858058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:13.872393 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac80d892-2d29-46ae-8d1a-bce6313ad049 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1469 microversion: 2.1 time: 0.659181 Mar 29 02:15:13.874548 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 731/1425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:13 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:14.461492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-plugged", "status": "completed", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:14.463419 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:14.463419 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:14.473026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:14.473469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:14.494342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] Creating event network-vif-plugged:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:15:14.502249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] Instance 3219f754-4bc7-4c6c-990d-69861ad335e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:15:14.509842 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-91b27f48-e57b-488a-9fa1-1f8a8fbfea97 req-6a9e4e29-d260-4918-aab4-e24a72e3069d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051800 Mar 29 02:15:14.511244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 732/1426] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:14.893178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:14.894705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:14.906674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:15:14.907719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Neutron security group 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:15:14.908290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.security_groups [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Security Group ID 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 does not exist {{(pid=103514) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Mar 29 02:15:14.912989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:14.913915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:14.916584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:14.918463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:15.043284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:15:15.044163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Neutron security group 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:15:15.044853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.security_groups [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Security Group ID 969a3d1d-c81a-4b9a-ac35-c8c1a18b6213 does not exist {{(pid=103514) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Mar 29 02:15:15.564760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:15.576499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c6ba775-617e-4a11-aa89-2fcf85a75240 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1469 microversion: 2.1 time: 0.685811 Mar 29 02:15:15.583362 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 733/1427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:14 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1469 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:16.533786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f7f5bb59-4a6a-47f8-aa44-4a1c3a80c692 req-ac70e427-732f-4ae3-844d-13482970cd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-plugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:16.536252 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:16.536252 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:16.553012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f7f5bb59-4a6a-47f8-aa44-4a1c3a80c692 req-ac70e427-732f-4ae3-844d-13482970cd58 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:16.553705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f7f5bb59-4a6a-47f8-aa44-4a1c3a80c692 req-ac70e427-732f-4ae3-844d-13482970cd58 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:16.571723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f7f5bb59-4a6a-47f8-aa44-4a1c3a80c692 req-ac70e427-732f-4ae3-844d-13482970cd58 service nova] Creating event network-vif-plugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:15:16.577945 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f7f5bb59-4a6a-47f8-aa44-4a1c3a80c692 req-ac70e427-732f-4ae3-844d-13482970cd58 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047996 Mar 29 02:15:16.579652 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 734/1428] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:16.597022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:16.597864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:16.608220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:16.609284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:16.610758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:16.611419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:16.814178 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69144048-fed7-4986-9016-817c378e797a tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11161 microversion: 2.1 time: 4.908460 Mar 29 02:15:16.815909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 695/1429] 10.222.0.36 () {58 vars in 1190 bytes} [Tue Mar 29 02:15:11 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11161 bytes in 4911 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:15:16.837970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d9b99325-0310-4a80-8298-dc43d2e38df6 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] Calling method '.version_select at 0x7f8717e8b940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:17.349556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:17.361515 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e99c0ceb-156d-46d0-b081-c5f9192d3ceb tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1469 microversion: 2.1 time: 0.773946 Mar 29 02:15:17.364160 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 735/1430] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:16 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1469 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:17.483641 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d9b99325-0310-4a80-8298-dc43d2e38df6 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.650479 Mar 29 02:15:17.484329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 696/1431] 10.222.0.36 () {58 vars in 1190 bytes} [Tue Mar 29 02:15:16 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:17.497251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c11c1a44-f32b-418c-8501-63517b698a70 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Calling method '.version_select at 0x7f8724bad160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:18.287778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1883635020", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "791b6e2f-84cc-4e53-b233-99285785bda3"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:18.482178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] validate_networks() for [('791b6e2f-84cc-4e53-b233-99285785bda3', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:19.063320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c11c1a44-f32b-418c-8501-63517b698a70 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/98977296-1f99-4463-b233-0e614d91b1c8" status: 202 len: 0 microversion: 2.1 time: 1.570061 Mar 29 02:15:19.065179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 736/1432] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:15:17 2022] DELETE /compute/v2.1/os-security-groups/98977296-1f99-4463-b233-0e614d91b1c8 => generated 0 bytes in 1573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:19.070547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:19.071316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:19.094972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:19.098316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:19.099663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:19.105978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:19.526825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:19.545862 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbc88ffa-dfdd-43f4-950b-22b07892a753 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1535 microversion: 2.1 time: 0.475767 Mar 29 02:15:19.546883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 737/1433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:19 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1535 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:19.564675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1c20692-52ec-409a-80a5-861e6c4a8098 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] Calling method '.version_select at 0x7f8724c6d790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:20.096587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:15:20.097736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:15:20.098409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:15:20.099036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:15:20.099655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:15:20.110275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:20.111590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:20.112627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:20.113169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:20.306724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:20.317086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for user 7ff0139c538f4391bd0b5eb0c42f11a0 and project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:20.331616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:15:20.334375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:15:20.458724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b51fca7-b13c-44c8-aafd-1700e798c657 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514007 Mar 29 02:15:20.461877 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 697/1434] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:15:20.483102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e1ba0c0b-338c-4ebf-8fae-65bd70fa2b21"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:20.485572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:20.504137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:20.505609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:20.508472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:20.508822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:20.965192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1c20692-52ec-409a-80a5-861e6c4a8098 tempest-SecurityGroupsTestAdminJSON-566055667 tempest-SecurityGroupsTestAdminJSON-566055667-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e30f11e4-da01-49b6-8483-677b8003b580" status: 202 len: 0 microversion: 2.1 time: 1.412622 Mar 29 02:15:20.970285 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 738/1435] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:15:19 2022] DELETE /compute/v2.1/os-security-groups/e30f11e4-da01-49b6-8483-677b8003b580 => generated 0 bytes in 1415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:20.979657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f952ea55-84be-4a6a-8640-5c700837ffd0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:20.982144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f952ea55-84be-4a6a-8640-5c700837ffd0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:21.188429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f952ea55-84be-4a6a-8640-5c700837ffd0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:21.208064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f952ea55-84be-4a6a-8640-5c700837ffd0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1225 microversion: 2.1 time: 0.232276 Mar 29 02:15:21.208925 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 739/1436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:20 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1225 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:21.230283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:21.230942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:21.259109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:21.259949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:21.271155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:21.271704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:21.913706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ef3b1b51-99df-4c31-be82-303c1bd942fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "POST /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.449154 Mar 29 02:15:21.914775 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 698/1437] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:15:20 2022] POST /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments => generated 194 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:21.923074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6cb163cf-dcda-4a99-a3e9-c7f3bba0d255 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] Calling method '.version_select at 0x7f8725e6adc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:21.953378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:21.972328 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9032f775-e919-49ee-acff-fd740ae63404 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1535 microversion: 2.1 time: 0.757252 Mar 29 02:15:21.973537 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 740/1438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:21 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1535 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:22.231732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:22.232693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:22.257858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:22.258345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:22.259984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:22.260417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:22.722288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:22.737581 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7185d84-7560-4d8a-8865-2cc229a355c4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1229 microversion: 2.1 time: 0.515830 Mar 29 02:15:22.738830 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 741/1439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:22 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1229 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:22.991228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:22.995156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:23.026370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:23.029385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:23.030216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:23.031422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:23.511712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6cb163cf-dcda-4a99-a3e9-c7f3bba0d255 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4f5bfd39-d6ac-4a3c-85e0-2fd33facb738" status: 202 len: 0 microversion: 2.1 time: 1.594418 Mar 29 02:15:23.513941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:23.518844 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 699/1440] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:15:21 2022] DELETE /compute/v2.1/os-security-groups/4f5bfd39-d6ac-4a3c-85e0-2fd33facb738 => generated 0 bytes in 1600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:23.527279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-unplugged", "status": "completed", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:23.531842 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:23.531842 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:23.536697 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a52554e6-18ae-454d-9c6d-a7e9a9cedc20 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1535 microversion: 2.1 time: 0.549745 Mar 29 02:15:23.538746 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 742/1441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:22 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1535 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:23.543919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34c7664f-39a7-48a2-af4f-173105ae9e00 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] Calling method '.version_select at 0x7f8724bad040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:23.555281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:23.557257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:23.606595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] Creating event network-vif-unplugged:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:15:23.630142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] Instance 3219f754-4bc7-4c6c-990d-69861ad335e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:15:23.643536 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-65c93b92-5a54-45ac-b691-161893640d02 req-23f8c601-ca18-4be3-a0ac-01ea3cc4335b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121289 Mar 29 02:15:23.648257 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 700/1442] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:23.756499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:23.757282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:23.777243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:23.777664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:23.778472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:23.781025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:24.153525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:24.169252 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c2a65f68-0e06-4507-9e67-055f7b66c6a7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1285 microversion: 2.1 time: 0.414506 Mar 29 02:15:24.170414 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 701/1443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:23 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1285 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:24.397461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34c7664f-39a7-48a2-af4f-173105ae9e00 tempest-SecurityGroupsTestAdminJSON-1800822932 tempest-SecurityGroupsTestAdminJSON-1800822932-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/30425d41-266f-4a75-b91b-8b9be7ec3553" status: 202 len: 0 microversion: 2.1 time: 0.857349 Mar 29 02:15:24.398199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 743/1444] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:15:23 2022] DELETE /compute/v2.1/os-security-groups/30425d41-266f-4a75-b91b-8b9be7ec3553 => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:24.564396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:24.564396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:24.571436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:24.572894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:24.574993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:24.580056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:25.187808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:25.189360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:25.218197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:25.222712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:25.223729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:25.227298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:25.439069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:25.451656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-416b01d6-6679-4630-9a3d-3af4d30ed123 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1535 microversion: 2.1 time: 0.894509 Mar 29 02:15:25.452507 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 702/1445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:24 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1535 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:25.642812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:25.651285 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5562398b-0e92-43e1-b67a-7c3d4666644d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1283 microversion: 2.1 time: 0.468986 Mar 29 02:15:25.657229 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 744/1446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:25 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1283 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:26.472520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:26.474165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:26.494852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.496812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:26.498083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.500668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:26.669998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:26.671198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:26.681064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.681522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:26.682354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.682850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:26.775930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:26.786117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f8f3adb-278f-451e-aa92-9d65c3dc992f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1528 microversion: 2.1 time: 0.320137 Mar 29 02:15:26.787284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 703/1447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:26 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1528 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:26.804794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:26.805436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:26.824673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.825092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:26.825904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:26.826341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:27.147141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:27.158640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-92aaaf0c-5909-4d12-8538-600f3d0ee908 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1528 microversion: 2.1 time: 0.357886 Mar 29 02:15:27.160002 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 704/1448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:26 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1528 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:27.178263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62644159-4caa-4e96-97e6-9f17571c11c7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:27.184719 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:27.184719 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:27.194374 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-62644159-4caa-4e96-97e6-9f17571c11c7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] HTTP exception thrown: Flavor b54bd94a-9b9f-41bd-b7cb-37d6b4b82451 could not be found. Mar 29 02:15:27.199516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62644159-4caa-4e96-97e6-9f17571c11c7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Returning 404 to user: Flavor b54bd94a-9b9f-41bd-b7cb-37d6b4b82451 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:27.200591 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62644159-4caa-4e96-97e6-9f17571c11c7 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/b54bd94a-9b9f-41bd-b7cb-37d6b4b82451" status: 404 len: 109 microversion: 2.1 time: 0.028291 Mar 29 02:15:27.203796 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 705/1449] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:27 2022] DELETE /compute/v2.1/flavors/b54bd94a-9b9f-41bd-b7cb-37d6b4b82451 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:15:27.377658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:27.387307 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a8a1660-e3f6-4b77-9cfb-8979de287978 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 0.722068 Mar 29 02:15:27.397176 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 745/1450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:26 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:27.998245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1324262135", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:28.150053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:28.785053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1999672068", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:28.932424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] validate_networks() for [('da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:29.182424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:15:29.183629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:15:29.185196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:15:29.185928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:15:29.186614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:15:29.215053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:29.215807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:29.216818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:29.217470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:29.281208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:29.300416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Getting quotas for user 035be210e94e4072b31cb011a5189ee4 and project 6f9ebef1d2254e5196cc9ae764956d25. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:29.342939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:15:29.354224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:15:29.546910 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-91e2a404-0033-4e34-86f3-38d4d128e41a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553087 Mar 29 02:15:29.552583 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 706/1451] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:15:29.557293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:29.558510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:29.590427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:29.591223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:29.592181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:29.592770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:30.243121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:30.255074 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d230d15-7cb3-4e37-aff8-681fdaf2fbbe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 0.701251 Mar 29 02:15:30.258676 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 707/1452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:29 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:30.263690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c297fd28-fd09-4467-a023-00aadfc8e1e5 req-57b005ef-1d6e-4776-b2b2-803bad748147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbf5ec3-94f8-4cd9-8c97-cfead97c717f", "tag": "389d1a00-004f-4f58-9a14-b81844fdeab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:30.267528 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:30.267528 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:30.278686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c297fd28-fd09-4467-a023-00aadfc8e1e5 req-57b005ef-1d6e-4776-b2b2-803bad748147 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:30.279160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c297fd28-fd09-4467-a023-00aadfc8e1e5 req-57b005ef-1d6e-4776-b2b2-803bad748147 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:30.342554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c297fd28-fd09-4467-a023-00aadfc8e1e5 req-57b005ef-1d6e-4776-b2b2-803bad748147 service nova] Creating event network-changed:389d1a00-004f-4f58-9a14-b81844fdeab5 for instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f on n-h2-828148-1 Mar 29 02:15:30.357624 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c297fd28-fd09-4467-a023-00aadfc8e1e5 req-57b005ef-1d6e-4776-b2b2-803bad748147 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096344 Mar 29 02:15:30.364623 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 708/1453] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:30.375844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98b21456-fe51-46f8-ab22-aaabedc58e54 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:30.376714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98b21456-fe51-46f8-ab22-aaabedc58e54 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:30.506686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98b21456-fe51-46f8-ab22-aaabedc58e54 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:30.517764 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98b21456-fe51-46f8-ab22-aaabedc58e54 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1213 microversion: 2.1 time: 0.154709 Mar 29 02:15:30.518387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 709/1454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:30 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1213 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:30.737628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6758a6b3-26dc-47be-99b5-539e7e4e8360 req-216b5269-c980-49bb-8d44-f19ebf1d09f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-plugged", "status": "completed", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:30.739842 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:30.739842 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:30.765952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6758a6b3-26dc-47be-99b5-539e7e4e8360 req-216b5269-c980-49bb-8d44-f19ebf1d09f0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:30.766866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6758a6b3-26dc-47be-99b5-539e7e4e8360 req-216b5269-c980-49bb-8d44-f19ebf1d09f0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:30.795672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6758a6b3-26dc-47be-99b5-539e7e4e8360 req-216b5269-c980-49bb-8d44-f19ebf1d09f0 service nova] Creating event network-vif-plugged:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:15:30.801389 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6758a6b3-26dc-47be-99b5-539e7e4e8360 req-216b5269-c980-49bb-8d44-f19ebf1d09f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068733 Mar 29 02:15:30.802642 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 710/1455] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:31.172589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:15:31.175866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:15:31.176569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:15:31.177173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:15:31.178935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:15:31.202386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.213662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.214796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.216127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.237677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:31.245659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for user 808db28af62c4400b9f28220649f0985 and project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:31.275934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:31.279477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:31.282711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:15:31.287287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:15:31.301909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.302571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.303723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.304273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.515065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81bb3279-afed-462f-9b12-6730a51b9860 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.340720 Mar 29 02:15:31.543231 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 746/1456] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:15:31.548610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:31.549351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:31.559985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.559985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.570401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:31.571832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:31.842510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:31.849387 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0663e54-bb0d-4c98-ab08-251eadd4e970 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 0.573758 Mar 29 02:15:31.849387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 711/1457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:31 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:15:31.859454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-530391f0-1ad9-40dc-a69c-3d6d4a57d569 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:31.860104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-530391f0-1ad9-40dc-a69c-3d6d4a57d569 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:32.086240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:32.088116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-530391f0-1ad9-40dc-a69c-3d6d4a57d569 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:32.106481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a87b05de-bfc2-445f-856a-36ee3592414c tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1209 microversion: 2.1 time: 0.574114 Mar 29 02:15:32.107435 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 747/1458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:31 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1209 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:32.124896 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-530391f0-1ad9-40dc-a69c-3d6d4a57d569 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1211 microversion: 2.1 time: 0.278290 Mar 29 02:15:32.125493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 712/1459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:31 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1211 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:32.872869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:32.873515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:32.935442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:32.935991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:32.936824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:32.937532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:33.185089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2023352376", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:33.332421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:33.386540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:33.402562 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-571a7aa4-bf21-4bf6-b1d8-772ea118d67f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 0.536366 Mar 29 02:15:33.410723 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 713/1460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:32 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:33.419977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:33.429024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:33.454882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:33.455336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:33.457928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:33.457928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:33.860291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:33.874662 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30d1a1a7-20d0-4d2a-960f-16ff8e2b250f tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1271 microversion: 2.1 time: 0.463084 Mar 29 02:15:33.875339 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 714/1461] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:33 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1271 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:33.887922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:33.888540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:33.907294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:33.908008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:33.908992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:33.909578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.207367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:34.211289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:15:34.211823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:15:34.212212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:15:34.212630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:15:34.213074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:15:34.221099 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-93591ef4-03ca-44f0-a43b-1649e34926ed tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1215 microversion: 2.1 time: 0.344711 Mar 29 02:15:34.231411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 715/1462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:33 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:34.233845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.234018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:34.235253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:34.237471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.238361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.238792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.245780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.246534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.247743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.248495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.279188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:34.285101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for user a2c3da46792940ce9c4ed371e1c2748e and project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:34.299234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:15:34.301661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:15:34.337203 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-90120fa7-1e2d-455c-93dc-2e855e7ba385 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108199 Mar 29 02:15:34.339119 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 716/1463] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:15:34 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:34.349595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:34.350346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:34.358785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.359567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.360574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.361246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.523261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lazy-loading 'services' on Instance uuid 5d4c01fd-5c30-428e-8e62-f9209c626c87 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:15:34.738936 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3c5a162-c59d-4a7e-be7d-eeb3cfefdaf5 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.005194 Mar 29 02:15:34.757875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 748/1464] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:15:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:15:34.778244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:34.788831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:34.810773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.812314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.816460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:34.817185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:34.884336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c72647c-b3a4-405d-97ce-c8dcaf39d4b9 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments/e1ba0c0b-338c-4ebf-8fae-65bd70fa2b21" status: 202 len: 0 microversion: 2.1 time: 0.538114 Mar 29 02:15:34.901849 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 717/1465] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:15:34 2022] DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments/e1ba0c0b-338c-4ebf-8fae-65bd70fa2b21 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:34.907526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1555511431", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:35.158451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:35.565503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:35.574976 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46ed080a-5e8a-4f2d-ba22-8a97dd6b7068 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 0.815901 Mar 29 02:15:35.591008 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 749/1466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:34 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:35.598163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:35.598884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:35.608012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:35.608875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:35.609850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:35.620815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:36.234051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:36.242705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dff7b17e-e6bc-4c2f-8cbc-6e4f53a3c05b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.652633 Mar 29 02:15:36.253496 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 750/1467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:35 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:36.275111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:36.278464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:36.299378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:36.300445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:36.301495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:36.304398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:36.533625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:36.548190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-67dd78d3-a4fb-48f7-9f60-2755c8d6eb0c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1271 microversion: 2.1 time: 0.295626 Mar 29 02:15:36.550180 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 751/1468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:36 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:36.643965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:15:36.644993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:15:36.645308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:15:36.645955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:15:36.646481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:15:36.682034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:36.686672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:36.689540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:36.693664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:36.717808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Action: 'create', calling method: .version_select at 0x7f8717ea8a60>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:36.743410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:36.745030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Getting quotas for project d9b7fc56918143ff97cd1ff0d0a8d666. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:36.751326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Getting quotas for user 73c8afd4619f4f4e83a1bbc88cd0b6be and project d9b7fc56918143ff97cd1ff0d0a8d666. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:36.755130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for user a2c3da46792940ce9c4ed371e1c2748e and project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:36.791406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:15:36.801140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:15:36.963234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Getting quotas for project d9b7fc56918143ff97cd1ff0d0a8d666. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:36.967114 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-564d106f-378f-4836-840e-76adcf7fefb3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063910 Mar 29 02:15:36.968885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 718/1469] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:15:36.977228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Getting quotas for user 73c8afd4619f4f4e83a1bbc88cd0b6be and project d9b7fc56918143ff97cd1ff0d0a8d666. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:36.977918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:36.980874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:37.009619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23026f68-f2e9-4f29-8ae5-ec89c4b19d19 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.458147 Mar 29 02:15:37.010922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.012923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.014293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.015185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.020091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 752/1470] 10.222.0.36 () {62 vars in 1213 bytes} [Tue Mar 29 02:15:36 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:15:37.027430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8755ac81-2c93-4d40-9cc9-c405fae9a602 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.032247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8755ac81-2c93-4d40-9cc9-c405fae9a602 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:37.208557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8755ac81-2c93-4d40-9cc9-c405fae9a602 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:37.222554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8755ac81-2c93-4d40-9cc9-c405fae9a602 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1214 microversion: 2.1 time: 0.198681 Mar 29 02:15:37.225627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 753/1471] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:37.243718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7abf576-d1b5-48ac-8a65-c5cf4403c0c7 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.288539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7abf576-d1b5-48ac-8a65-c5cf4403c0c7 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.060180 Mar 29 02:15:37.292634 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 754/1472] 10.222.0.36 () {60 vars in 1192 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:15:37.305895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.306966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:37.317667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.318524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.319661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.320463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.675178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:37.688832 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad013bc3-88bd-46e9-9582-ad696bf59d47 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.394731 Mar 29 02:15:37.689794 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 755/1473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:37.695095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-411bbc00-d276-412a-a412-3cd8a774b38f tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.719023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-411bbc00-d276-412a-a412-3cd8a774b38f tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa" status: 200 len: 235 microversion: 2.64 time: 0.027567 Mar 29 02:15:37.724930 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 756/1474] 10.222.0.36 () {60 vars in 1303 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa => generated 235 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:15:37.745854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.751375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:37.773728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.774607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.776926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.777597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.953749 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d23d2b8-4722-483f-ae00-fd62e4b9357f tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.233165 Mar 29 02:15:37.954811 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 757/1475] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments => generated 25 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:15:37.973786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:37.974475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:37.984121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.984489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:37.985448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:37.985894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:38.192025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:38.212626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef95c24d-393b-405e-a9fa-231dca46f755 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1269 microversion: 2.1 time: 0.256461 Mar 29 02:15:38.223862 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 758/1476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:37 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1269 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:38.228314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5c3255d-3367-419f-a151-2e9f301865e4 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:38.401511 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e5c3255d-3367-419f-a151-2e9f301865e4 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa" status: 204 len: 0 microversion: 2.64 time: 0.184260 Mar 29 02:15:38.407833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 759/1477] 10.222.0.36 () {60 vars in 1306 bytes} [Tue Mar 29 02:15:38 2022] DELETE /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:15:38.433626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:38.435018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:38.473022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:38.475090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:38.481898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:38.483233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:38.640484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99ca77f8-f783-4433-9f72-b3a4b4902029 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.215336 Mar 29 02:15:38.641657 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 760/1478] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:15:38 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87/os-volume_attachments => generated 25 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:15:38.664823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:38.675862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:38.701306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:38.705113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:38.705113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:38.705664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:39.075967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:39.091046 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cc39fd0-19f2-432b-a4f0-6f6f499f5eb8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1210 microversion: 2.1 time: 0.447409 Mar 29 02:15:39.094810 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 761/1479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:38 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1210 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:39.106974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30f7cf29-784d-44ee-a6d6-5922209349e9 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:39.133975 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-30f7cf29-784d-44ee-a6d6-5922209349e9 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] HTTP exception thrown: Instance group 85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa could not be found. Mar 29 02:15:39.137040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30f7cf29-784d-44ee-a6d6-5922209349e9 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] Returning 404 to user: Instance group 85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:39.137954 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30f7cf29-784d-44ee-a6d6-5922209349e9 tempest-ServerGroup264TestJSON-1936262720 tempest-ServerGroup264TestJSON-1936262720-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa" status: 404 len: 117 microversion: 2.64 time: 0.042056 Mar 29 02:15:39.148686 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 762/1480] 10.222.0.36 () {60 vars in 1306 bytes} [Tue Mar 29 02:15:39 2022] DELETE /compute/v2.1/os-server-groups/85ea5b5b-ce58-4b9e-a6a1-a8ef22cc94aa => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:15:39.149770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:39.152102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:39.178559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:39.179636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:39.183676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:39.184295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:39.371252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:39.381490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5487c582-0908-4181-8cb6-5c2c7949c514 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 2.410378 Mar 29 02:15:39.390924 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 719/1481] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:36 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:39.408103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:39.408606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:39.456081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:39.456535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:39.470319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:39.470319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:39.696177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:15:40.221245 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e589d27-5a93-4221-b03e-385a87f75bec tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 204 len: 0 microversion: 2.1 time: 0.813924 Mar 29 02:15:40.225213 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 720/1482] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:15:39 2022] DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:15:40.237464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:40.245271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:40.267695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:40.269753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:40.270777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:40.273745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.097199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:41.111879 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5f7bda6-74b0-439d-a1e2-df6e87a8188e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 1.967360 Mar 29 02:15:41.121891 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 763/1483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:39 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:41.128204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:41.134727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:41.139841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.140863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.141947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.143030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.262087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:41.283531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f929dc9c-56ee-4155-8023-ecb9993b539f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1269 microversion: 2.1 time: 1.056090 Mar 29 02:15:41.284140 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 721/1484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:40 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1269 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:41.314072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2ec4e4d3-caed-4a6c-becb-c347c1d3c4c4 req-6fbd44d8-eadf-4bbc-b987-d136e18fe305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbf5ec3-94f8-4cd9-8c97-cfead97c717f", "name": "network-vif-plugged", "status": "completed", "tag": "389d1a00-004f-4f58-9a14-b81844fdeab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:41.316366 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:41.316366 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:41.328940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2ec4e4d3-caed-4a6c-becb-c347c1d3c4c4 req-6fbd44d8-eadf-4bbc-b987-d136e18fe305 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.329382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2ec4e4d3-caed-4a6c-becb-c347c1d3c4c4 req-6fbd44d8-eadf-4bbc-b987-d136e18fe305 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.367231 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2ec4e4d3-caed-4a6c-becb-c347c1d3c4c4 req-6fbd44d8-eadf-4bbc-b987-d136e18fe305 service nova] Creating event network-vif-plugged:389d1a00-004f-4f58-9a14-b81844fdeab5 for instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f on n-h2-828148-1 Mar 29 02:15:41.388825 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2ec4e4d3-caed-4a6c-becb-c347c1d3c4c4 req-6fbd44d8-eadf-4bbc-b987-d136e18fe305 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086668 Mar 29 02:15:41.394560 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 722/1485] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:41.411248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:41.431788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:41.458026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.459019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.459890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.460441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.653829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:41.668312 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80608c22-f2fd-451f-a56b-ddc14f8edb72 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1272 microversion: 2.1 time: 0.544962 Mar 29 02:15:41.677511 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 764/1486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:41 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1272 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:41.699514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:41.701996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:41.726818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.727801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:41.728809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:41.729444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:42.899441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:42.915765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6ce0bb4-c6e5-48d6-bbf4-a327974a6985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1325 microversion: 2.1 time: 1.236601 Mar 29 02:15:42.920717 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 765/1487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:41 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1325 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:42.926934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:42.945806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:42.974528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:42.976553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:42.979534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:42.990279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:44.363783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:44.384106 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b481073a-e870-465c-b604-c1690b989e08 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1681 microversion: 2.1 time: 2.988157 Mar 29 02:15:44.387665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 723/1488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:41 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1681 bytes in 2990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:44.392663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:44.399954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:44.412390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:44.413197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:44.416891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:44.416891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:45.114758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:45.132261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bfaf1c1c-0b51-42e0-ad0d-8176f8534f8e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 2.208777 Mar 29 02:15:45.133265 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 766/1489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:42 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 2210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:45.138878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:45.141613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:45.155428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:45.156221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:45.157214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:45.169357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:45.440308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:45.451953 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6e3d16b-a9a8-4946-aa82-f2e4759c7646 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 1.065362 Mar 29 02:15:45.453187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 724/1490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:44 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:45.462614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f3a08277-241e-4a4a-8bf8-f84c5271241e req-cf3b6ece-3b7a-48d6-8d76-8f0ae4f06005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:45.462614 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:45.462614 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:45.471889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3a08277-241e-4a4a-8bf8-f84c5271241e req-cf3b6ece-3b7a-48d6-8d76-8f0ae4f06005 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:45.472691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3a08277-241e-4a4a-8bf8-f84c5271241e req-cf3b6ece-3b7a-48d6-8d76-8f0ae4f06005 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:45.493581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f3a08277-241e-4a4a-8bf8-f84c5271241e req-cf3b6ece-3b7a-48d6-8d76-8f0ae4f06005 service nova] Creating event network-changed:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h1-828148-1 Mar 29 02:15:45.499094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f3a08277-241e-4a4a-8bf8-f84c5271241e req-cf3b6ece-3b7a-48d6-8d76-8f0ae4f06005 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043587 Mar 29 02:15:45.500502 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 725/1491] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:45.507225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:45.511436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:45.517295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:45.518057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:45.519464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:45.520119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:46.048063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:46.058584 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08447b80-86be-4c99-8df6-0d73f2f6f211 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.556083 Mar 29 02:15:46.069929 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 726/1492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:45 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:46.081671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Action: 'create', calling method: .version_select at 0x7f8724350c10>, body: {"keypair": {"name": "tempest-keypair-653102392"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:46.102017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for project c614c9fa0e294c13b291d76d98e4e350. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:46.108633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for user f44f15c99fa3407c8d95b7c99783b70d and project c614c9fa0e294c13b291d76d98e4e350. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:46.438524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for project c614c9fa0e294c13b291d76d98e4e350. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:15:46.457201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for user f44f15c99fa3407c8d95b7c99783b70d and project c614c9fa0e294c13b291d76d98e4e350. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:15:46.481586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9b1b5fc-f0a4-4e5b-81d7-43e076b6b4c7 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.32 time: 0.410429 Mar 29 02:15:46.483060 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 727/1493] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:15:46 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:15:46.488453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f0d95d34-a57d-4d36-be06-7c995c29a526 req-29b72d66-d790-4ffc-ac83-1fdbf08823c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4c01fd-5c30-428e-8e62-f9209c626c87", "name": "network-vif-unplugged", "status": "completed", "tag": "409a672e-4186-495e-87aa-4bbf92afe7b4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:46.491175 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:46.491175 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:46.502532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f0d95d34-a57d-4d36-be06-7c995c29a526 req-29b72d66-d790-4ffc-ac83-1fdbf08823c7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:46.503631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f0d95d34-a57d-4d36-be06-7c995c29a526 req-29b72d66-d790-4ffc-ac83-1fdbf08823c7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:46.523703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f0d95d34-a57d-4d36-be06-7c995c29a526 req-29b72d66-d790-4ffc-ac83-1fdbf08823c7 service nova] Creating event network-vif-unplugged:409a672e-4186-495e-87aa-4bbf92afe7b4 for instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 on n-h2-828148-1 Mar 29 02:15:46.529292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f0d95d34-a57d-4d36-be06-7c995c29a526 req-29b72d66-d790-4ffc-ac83-1fdbf08823c7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044702 Mar 29 02:15:46.532444 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 728/1494] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:46.540155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:46.542649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:46.586355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:46.587053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:46.588099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:46.588723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:46.715741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:46.726594 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10357bb9-daed-4eee-b621-6baf7d2c74f3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 1.592083 Mar 29 02:15:46.727892 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 767/1495] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:45 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:46.733965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:46.735072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:46.744197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:46.745600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:46.746774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:46.747468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:47.594408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:47.608964 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-781b3963-d30f-4bc3-9bb9-711eda4b91fa tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1681 microversion: 2.1 time: 1.073468 Mar 29 02:15:47.611588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 729/1496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:46 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1681 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:47.631045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:47.631829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:47.640396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:47.641325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:47.642517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:47.643385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:47.780065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:47.789012 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d634f83-2147-436c-a7ba-c175dd38f985 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 1.058949 Mar 29 02:15:47.794190 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 768/1497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:46 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:47.804637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:47.805429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:47.814084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:47.814790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:47.815463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:47.815955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:48.620798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:48.632228 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-934f9d4b-fc8c-42ff-807d-baef8a0e5899 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 1.007572 Mar 29 02:15:48.644182 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 730/1498] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:47 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:48.649515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:48.650394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:48.660215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:48.686742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:48.688756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:48.690065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.245528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:49.256162 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a10f204c-f4f7-44fd-aeb1-717cbc13ad13 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 1.465142 Mar 29 02:15:49.256731 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 769/1499] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:47 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:49.263217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-790232cb-25d1-4993-9a32-c7aa74932304 req-b330b161-858a-444f-82ae-a2819c40e9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a64121-445b-4fcb-8b77-7db8db344cab", "tag": "2ff59a99-506e-4a84-9b64-206ecb4e2882"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:49.265291 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:49.265291 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:49.274092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-790232cb-25d1-4993-9a32-c7aa74932304 req-b330b161-858a-444f-82ae-a2819c40e9a5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.274530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-790232cb-25d1-4993-9a32-c7aa74932304 req-b330b161-858a-444f-82ae-a2819c40e9a5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.291750 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-790232cb-25d1-4993-9a32-c7aa74932304 req-b330b161-858a-444f-82ae-a2819c40e9a5 service nova] Creating event network-changed:2ff59a99-506e-4a84-9b64-206ecb4e2882 for instance 69a64121-445b-4fcb-8b77-7db8db344cab on n-h1-828148-1 Mar 29 02:15:49.296529 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-790232cb-25d1-4993-9a32-c7aa74932304 req-b330b161-858a-444f-82ae-a2819c40e9a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038475 Mar 29 02:15:49.297459 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 770/1500] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:49.302559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:49.303442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:49.311207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.312123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.313077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.313666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.442255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:49.452163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56644d93-1e87-45bb-8123-69f13dfc2329 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.806216 Mar 29 02:15:49.453187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 731/1501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:48 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:49.457968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a050f62-c875-49cb-890b-bd735393babe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-185750168", "metadata": {"": ""}}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:49.459284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a050f62-c875-49cb-890b-bd735393babe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:49.460088 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a050f62-c875-49cb-890b-bd735393babe tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action" status: 400 len: 170 microversion: 2.1 time: 0.005828 Mar 29 02:15:49.460596 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 732/1502] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Mar 29 02:15:49 2022] POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action => generated 170 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:15:49.467654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:49.468254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:49.477136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.478054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.479557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.480138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.705500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:49.717633 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-906fda87-3793-45a7-9862-a5e2d18908c4 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1614 microversion: 2.1 time: 0.255833 Mar 29 02:15:49.718968 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 733/1503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:49 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1614 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:49.746520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5871ca2c-2ae2-4d9e-a415-50a177a79f9c req-b402538d-e2be-440a-992d-9215e8548ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:49.748229 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:49.748229 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:49.757044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5871ca2c-2ae2-4d9e-a415-50a177a79f9c req-b402538d-e2be-440a-992d-9215e8548ee5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.763134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5871ca2c-2ae2-4d9e-a415-50a177a79f9c req-b402538d-e2be-440a-992d-9215e8548ee5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.781041 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5871ca2c-2ae2-4d9e-a415-50a177a79f9c req-b402538d-e2be-440a-992d-9215e8548ee5 service nova] Creating event network-changed:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:15:49.786510 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5871ca2c-2ae2-4d9e-a415-50a177a79f9c req-b402538d-e2be-440a-992d-9215e8548ee5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066053 Mar 29 02:15:49.787648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 734/1504] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:49.793924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-674379972"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:49.795355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:49.803570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.808952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:49.808952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:49.808952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:50.527129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:50.536533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26a98cee-c829-41a6-8f01-57d2d760a514 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 1.237697 Mar 29 02:15:50.546735 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 771/1505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:49 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:50.551705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:50.552527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:50.560391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:50.561568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:50.562749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:50.563373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:50.683758 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e77750f5-92fc-4223-87e9-62a62b7272f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.893694 Mar 29 02:15:50.698026 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 735/1506] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:15:49 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Mar 29 02:15:50.705383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:50.706485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:50.715832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:50.716806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:50.717831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:50.718390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:51.432616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:51.470019 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b95fa2c-3ac2-4de6-ae0d-733d79ae3574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.920799 Mar 29 02:15:51.484019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 772/1507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:50 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:51.486885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:51.514514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:51.514681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a81a167-61f2-4869-a058-b959f02a19af tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.805003 Mar 29 02:15:51.514804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:51.514905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 736/1508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:50 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:51.514905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-75c92eb4-a576-4eab-85d0-a4d18643f6d2 req-91bc9d3b-b9fe-495d-831d-e2d0c6880b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-unplugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:51.514905 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:51.514905 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:51.525600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:51.528002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:51.529073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-75c92eb4-a576-4eab-85d0-a4d18643f6d2 req-91bc9d3b-b9fe-495d-831d-e2d0c6880b13 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:51.529547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-75c92eb4-a576-4eab-85d0-a4d18643f6d2 req-91bc9d3b-b9fe-495d-831d-e2d0c6880b13 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:51.530044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:51.533587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:51.568280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-75c92eb4-a576-4eab-85d0-a4d18643f6d2 req-91bc9d3b-b9fe-495d-831d-e2d0c6880b13 service nova] Creating event network-vif-unplugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:15:51.574318 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-75c92eb4-a576-4eab-85d0-a4d18643f6d2 req-91bc9d3b-b9fe-495d-831d-e2d0c6880b13 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067212 Mar 29 02:15:51.575092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 737/1509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:51.580790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:51.580790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:51.600133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:51.600575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:51.601379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:51.601809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.111912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:52.128033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-00fa8003-1063-44c3-9205-96c6049e0b81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.551898 Mar 29 02:15:52.131698 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 738/1510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:51 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:52.146144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:52.147213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:52.168303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.168967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.172012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.172784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.296782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:52.304227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.304966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.305570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0816a687-3751-4ba7-9b66-2d5d813165ba tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 0.820815 Mar 29 02:15:52.305745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lazy-loading 'fault' on Instance uuid 5d4c01fd-5c30-428e-8e62-f9209c626c87 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:15:52.306144 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 773/1511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:51 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:52.324677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:52.329627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:52.344534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.352069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.353825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.354490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.409761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7349ebfc977a4c78b752221fa7ac41da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e5017ae7974b11bb7cce9497ad69a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:52.421053 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f7e83dc-3d79-4186-8f65-958dee03a497 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 200 len: 1332 microversion: 2.1 time: 0.288195 Mar 29 02:15:52.423531 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 739/1512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:52 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 1332 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:52.429232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:52.429838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:52.448638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.449200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:52.456452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:52.456452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.093558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:53.118303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c33db9e5-202e-4eac-97a3-4ed2d9f87648 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.810047 Mar 29 02:15:53.119043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 774/1513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:52 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:53.125587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c571141c-30c2-4b24-b0f4-a92a7dddac8d", "tag": "e0e922c7-2182-4fdc-97f7-f7920cb32d2e"}, {"server_uuid": "5d4c01fd-5c30-428e-8e62-f9209c626c87", "name": "network-vif-deleted", "tag": "409a672e-4186-495e-87aa-4bbf92afe7b4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:53.133755 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:53.133755 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:15:53.140925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:53.152083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.152784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.155848 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d1867b6-4699-44d7-b93f-7c61aba148a7 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 0.731168 Mar 29 02:15:53.156561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 740/1514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:52 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:53.167522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:53.168604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:53.182770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.185213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] Creating event network-changed:e0e922c7-2182-4fdc-97f7-f7920cb32d2e for instance c571141c-30c2-4b24-b0f4-a92a7dddac8d on n-h2-828148-1 Mar 29 02:15:53.185568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.186713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.187096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] Creating event network-vif-deleted:409a672e-4186-495e-87aa-4bbf92afe7b4 for instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 on n-h2-828148-1 Mar 29 02:15:53.189542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.196069 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2c2fa04e-3558-429e-b5a2-74fb94cac912 req-7cc4da36-31a9-429d-b6e4-eab3226fd921 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075642 Mar 29 02:15:53.198890 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 775/1515] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:53.215479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-856805cb-54d9-457d-83fb-6a151b09700d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1979472495", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:53.217530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-856805cb-54d9-457d-83fb-6a151b09700d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:53.218867 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-856805cb-54d9-457d-83fb-6a151b09700d tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action" status: 400 len: 938 microversion: 2.1 time: 0.018635 Mar 29 02:15:53.219913 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 776/1516] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Mar 29 02:15:53 2022] POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action => generated 938 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:15:53.226164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:53.227578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:53.237890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.238811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.239813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.240436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.843931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:53.870893 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0d5364a-70a6-4067-948b-16a67de23fe1 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.704362 Mar 29 02:15:53.874905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 741/1517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:53 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:53.886721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:53.887502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:53.897417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.898562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:53.899826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:53.901040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.005198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:54.017902 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7fd1786a-f33c-444b-8f00-85df10c78aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.796771 Mar 29 02:15:54.018972 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 777/1518] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:53 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:54.023562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.024615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:54.035297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.035871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.036948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.037991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.158772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:54.167958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b39d67de-2cca-4b80-a101-f69ac8e8fb90 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.290365 Mar 29 02:15:54.168653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 742/1519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:53 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:54.173424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.174247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:54.183977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.184427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.191055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.191055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.241146 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] HTTP exception thrown: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. Mar 29 02:15:54.241749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Returning 404 to user: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:54.242579 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81329e3c-81ed-4101-a5e5-50aad46246b0 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 404 len: 111 microversion: 2.1 time: 0.072726 Mar 29 02:15:54.243207 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 743/1520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:54 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:15:54.248713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.254148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:54.258043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.258765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.259806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.260388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.760395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:54.761160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:54.768684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d1d6ecc9-e4f9-42f3-9a06-d18bf506f633 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 0.523697 Mar 29 02:15:54.774935 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 744/1521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:54 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:54.775102 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f730f867-7a48-4013-ade6-18da7b0ab746 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 0.749967 Mar 29 02:15:54.775102 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 778/1522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:54 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:54.775261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.775261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:54.781852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.782300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.783103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.783534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.788555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd8c03ad-25a2-4e4e-8f4d-09204488af2c tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '.version_select at 0x7f8724d2cc10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.934025 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd8c03ad-25a2-4e4e-8f4d-09204488af2c tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115345199" status: 202 len: 0 microversion: 2.1 time: 0.152901 Mar 29 02:15:54.935470 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 779/1523] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115345199 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:15:54.943599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:54.944704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:54.954917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.955628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:54.956932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:54.957580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.180648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:55.193670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c62cce0c-f8a9-4a33-926b-bd51bf334ecc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.423348 Mar 29 02:15:55.194883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 745/1524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:54 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:55.202142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:55.203343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:55.214120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.214799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.215575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.216175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.482694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:55.493145 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f498976d-442d-4acc-82cf-c7e31888c34d tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.555969 Mar 29 02:15:55.494135 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 780/1525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:54 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:55.499355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b59f6bbd-a752-44b9-88ff-65d0288c2300 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:55.502699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b59f6bbd-a752-44b9-88ff-65d0288c2300 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:15:55.502699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b59f6bbd-a752-44b9-88ff-65d0288c2300 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action" status: 400 len: 619 microversion: 2.1 time: 0.007468 Mar 29 02:15:55.507226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 781/1526] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Mar 29 02:15:55 2022] POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:15:55.516071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:55.516932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:55.526338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.526844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.527625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.528133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.777588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:55.787533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0acb698-b43e-4864-a6b5-5035a2949dc7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.276460 Mar 29 02:15:55.789799 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 782/1527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:55 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:55.795025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1785437801", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "32489ad6-72a4-4fd1-b22c-7b386a448817"}, {"port": "cb4c85a2-0f06-43b8-8ca8-0980ac95e70f", "tag": "port-1"}, {"port": "105600a4-c888-4283-8455-59177e972415", "tag": "port-2"}, {"uuid": "580dee89-a066-4ece-b97c-e9536d77cb2a", "tag": "net-1"}, {"uuid": "580dee89-a066-4ece-b97c-e9536d77cb2a"}, {"uuid": "a68fd8be-8cd4-40a0-bec7-d8f10c13ac2d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a68fd8be-8cd4-40a0-bec7-d8f10c13ac2d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "31ea9f81-7a2b-4403-9af7-6565dee34076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "3b2839ca-4cc1-4954-a2ac-3488a4d4e549", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2e63a71b-1db9-4833-9067-f965746c6a34", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1902125441"}], "key_name": "tempest-keypair-653102392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:55.887460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:55.898232 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2bdda5cd-143c-43cf-922d-7cd00bc8824b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1688 microversion: 2.1 time: 0.701512 Mar 29 02:15:55.898894 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 746/1528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:55 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1688 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:55.904134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:55.905008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:55.912571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.913272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:55.914230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:55.914873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:56.153494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:56.163467 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec1de743-75e1-447c-a7f0-7f0bbc3c13dd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 0.263262 Mar 29 02:15:56.164239 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 747/1529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:55 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:56.180565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:56.181704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:56.191767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:56.192607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:56.193844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:56.195139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:56.396227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] validate_networks() for [('32489ad6-72a4-4fd1-b22c-7b386a448817', None, None, None), (None, None, 'cb4c85a2-0f06-43b8-8ca8-0980ac95e70f', None), (None, None, '105600a4-c888-4283-8455-59177e972415', None), ('580dee89-a066-4ece-b97c-e9536d77cb2a', None, None, None), ('580dee89-a066-4ece-b97c-e9536d77cb2a', None, None, None), ('a68fd8be-8cd4-40a0-bec7-d8f10c13ac2d', '10.2.2.100', None, None), ('a68fd8be-8cd4-40a0-bec7-d8f10c13ac2d', '10.2.2.200', None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:15:56.532898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:56.539319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-25373ab4-b89b-4165-8259-4afa835dd5fe tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 0.363388 Mar 29 02:15:56.548894 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 748/1530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:56 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:56.548894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:56.548894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:56.556370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:56.557202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:56.561548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:56.561548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:57.745726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:57.759099 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c5dd5fb9-dbdd-4fcc-a59e-bc85ebf702b4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 1.217163 Mar 29 02:15:57.760229 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 749/1531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:56 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:57.765467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:57.766113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:57.778593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:57.779126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:57.780034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:57.793196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:58.248182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:58.259352 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2bba2f82-90e2-4376-87f0-97630e8dbccc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1313 microversion: 2.1 time: 0.497996 Mar 29 02:15:58.271479 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 750/1532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:57 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:58.286285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f511e986-73a9-48d1-bc06-ba9191e6841e req-b1a6d801-2889-4dce-bd91-a532c2b9d3fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "name": "network-vif-plugged", "status": "completed", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:15:58.288765 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:15:58.288765 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:15:58.300759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f511e986-73a9-48d1-bc06-ba9191e6841e req-b1a6d801-2889-4dce-bd91-a532c2b9d3fd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:58.302799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f511e986-73a9-48d1-bc06-ba9191e6841e req-b1a6d801-2889-4dce-bd91-a532c2b9d3fd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:58.324897 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f511e986-73a9-48d1-bc06-ba9191e6841e req-b1a6d801-2889-4dce-bd91-a532c2b9d3fd service nova] Creating event network-vif-plugged:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h1-828148-1 Mar 29 02:15:58.330232 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f511e986-73a9-48d1-bc06-ba9191e6841e req-b1a6d801-2889-4dce-bd91-a532c2b9d3fd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057192 Mar 29 02:15:58.331550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 751/1533] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:15:58.339790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:58.345376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:58.362686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:58.363331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:58.366838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:58.367357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:58.788707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:58.801771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a450868f-2cfc-4a87-9cf9-ac9b1a442b9e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1688 microversion: 2.1 time: 0.467488 Mar 29 02:15:58.812681 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 752/1534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:58 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1688 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:58.817261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:58.817912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:58.827643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:58.828094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:58.828893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:58.829330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:59.590496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:15:59.600799 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-919f1163-1340-4147-9166-0895c66f89ed tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 0.787046 Mar 29 02:15:59.607252 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 753/1535] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:58 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:15:59.619002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:15:59.619653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:15:59.632102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:59.633072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:15:59.634973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:15:59.635683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.059405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:00.069398 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed88160f-4976-4868-8c10-4d14eb9a8970 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 0.460952 Mar 29 02:16:00.070268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 754/1536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:15:59 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:00.075094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-543431614"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:00.076923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:00.119526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.121412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.125629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.127982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.897809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:00.898565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:00.899040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:00.899462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:00.900699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:00.922682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.925502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.927143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.929248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.948810 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99ab3683-e249-4f01-a1c3-11fd38492446 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action" status: 202 len: 0 microversion: 2.1 time: 0.877089 Mar 29 02:16:00.952646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for project c614c9fa0e294c13b291d76d98e4e350. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:00.953264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 755/1537] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:00 2022] POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:16:00.963497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:00.968013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Getting quotas for user f44f15c99fa3407c8d95b7c99783b70d and project c614c9fa0e294c13b291d76d98e4e350. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:00.975657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:00.990157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.990649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:00.991709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:00.993378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:01.299625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:01.301489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='31ea9f81-7a2b-4403-9af7-6565dee34076',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='3b2839ca-4cc1-4954-a2ac-3488a4d4e549',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e63a71b-1db9-4833-9067-f965746c6a34',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:01.619323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:01.669202 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9a3a747-506b-4520-ad2c-fc27111184d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1462 microversion: 2.1 time: 0.714366 Mar 29 02:16:01.676025 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 756/1538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:00 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1462 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:01.690649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:01.702586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:01.739566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:01.741256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:01.752090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:01.753928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.093719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:02.106898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-412758e8-581a-4637-8963-9d594488b708 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 0.423012 Mar 29 02:16:02.118826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 757/1539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:01 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:02.124389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-plugged", "status": "completed", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}, {"server_uuid": "69a64121-445b-4fcb-8b77-7db8db344cab", "name": "network-vif-plugged", "status": "completed", "tag": "2ff59a99-506e-4a84-9b64-206ecb4e2882"}, {"server_uuid": "c571141c-30c2-4b24-b0f4-a92a7dddac8d", "name": "network-vif-plugged", "status": "completed", "tag": "e0e922c7-2182-4fdc-97f7-f7920cb32d2e"}, {"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-plugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:02.127877 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:02.127877 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:02.155111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.155921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.193911 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Creating event network-vif-plugged:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:16:02.194416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Creating event network-vif-plugged:2ff59a99-506e-4a84-9b64-206ecb4e2882 for instance 69a64121-445b-4fcb-8b77-7db8db344cab on n-h1-828148-1 Mar 29 02:16:02.195177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Creating event network-vif-plugged:e0e922c7-2182-4fdc-97f7-f7920cb32d2e for instance c571141c-30c2-4b24-b0f4-a92a7dddac8d on n-h2-828148-1 Mar 29 02:16:02.195898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] Creating event network-vif-plugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:16:02.209165 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c347ec53-0779-494b-a7b2-afdeb8b1cbeb req-0204f62a-df75-476d-9863-8eda64564c92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.088455 Mar 29 02:16:02.210626 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 758/1540] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:02.217901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:02.219440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:02.255506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.256428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.262934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.263840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.702344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:02.716625 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e794f895-1486-4efe-86df-c6fc79db9c05 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1314 microversion: 2.1 time: 0.504345 Mar 29 02:16:02.726518 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 759/1541] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:02 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:02.731545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1560360624"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:02.737657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:02.756083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.760392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.761484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.762141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.841074 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Cannot 'createImage' instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f while it is in task_state image_pending_upload Mar 29 02:16:02.842588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 409 to user: Cannot 'createImage' instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f while it is in task_state image_pending_upload {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:16:02.844278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-194cc7b9-dd43-4f4e-a213-bdd148f89174 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action" status: 409 len: 165 microversion: 2.1 time: 0.115983 Mar 29 02:16:02.845404 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 760/1542] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:02 2022] POST /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f/action => generated 165 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:16:02.854668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:02.856165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:02.864381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.873816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.874688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.875204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.925017 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d027a4df-bbc4-4dcf-9aba-ed0b05b201ef tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.131821 Mar 29 02:16:02.928046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 783/1543] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Mar 29 02:15:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 7137 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:16:02.939374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:02.945987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:02.961801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.962467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:02.965490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:02.967187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:03.285781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:03.294636 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60a297e1-14f4-442c-a988-81c3a09f188e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1311 microversion: 2.1 time: 0.447459 Mar 29 02:16:03.301772 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 761/1544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:02 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:03.326285 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ef1c2d1-7a6f-4a4f-98f9-c884d3b9c00f tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1613 microversion: 2.1 time: 0.396988 Mar 29 02:16:03.330084 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 784/1545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:02 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1613 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:03.336532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5398b6a0-9315-4962-a9ae-e37a77e9da34 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f87241729d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:03.466184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-465425444", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:03.740411 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5398b6a0-9315-4962-a9ae-e37a77e9da34 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/images/d62b2fdc-f65e-4b00-bd1f-58e5f156ba41" status: 204 len: 0 microversion: 2.1 time: 0.408941 Mar 29 02:16:03.744523 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 785/1546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:03 2022] DELETE /compute/v2.1/images/d62b2fdc-f65e-4b00-bd1f-58e5f156ba41 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:16:03.748259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:03.754303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:03.845015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] validate_networks() for [('39dfc579-1e6a-472b-9fc9-7d16e1c082d6', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:16:03.945622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:03.960357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:03.962863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:03.964176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de0f0ad3-60d1-4c07-9d2d-7c3f84961759 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1285 microversion: 2.32 time: 0.220922 Mar 29 02:16:03.965509 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 786/1547] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:03 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:03.970385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:03.971052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:03.984657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:03.985040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:03.986704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:03.987755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:04.052434 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] HTTP exception thrown: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. Mar 29 02:16:04.053527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Returning 404 to user: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:16:04.054645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9e5200e-6de6-49ba-b843-c70a9f33a146 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 404 len: 111 microversion: 2.1 time: 0.087851 Mar 29 02:16:04.055561 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 787/1548] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:16:03 2022] DELETE /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:16:04.061435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:04.062358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:04.071967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:04.072492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:04.073389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:04.074145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:04.333071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:04.343622 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55f7f2cb-ebbf-490e-9167-9ca63a53ac52 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 0.286577 Mar 29 02:16:04.354802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 788/1549] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:04 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:04.359827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:04.360769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:04.369496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:04.370287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:04.371329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:04.372186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:04.463988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '290f81f2a34543a2812af388717ad506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35b3b7951bfa4f3b914de847772d8de3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:04.465062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] flavor_id is None. Assuming migration. {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4011}} Mar 29 02:16:04.465715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:16:04.962653 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39e5b478-ed15-4a83-8f45-a9310727faf3 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335/action" status: 202 len: 0 microversion: 2.1 time: 0.606339 Mar 29 02:16:04.968164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 789/1550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:04 2022] POST /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:04.973153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:04.973863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:05.011275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.012296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.017465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.017922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.232916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:05.233482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:05.233971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:05.234713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:05.235451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:05.249100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.249964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.260574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.261441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.301976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Getting quotas for project d10747b4b0194fb39b32e077d5ca8e49. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:05.308063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Getting quotas for user f378decc1b1a40c89114be1900f54da2 and project d10747b4b0194fb39b32e077d5ca8e49. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:05.326978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:05.329918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:05.346050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:05.359626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-819bc098-261a-4b4a-9d1a-4f210125c487 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1463 microversion: 2.1 time: 0.390524 Mar 29 02:16:05.360325 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 790/1551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:04 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1463 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:05.374081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:05.375493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:05.386400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.388195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.389708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.390342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.572676 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8ae4925-6bc2-4d44-9dcb-a6e586a892b1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.269601 Mar 29 02:16:05.581243 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 762/1552] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:16:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:16:05.592073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:05.598169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] [instance: 5d4c01fd-5c30-428e-8e62-f9209c626c87] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:05.615275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.617286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.618318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.620151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.818030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] HTTP exception thrown: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. Mar 29 02:16:05.818657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] Returning 404 to user: Instance 5d4c01fd-5c30-428e-8e62-f9209c626c87 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:16:05.819790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c62e39af-62f3-4f60-a1eb-c04c27aed796 tempest-AttachSCSIVolumeTestJSON-1439956252 tempest-AttachSCSIVolumeTestJSON-1439956252-project] 10.222.0.36 "GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87" status: 404 len: 111 microversion: 2.1 time: 0.237254 Mar 29 02:16:05.824569 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 763/1553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:05 2022] GET /compute/v2.1/servers/5d4c01fd-5c30-428e-8e62-f9209c626c87 => generated 111 bytes in 242 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:16:05.840537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:05.841325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:05.862866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.863966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.865023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:05.865495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:05.948045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:05.968243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c850eca7-d773-4df5-b7e2-e3b63c578e31 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1535 microversion: 2.1 time: 0.606486 Mar 29 02:16:05.987383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 791/1554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:05 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1535 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:06.005759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:06.006455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:06.022051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.022719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:06.025231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.026811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:06.531122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:06.542727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5b29cd8-5ac0-4abc-aa04-b9bdbc833c1e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1471 microversion: 2.1 time: 0.554163 Mar 29 02:16:06.543872 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 792/1555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:05 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:06.549347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:06.550278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:06.580571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.581129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:06.589860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.590368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:06.844980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:06.874502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:06.876018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:06.877225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ae6c525-46ed-464f-b24f-72b28b2982ae tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1583 microversion: 2.32 time: 0.332194 Mar 29 02:16:06.889042 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 793/1556] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:06 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1583 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:06.902002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:06.903201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:06.926321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.927081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:06.928070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:06.928704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:07.383563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:07.404437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7890dae8-6f02-4abb-a1ae-36cd64b49b68 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1493 microversion: 2.1 time: 1.578604 Mar 29 02:16:07.406169 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 764/1557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:05 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1493 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:07.412879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:07.413734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:07.432581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:07.440647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:07.440647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:07.440647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:07.587036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:07.596125 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-650ad173-5b1d-41fa-8add-6ec5d127c47c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 0.709677 Mar 29 02:16:07.617658 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 794/1558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:06 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:07.639098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:07.639098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:07.679956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:07.681133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:07.682212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:07.682875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:07.966537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:07.981463 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-823551ef-d331-4b6a-bf32-0de55a23563c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1217 microversion: 2.1 time: 0.358451 Mar 29 02:16:07.982675 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 795/1559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:07 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1217 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:07.997948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:07.998892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:08.008383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.009750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.011299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.011908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.335231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:08.346950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-585700fe-b648-43d6-89c5-34534b94dc24 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1522 microversion: 2.1 time: 0.362267 Mar 29 02:16:08.348022 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 796/1560] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:07 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:08.516195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:08.525990 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c8e5183e-4784-449e-bf04-8131e827ff38 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1464 microversion: 2.1 time: 1.118811 Mar 29 02:16:08.526568 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 765/1561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:07 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1464 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:08.530838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:08.541595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:08.557780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.558225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.559217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.559834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.564652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:08.565537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:08.575619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.576094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.577326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.577795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:08.933046 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-613d7e6f-c618-4bcf-a1b8-c48967dd896c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1644 microversion: 2.1 time: 0.581400 Mar 29 02:16:08.955690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 797/1562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:08 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1644 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:08.966807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f8b55bf6-8213-4e61-8fac-a19680b23827 req-e84e8dbe-e642-4035-bf30-eb6fab79b6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbf5ec3-94f8-4cd9-8c97-cfead97c717f", "name": "network-vif-plugged", "status": "completed", "tag": "389d1a00-004f-4f58-9a14-b81844fdeab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:08.969004 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:08.969004 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:08.982039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f8b55bf6-8213-4e61-8fac-a19680b23827 req-e84e8dbe-e642-4035-bf30-eb6fab79b6f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:08.982685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f8b55bf6-8213-4e61-8fac-a19680b23827 req-e84e8dbe-e642-4035-bf30-eb6fab79b6f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.014785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f8b55bf6-8213-4e61-8fac-a19680b23827 req-e84e8dbe-e642-4035-bf30-eb6fab79b6f8 service nova] Creating event network-vif-plugged:389d1a00-004f-4f58-9a14-b81844fdeab5 for instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f on n-h2-828148-1 Mar 29 02:16:09.023172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f8b55bf6-8213-4e61-8fac-a19680b23827 req-e84e8dbe-e642-4035-bf30-eb6fab79b6f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064684 Mar 29 02:16:09.024082 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 798/1563] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:09.034329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:09.035910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:09.045968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.053695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.054643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.056616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.211437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:09.224947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:09.225460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:09.226727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c54f63d-dd24-49a5-a6a6-7fb0159951ab tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1593 microversion: 2.32 time: 0.199369 Mar 29 02:16:09.232919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 799/1564] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:09 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1593 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:09.238343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:09.240080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:09.251759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.252207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.253456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.253891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.330003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:16:09.333101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:09.342112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81fe12b3-c6dc-4047-a2de-b074eadb7641 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1471 microversion: 2.1 time: 0.814593 Mar 29 02:16:09.353345 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 766/1565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:08 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1471 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:09.358619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:09.359468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:09.371227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.372044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.373065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:09.373713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:09.787284 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e53fb86-7573-48ee-85b3-5c64166af629 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 204 len: 0 microversion: 2.1 time: 0.552672 Mar 29 02:16:09.787876 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 800/1566] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:16:09 2022] DELETE /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:16:09.793976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1400581079", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "51d86884-c17f-4a9e-99a8-f036046606d2"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:09.868747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:16:10.273776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:10.274507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:10.274856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:10.275388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:10.275872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:10.291509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.292166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.293261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.293752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.315235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:10.322639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Getting quotas for user a2c3da46792940ce9c4ed371e1c2748e and project 4c0c4a74ba1d46dc99e030cdf41349b5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:10.337520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:10.340947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:10.448310 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d11650a9-88f0-4999-82cd-0dbdd5a67944 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658733 Mar 29 02:16:10.449491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 801/1567] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:16:10.454946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:10.455923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:10.470189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.470189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.470189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.470571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.556371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:10.567712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e258c588-3d32-428a-b5fa-826e7fdaade6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 1.212949 Mar 29 02:16:10.580163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 767/1568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:09 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:10.586110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:10.587525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:10.599556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.600730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.602565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.603179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.844763 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b0c8941-d171-4189-b555-1b6c51b5a6d8 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1644 microversion: 2.1 time: 0.393992 Mar 29 02:16:10.847660 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 802/1569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:10 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1644 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:10.856211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:10.856871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:10.873737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.874205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:10.875056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:10.877841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:11.020405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:11.030744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-972e6a1a-aa3f-4f2a-aae2-a0853150600e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1271 microversion: 2.1 time: 0.448599 Mar 29 02:16:11.030883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 768/1570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:10 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1271 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:11.057958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:11.058596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:11.090453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:11.091007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:11.092440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:11.092906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:11.213340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:11.224646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee708e45-6bee-487d-8e5e-9e730e820016 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1528 microversion: 2.1 time: 0.374672 Mar 29 02:16:11.224646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 803/1571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:10 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:11.229252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:11.230098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:11.248710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:11.249463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:11.250445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:11.251044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:11.980831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:11.993227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:12.003226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:12.004281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6261b4c8-6821-477a-984a-cc11d2b2f1d9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1593 microversion: 2.32 time: 0.959632 Mar 29 02:16:12.005052 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 769/1572] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:11 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1593 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:12.026231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:12.026231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:12.045428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:12.056684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.060181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.066150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.066839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.068889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00ef2dda-7ff4-4e86-9977-dc763e009244 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1471 microversion: 2.1 time: 0.842119 Mar 29 02:16:12.096560 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 804/1573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:11 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1471 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:12.096560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:12.113580 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:12.113580 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:12.115382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.116044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.116876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.117316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.178966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1b311b9-20a2-4019-951b-98b3298ee6f7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.093755 Mar 29 02:16:12.181331 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 805/1574] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:16:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:12.188317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6fb119a1-6190-4a74-b83d-9879d46ef7e0 req-65238d92-3bb3-4f49-8e03-92aafe5521ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbf5ec3-94f8-4cd9-8c97-cfead97c717f", "name": "network-vif-unplugged", "status": "completed", "tag": "389d1a00-004f-4f58-9a14-b81844fdeab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:12.189945 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:12.189945 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:12.200533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6fb119a1-6190-4a74-b83d-9879d46ef7e0 req-65238d92-3bb3-4f49-8e03-92aafe5521ef service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.202125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6fb119a1-6190-4a74-b83d-9879d46ef7e0 req-65238d92-3bb3-4f49-8e03-92aafe5521ef service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.225466 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6fb119a1-6190-4a74-b83d-9879d46ef7e0 req-65238d92-3bb3-4f49-8e03-92aafe5521ef service nova] Creating event network-vif-unplugged:389d1a00-004f-4f58-9a14-b81844fdeab5 for instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f on n-h2-828148-1 Mar 29 02:16:12.237669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6fb119a1-6190-4a74-b83d-9879d46ef7e0 req-65238d92-3bb3-4f49-8e03-92aafe5521ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053269 Mar 29 02:16:12.257345 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 806/1575] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:12.269333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:12.271296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:12.299856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.300323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.301170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.306833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.628253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:12.639888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edf68a4f-cc45-414b-9e69-c72bc76c9919 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1218 microversion: 2.1 time: 0.632362 Mar 29 02:16:12.642640 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 770/1576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:12 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1218 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:12.652976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:12.653806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:12.668585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.671498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.673114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:12.674138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:12.996204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:13.011579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4750e124-f62f-4a4e-8d0a-1413556ea515 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 0.753885 Mar 29 02:16:13.014760 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 807/1577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:12 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:13.028110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-828148-1", "block_migration": true, "disk_over_commit": false}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:13.029276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:13.050605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.051227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:13.059425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.059425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:13.059803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:13.074124 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bf166c0-87ea-45ce-8a73-2419770673c1 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1271 microversion: 2.1 time: 0.430123 Mar 29 02:16:13.081005 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 771/1578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:12 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1271 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:13.096795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:13.100850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:13.132568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.135278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:13.135278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.135278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:13.192581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lazy-loading 'flavor' on Instance uuid 69a64121-445b-4fcb-8b77-7db8db344cab {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:16:13.292033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Going to try to live migrate instance to n-h2-828148-1 {{(pid=103513) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:16:13.496073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:13.509789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a881f9d-1433-4e10-b026-5f7de2e29b44 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 200 len: 1486 microversion: 2.1 time: 0.425604 Mar 29 02:16:13.511637 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 772/1579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:13 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 1486 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:13.539186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:13.543067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:13.573771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.576463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:13.579761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:13.581189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:14.757374 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:16:15.550819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:15.566703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:15.575751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:15.586092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7bd07a82-75ec-424f-b8d4-79e7dd672d52 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1661 microversion: 2.32 time: 2.073396 Mar 29 02:16:15.590588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 773/1580] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:13 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1661 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:15.611592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:15.612256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:15.639046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:15.642862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:15.648596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:15.649793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:15.765453 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55108. Mar 29 02:16:16.651277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:16.655904 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-54e0f617-7885-4ab2-8532-60626fe27965 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1471 microversion: 2.1 time: 1.064136 Mar 29 02:16:16.656479 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 774/1581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:15 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1471 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:16.666624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:16.671907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:16.686559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:16.687008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:16.690969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:16.691447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:18.535001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:18.546633 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e63af806-8342-4446-92b1-b355a3416d84 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 1.886615 Mar 29 02:16:18.547719 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 775/1582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:16 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:18.553075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-aa7a1ddf-5753-4174-a5cc-af8c900a2c10 req-9ebec088-0bc7-4064-94a2-269c9d9361b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbf5ec3-94f8-4cd9-8c97-cfead97c717f", "name": "network-vif-deleted", "tag": "389d1a00-004f-4f58-9a14-b81844fdeab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:18.556188 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:18.556188 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:18.565806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aa7a1ddf-5753-4174-a5cc-af8c900a2c10 req-9ebec088-0bc7-4064-94a2-269c9d9361b3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:18.566535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aa7a1ddf-5753-4174-a5cc-af8c900a2c10 req-9ebec088-0bc7-4064-94a2-269c9d9361b3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:18.586622 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-aa7a1ddf-5753-4174-a5cc-af8c900a2c10 req-9ebec088-0bc7-4064-94a2-269c9d9361b3 service nova] Creating event network-vif-deleted:389d1a00-004f-4f58-9a14-b81844fdeab5 for instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f on n-h2-828148-1 Mar 29 02:16:18.599120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-aa7a1ddf-5753-4174-a5cc-af8c900a2c10 req-9ebec088-0bc7-4064-94a2-269c9d9361b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049240 Mar 29 02:16:18.600003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 776/1583] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:18.607582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:18.608668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:18.621200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:18.621922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:18.623862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:18.624637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:18.974663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56152205-22fe-470e-916f-36d296f4c4d7 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab/action" status: 202 len: 0 microversion: 2.1 time: 5.950690 Mar 29 02:16:18.978483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 808/1584] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:13 2022] POST /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab/action => generated 0 bytes in 5963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:18.981336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:18.981957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:19.005944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.006400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:19.014820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.015275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:19.795042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:19.804477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd1a8f23-71ed-4a4c-9219-9c592417325e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 1.202810 Mar 29 02:16:19.808247 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 777/1585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:18 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:19.819172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:19.820146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:19.836668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.837570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:19.839076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.839752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:19.912353 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. Mar 29 02:16:19.913149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:16:19.914100 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbe965ae-effc-4a6c-a05f-31d7e993f14f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 404 len: 111 microversion: 2.1 time: 0.099491 Mar 29 02:16:19.918323 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 778/1586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:19 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:16:19.920831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:19.921703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:19.929527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.930936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:19.931988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:19.932542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:20.769248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:20.780482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3017a6d-e70c-43c5-9dd2-6abf8d8d3120 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 1.804073 Mar 29 02:16:20.786639 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 809/1587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:18 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:21.056200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:21.060892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:21.061507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:21.080740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.088177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:21.088597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:21.090412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:21.091466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.101882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:21.101991 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-554a900d-1c6a-4675-bc94-4be06247bd85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1696 microversion: 2.32 time: 1.182721 Mar 29 02:16:21.102390 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 779/1588] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:19 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1696 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:21.112870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:21.114873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:21.132621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.136222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:21.136486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.139066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:21.800258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:21.810091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7c0f2acb-cc20-46ad-ac3c-b229e625695f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 0.706423 Mar 29 02:16:21.811292 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 780/1589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:21 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:21.815905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:21.816783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:21.835398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.836806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:21.837844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:21.838497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:22.258660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:22.272019 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ddc5233-f824-40c9-aed1-f20fdf1ce9e8 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 1.482859 Mar 29 02:16:22.274898 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 810/1590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:20 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:22.281822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'create', calling method: .version_select at 0x7f8717fbd160>, body: {"keypair": {"name": "tempest-keypair-350972814"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:22.309741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:22.312864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:22.323082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for user 7ff0139c538f4391bd0b5eb0c42f11a0 and project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:22.323452 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9d7e835-7d84-438b-bdc3-df25b6af5660 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 0.509616 Mar 29 02:16:22.331733 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 781/1591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:21 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:22.337174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-50338415-c3f2-46ff-8f4e-cd367e17be2e req-bbf95bae-a1f3-41df-8041-d746e345e599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed9ec9a7-1c01-4876-aee0-22d5ba868502", "tag": "58124146-6c37-4dae-911f-9195c10ad2c3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:22.349377 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:22.349377 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:22.367536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-50338415-c3f2-46ff-8f4e-cd367e17be2e req-bbf95bae-a1f3-41df-8041-d746e345e599 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:22.368290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-50338415-c3f2-46ff-8f4e-cd367e17be2e req-bbf95bae-a1f3-41df-8041-d746e345e599 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:22.394430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-50338415-c3f2-46ff-8f4e-cd367e17be2e req-bbf95bae-a1f3-41df-8041-d746e345e599 service nova] Creating event network-changed:58124146-6c37-4dae-911f-9195c10ad2c3 for instance ed9ec9a7-1c01-4876-aee0-22d5ba868502 on n-h1-828148-1 Mar 29 02:16:22.400502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-50338415-c3f2-46ff-8f4e-cd367e17be2e req-bbf95bae-a1f3-41df-8041-d746e345e599 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067248 Mar 29 02:16:22.401503 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 782/1592] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:22.407956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8373bee7-618c-4bd5-a054-c38f84c3c64e req-3914b425-2233-438d-99a5-277770bedac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9994c2ab-a820-4d6d-8278-4ebc48290e2a", "tag": "57fa01ee-903d-41b2-b7a4-b213bb595ba8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:22.409478 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:22.409478 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:22.420988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8373bee7-618c-4bd5-a054-c38f84c3c64e req-3914b425-2233-438d-99a5-277770bedac8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:22.421437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8373bee7-618c-4bd5-a054-c38f84c3c64e req-3914b425-2233-438d-99a5-277770bedac8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:22.447297 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8373bee7-618c-4bd5-a054-c38f84c3c64e req-3914b425-2233-438d-99a5-277770bedac8 service nova] Creating event network-changed:57fa01ee-903d-41b2-b7a4-b213bb595ba8 for instance 9994c2ab-a820-4d6d-8278-4ebc48290e2a on n-h2-828148-1 Mar 29 02:16:22.452412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8373bee7-618c-4bd5-a054-c38f84c3c64e req-3914b425-2233-438d-99a5-277770bedac8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048987 Mar 29 02:16:22.453514 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 783/1593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:22.459744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:22.460452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:22.470073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:22.470527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:22.471314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:22.471748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:23.027486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:23.043806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for user 7ff0139c538f4391bd0b5eb0c42f11a0 and project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:23.074363 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a325edb-fe6c-4568-9537-5e98c391f375 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.797830 Mar 29 02:16:23.080362 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 811/1594] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:16:22 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:23.091618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:23.092903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:23.109417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:23.109885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:23.110691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:23.111121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:23.450225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:23.461162 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f893c05b-fddd-4b2b-9e7e-554aea33bc4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 1.005668 Mar 29 02:16:23.462167 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 784/1595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:22 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:23.472744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:23.472744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:23.479664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:23.480272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:23.481185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:23.481705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:23.978294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:23.987039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e6d605d-f122-43c2-8491-a72920317d7f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.907578 Mar 29 02:16:23.988193 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 812/1596] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:23 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:23.992196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:23.993171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:24.000863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.001281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.002149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.002489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.095728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:24.107327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:24.109065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:24.110404 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-062bedbc-9a71-4d80-886d-8bf542daace6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1743 microversion: 2.32 time: 0.646750 Mar 29 02:16:24.124680 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 785/1597] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:23 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1743 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:24.124680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:24.124680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:24.125645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.126097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.126929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.127417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.454695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:24.465874 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae51bedf-b54d-4870-82e5-76de73d844c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.353409 Mar 29 02:16:24.466729 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 786/1598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:24 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:24.480695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:24.480695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:24.488294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.489051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.493646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.494723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.798472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:24.810186 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0690bedb-2611-4591-902c-6b9c8946926f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 0.339799 Mar 29 02:16:24.820746 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 787/1599] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:24 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:24.829116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:24.830124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:24.848215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.852886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:24.853734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:24.854179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.276158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:25.288327 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7bc01af5-e3b8-4bd1-a40d-1a94ff604ec7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1683 microversion: 2.1 time: 0.467639 Mar 29 02:16:25.292769 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 788/1600] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1683 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:25.309995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:25.310635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:25.319807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:25.320283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.324635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:25.324635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.720009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:25.732998 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2bf8ddc2-7f3a-4ffd-ba0f-a492d2df67bb tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 1.744066 Mar 29 02:16:25.733913 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 813/1601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:23 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:25.739389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4b0e7e81-9514-4a6e-bcd0-0ac00ba4f274 req-a7e19454-bc00-4c3f-a012-c254c5c672a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a64121-445b-4fcb-8b77-7db8db344cab", "name": "network-vif-unplugged", "status": "completed", "tag": "2ff59a99-506e-4a84-9b64-206ecb4e2882"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:25.741046 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:25.741046 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:25.755310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4b0e7e81-9514-4a6e-bcd0-0ac00ba4f274 req-a7e19454-bc00-4c3f-a012-c254c5c672a2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:25.755767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4b0e7e81-9514-4a6e-bcd0-0ac00ba4f274 req-a7e19454-bc00-4c3f-a012-c254c5c672a2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.781482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4b0e7e81-9514-4a6e-bcd0-0ac00ba4f274 req-a7e19454-bc00-4c3f-a012-c254c5c672a2 service nova] Creating event network-vif-unplugged:2ff59a99-506e-4a84-9b64-206ecb4e2882 for instance 69a64121-445b-4fcb-8b77-7db8db344cab on n-h1-828148-1 Mar 29 02:16:25.789529 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4b0e7e81-9514-4a6e-bcd0-0ac00ba4f274 req-a7e19454-bc00-4c3f-a012-c254c5c672a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053818 Mar 29 02:16:25.790943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 814/1602] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:25.796366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:25.797524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:25.806192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:25.806866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.808006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:25.808774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:25.990322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:26.009632 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f19459e6-1698-450e-a303-9fa51d0429c3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.715688 Mar 29 02:16:26.019630 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 789/1603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:25 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:26.024784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:26.026840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:26.034257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.034922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.036047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.036642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.338556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:26.343818 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32ccd184-f07b-4094-a77d-6548aa30e2bc tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.322851 Mar 29 02:16:26.344515 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 790/1604] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:26 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:26.349117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:26.349987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:26.364890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.365360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.366779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.366907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.774929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:26.788142 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24c15e24-e069-48d9-b27b-6298cd92e404 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 0.442257 Mar 29 02:16:26.789572 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 791/1605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:26 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:26.807641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:26.808278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:26.816973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.817424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.818539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:26.819145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:26.979105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:26.997617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:27.004387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:27.007024 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-650c3d16-14e5-4c92-bbb0-4584553e07fb tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1837 microversion: 2.32 time: 1.214748 Mar 29 02:16:27.018752 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 815/1606] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:25 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1837 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:27.018752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:27.018752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:27.023335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.024045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.025089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.025734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.170649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:27.181906 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-932a671d-4759-4266-9617-dd8432df37b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.390315 Mar 29 02:16:27.183170 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 792/1607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:27.188465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:27.189279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:27.198826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.199471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.200417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.201119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.748945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:27.766628 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4648166f-6076-4d4c-9d04-b2b66e94ca85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.580053 Mar 29 02:16:27.774594 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 793/1608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:27 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:27.789608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:27.790998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:27.801698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.802417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.803262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.803940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.859638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:27.870626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4407558-189f-49c8-a690-8191606454a6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 0.860090 Mar 29 02:16:27.873340 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 816/1609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:27 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:27.878212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-451adb32-ad4b-4619-a149-1c68c3d3e920 req-048fbbf5-c34f-4dd8-9261-d4086bb9548a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9994c2ab-a820-4d6d-8278-4ebc48290e2a", "name": "network-vif-plugged", "status": "completed", "tag": "57fa01ee-903d-41b2-b7a4-b213bb595ba8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:27.882149 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:27.882149 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:27.890011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-451adb32-ad4b-4619-a149-1c68c3d3e920 req-048fbbf5-c34f-4dd8-9261-d4086bb9548a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.890473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-451adb32-ad4b-4619-a149-1c68c3d3e920 req-048fbbf5-c34f-4dd8-9261-d4086bb9548a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.907932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-451adb32-ad4b-4619-a149-1c68c3d3e920 req-048fbbf5-c34f-4dd8-9261-d4086bb9548a service nova] Creating event network-vif-plugged:57fa01ee-903d-41b2-b7a4-b213bb595ba8 for instance 9994c2ab-a820-4d6d-8278-4ebc48290e2a on n-h2-828148-1 Mar 29 02:16:27.913178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-451adb32-ad4b-4619-a149-1c68c3d3e920 req-048fbbf5-c34f-4dd8-9261-d4086bb9548a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038285 Mar 29 02:16:27.914170 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 817/1610] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:27.919297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:27.920732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:27.938775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.939870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:27.941016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:27.941624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:28.169695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:28.180468 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0130db4f-9677-4805-9ec7-c4b31146110e tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.404713 Mar 29 02:16:28.196966 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 794/1611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:27 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:28.201826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d0e3e449-ef53-4b37-8735-e1065257f6a4 req-363f65a7-dd54-48c2-93d0-863a04850d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a64121-445b-4fcb-8b77-7db8db344cab", "tag": "2ff59a99-506e-4a84-9b64-206ecb4e2882"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:28.203532 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:28.203532 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:28.212714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d0e3e449-ef53-4b37-8735-e1065257f6a4 req-363f65a7-dd54-48c2-93d0-863a04850d7d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:28.213586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d0e3e449-ef53-4b37-8735-e1065257f6a4 req-363f65a7-dd54-48c2-93d0-863a04850d7d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:28.232055 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d0e3e449-ef53-4b37-8735-e1065257f6a4 req-363f65a7-dd54-48c2-93d0-863a04850d7d service nova] Creating event network-changed:2ff59a99-506e-4a84-9b64-206ecb4e2882 for instance 69a64121-445b-4fcb-8b77-7db8db344cab on n-h1-828148-1 Mar 29 02:16:28.238091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d0e3e449-ef53-4b37-8735-e1065257f6a4 req-363f65a7-dd54-48c2-93d0-863a04850d7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039453 Mar 29 02:16:28.239163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 795/1612] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:28.245329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:28.247119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:28.256765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:28.257518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:28.259154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:28.259769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:28.980009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:28.993339 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1acd2f2e-4ac8-4a16-b44c-237c06e41733 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 1.077890 Mar 29 02:16:29.005150 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 818/1613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:27 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:29.011039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-61f1580e-1963-41ab-b27d-d4f6103b8765 req-285f9cc5-0fa5-4b32-8489-883723fcefc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "f513d80e-5a27-42e8-94fa-8a78a33d2a64"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:29.012539 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:29.012539 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:29.021930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-61f1580e-1963-41ab-b27d-d4f6103b8765 req-285f9cc5-0fa5-4b32-8489-883723fcefc0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.022623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-61f1580e-1963-41ab-b27d-d4f6103b8765 req-285f9cc5-0fa5-4b32-8489-883723fcefc0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.047415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-61f1580e-1963-41ab-b27d-d4f6103b8765 req-285f9cc5-0fa5-4b32-8489-883723fcefc0 service nova] Creating event network-changed:f513d80e-5a27-42e8-94fa-8a78a33d2a64 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:29.052804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-61f1580e-1963-41ab-b27d-d4f6103b8765 req-285f9cc5-0fa5-4b32-8489-883723fcefc0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046042 Mar 29 02:16:29.065367 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 819/1614] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:29.072292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:29.073270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:29.082600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.083297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.085101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.085744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.088401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:29.103671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:29.110922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:29.122003 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3267124c-e905-4e90-b6ac-8724fd12ffd3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1837 microversion: 2.32 time: 0.881426 Mar 29 02:16:29.136421 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 796/1615] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:28 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1837 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:29.136421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:29.136421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:29.136421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.136421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.137238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.137238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.738373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:29.747359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-661127fd-f40a-4410-b534-a61b4d58dbee tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.680372 Mar 29 02:16:29.757069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 820/1616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:29 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:29.762170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:29.762773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:29.770755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.771474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:29.772246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:29.772666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.123968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:30.137286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f56ba01-0076-4a24-936f-7e74f0a33aea tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 1.013525 Mar 29 02:16:30.147915 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 797/1617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:29 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:30.158137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:30.158137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:30.163184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.164139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.165214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.165872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.399211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:30.406445 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b96bbeac-b67b-4c8c-885e-b2418f7019c6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.648007 Mar 29 02:16:30.416744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 821/1618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:29 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:30.421858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f24c6977-f576-43bb-9bc1-f7c4770d23fc req-16474c08-960b-4528-8291-b8f460cc5f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-unplugged", "status": "completed", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:30.424253 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:30.424253 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:30.435340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f24c6977-f576-43bb-9bc1-f7c4770d23fc req-16474c08-960b-4528-8291-b8f460cc5f29 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.436500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f24c6977-f576-43bb-9bc1-f7c4770d23fc req-16474c08-960b-4528-8291-b8f460cc5f29 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.453853 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f24c6977-f576-43bb-9bc1-f7c4770d23fc req-16474c08-960b-4528-8291-b8f460cc5f29 service nova] Creating event network-vif-unplugged:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:16:30.459194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f24c6977-f576-43bb-9bc1-f7c4770d23fc req-16474c08-960b-4528-8291-b8f460cc5f29 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040881 Mar 29 02:16:30.462069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 822/1619] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:30.465150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:30.466144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:30.474157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.475077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.476468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.477287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.604456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:30.614012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a312f1d-5a3f-4418-83f1-4f2072f22f79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.463999 Mar 29 02:16:30.614550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 798/1620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:30 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:30.620271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:30.621039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:30.628709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.629396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:30.630425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:30.631763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.186459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:31.206545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e407378-178a-4c7f-b656-59cac3c39f93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 0.745291 Mar 29 02:16:31.213282 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 823/1621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:30 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:31.218172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:31.218960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:31.227127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.227820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.228806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.229477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.315596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:31.328597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:31.330498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:31.331838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e93b1bc-f1b2-4fc2-aabc-21e72ccd9e10 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1858 microversion: 2.32 time: 0.715992 Mar 29 02:16:31.333046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 799/1622] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:30 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1858 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:31.338351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-988567ab-ad36-4a78-a1cf-a92a6c155fe5 req-87ffe95d-fb9b-4a92-b24e-bf32564c1d4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "cb4c85a2-0f06-43b8-8ca8-0980ac95e70f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:31.346621 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:31.346621 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:31.356333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-988567ab-ad36-4a78-a1cf-a92a6c155fe5 req-87ffe95d-fb9b-4a92-b24e-bf32564c1d4d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.357044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-988567ab-ad36-4a78-a1cf-a92a6c155fe5 req-87ffe95d-fb9b-4a92-b24e-bf32564c1d4d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.376752 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-988567ab-ad36-4a78-a1cf-a92a6c155fe5 req-87ffe95d-fb9b-4a92-b24e-bf32564c1d4d service nova] Creating event network-changed:cb4c85a2-0f06-43b8-8ca8-0980ac95e70f for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:31.381890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-988567ab-ad36-4a78-a1cf-a92a6c155fe5 req-87ffe95d-fb9b-4a92-b24e-bf32564c1d4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047462 Mar 29 02:16:31.383017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 800/1623] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:31.388578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:31.389498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:31.405401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.405401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.405401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.405401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.853503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:31.864197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-180625a9-0e8c-4010-94ba-026c3e3954cb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.649656 Mar 29 02:16:31.874053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 824/1624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:31 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:31.878981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:31.879781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:31.894402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.895035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:31.895974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:31.896614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:32.085638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:32.094765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adec291c-08cd-4b00-a58e-8257adbb3a5b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 0.710284 Mar 29 02:16:32.095962 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 801/1625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:31 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:32.101937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1062484807", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:32.249568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] validate_networks() for [('791b6e2f-84cc-4e53-b233-99285785bda3', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:16:32.526067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:32.538223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fdd1c92c-5f2c-4353-9070-4adfb6f95938 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.662644 Mar 29 02:16:32.539529 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 825/1626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:31 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:32.544149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:32.545090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:32.552916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:32.553565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:32.555161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:32.555748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:32.976088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:32.985487 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c36c8a5-2d61-42ae-9a64-8d8f9a3f5578 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1314 microversion: 2.1 time: 0.444729 Mar 29 02:16:32.986379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 826/1627] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:32 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:32.990939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:32.991661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:33.002040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.003147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.004718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.005773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.401957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:33.411411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:33.413143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:33.414518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e61e5e14-863c-4818-b8d9-049e9cc29624 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.427004 Mar 29 02:16:33.426035 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 827/1628] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:32 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:33.432441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cc65a551-7dd2-4da9-abea-ce83634051da req-a0884c5e-1c23-424f-a135-1d60b80a9c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9ec9a7-1c01-4876-aee0-22d5ba868502", "name": "network-vif-plugged", "status": "completed", "tag": "58124146-6c37-4dae-911f-9195c10ad2c3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:33.434927 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:33.434927 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:33.444116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cc65a551-7dd2-4da9-abea-ce83634051da req-a0884c5e-1c23-424f-a135-1d60b80a9c88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.445854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cc65a551-7dd2-4da9-abea-ce83634051da req-a0884c5e-1c23-424f-a135-1d60b80a9c88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.464878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cc65a551-7dd2-4da9-abea-ce83634051da req-a0884c5e-1c23-424f-a135-1d60b80a9c88 service nova] Creating event network-vif-plugged:58124146-6c37-4dae-911f-9195c10ad2c3 for instance ed9ec9a7-1c01-4876-aee0-22d5ba868502 on n-h1-828148-1 Mar 29 02:16:33.472007 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cc65a551-7dd2-4da9-abea-ce83634051da req-a0884c5e-1c23-424f-a135-1d60b80a9c88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044021 Mar 29 02:16:33.473255 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 828/1629] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:33.485846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:33.485846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:33.494292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.495092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.496100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.496750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.514069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:33.514608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:33.518057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:33.518057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:33.518057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:33.528111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.528676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.533970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.536029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.564803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:33.575325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for user 7ff0139c538f4391bd0b5eb0c42f11a0 and project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:33.631787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:33.642338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:33.816924 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d6d99107-52f8-40e1-9be6-a1af88effd11 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.717632 Mar 29 02:16:33.823638 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 802/1630] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:16:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:16:33.824311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:33.828768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:33.836176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.836632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.837587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:33.838195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:33.994965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:34.006796 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c8e2f1f-6a62-413b-b2a5-1f698b2faa7d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1313 microversion: 2.1 time: 0.531971 Mar 29 02:16:34.015368 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 829/1631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:33 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:34.021482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:34.022090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:34.030382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.030941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.031935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.032542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.343512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:34.353520 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3bef6b9-7614-4af2-b6ee-facfcd307124 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.337001 Mar 29 02:16:34.365295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 830/1632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:34 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:34.371598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4f2e51d0-2e9e-4733-bdaa-b3a2798f8754 req-166bc140-a1c6-48a7-b0e0-4f4384502f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "105600a4-c888-4283-8455-59177e972415"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:34.373354 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:34.373354 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:34.383917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4f2e51d0-2e9e-4733-bdaa-b3a2798f8754 req-166bc140-a1c6-48a7-b0e0-4f4384502f19 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.384410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4f2e51d0-2e9e-4733-bdaa-b3a2798f8754 req-166bc140-a1c6-48a7-b0e0-4f4384502f19 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.401887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4f2e51d0-2e9e-4733-bdaa-b3a2798f8754 req-166bc140-a1c6-48a7-b0e0-4f4384502f19 service nova] Creating event network-changed:105600a4-c888-4283-8455-59177e972415 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:34.407340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4f2e51d0-2e9e-4733-bdaa-b3a2798f8754 req-166bc140-a1c6-48a7-b0e0-4f4384502f19 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040355 Mar 29 02:16:34.408233 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 831/1633] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:34.414071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:34.415548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:34.425513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.426396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.427450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.428302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.587535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:34.598591 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06af7874-aed5-4cd4-a6e3-f85bdbfa6475 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 0.778592 Mar 29 02:16:34.602932 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 803/1634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:33 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:34.614847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-822afd17-7e27-4fc2-a5b1-5f3808e102df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:34.617268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-822afd17-7e27-4fc2-a5b1-5f3808e102df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:34.822862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-822afd17-7e27-4fc2-a5b1-5f3808e102df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:34.832969 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-822afd17-7e27-4fc2-a5b1-5f3808e102df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1225 microversion: 2.1 time: 0.227040 Mar 29 02:16:34.834634 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 804/1635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:34 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:34.853895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:34.860697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:34.871188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.871900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.873059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:34.873648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:34.976577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:34.989584 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0231849a-49f3-4cd0-8fc7-f726d5e91308 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.580109 Mar 29 02:16:34.990548 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 832/1636] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:34 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:34.995762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:34.997223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:35.006455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.007872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.010052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.011206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.528599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:35.539792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb317bde-ffd4-4b97-96bc-cce784b87c5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.547960 Mar 29 02:16:35.551460 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 833/1637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:34 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:35.557937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:35.558803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:35.570995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.571640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.572716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.573372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.890280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:35.900071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:35.901610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:35.902713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dfbe84c9-0fa1-4cb5-a9cf-0501807aa014 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.350155 Mar 29 02:16:35.903433 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 834/1638] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:35 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:35.908044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:35.908641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:35.916154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.916905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.917407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:35.917839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:35.954677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:35.976514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fc7dae1-b5a3-4479-90a6-0e17db2e319d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1464 microversion: 2.1 time: 1.138479 Mar 29 02:16:35.987676 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 805/1639] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:34 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1464 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:35.996194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:35.997173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:36.004741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.005237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.006351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.006551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.365363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:36.373591 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5c0a4d4-1962-451e-8087-7164b9b0766a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1499 microversion: 2.1 time: 0.468887 Mar 29 02:16:36.374294 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 835/1640] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:35 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1499 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:36.378987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:36.379733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:36.391052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.391615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.392562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.393128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.397288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:36.407174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78090983-2933-478a-989b-1898612cd04d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.417886 Mar 29 02:16:36.408038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 806/1641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:35 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:36.413016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:36.414376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:36.423115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.423806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.425168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.426490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.646673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:36.668616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f63ecf5-6c06-4082-9590-b0150c922ba2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1285 microversion: 2.1 time: 0.258397 Mar 29 02:16:36.695933 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 807/1642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:36 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1285 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:36.875040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:36.889375 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:36.889375 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:36.889375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'deleted': False, 'project_id': 'e3f8e7850bc44a4185d8841cab9443be'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:36.889375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.889375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:36.889857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:36.890262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.014670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d8971e1-48e1-4b4b-b6e7-3cdc3a85f5e1 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.317291 Mar 29 02:16:37.016459 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 808/1643] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:16:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:37.021785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:37.023368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:37.031994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.032885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.034115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.034722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.157914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:37.166897 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f7549a9-ee92-4e64-8857-b82436dab495 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1503 microversion: 2.1 time: 0.791351 Mar 29 02:16:37.174402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 836/1644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:36 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1503 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:37.174402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:37.174402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:37.181475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.182244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.182907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.183441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.244557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lazy-loading 'flavor' on Instance uuid ed9ec9a7-1c01-4876-aee0-22d5ba868502 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:16:37.506553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:37.517806 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-694465b9-b969-4a22-8229-14521f381ab5 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1476 microversion: 2.1 time: 0.499953 Mar 29 02:16:37.518815 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 809/1645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:37 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1476 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:37.532225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:37.533364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:37.542564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.543553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.545768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.546801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.629114 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e33aa30c-cc95-4cfa-beed-02818c382ed4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "POST /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502/action" status: 200 len: 32 microversion: 2.1 time: 0.460045 Mar 29 02:16:37.631736 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 837/1646] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:37 2022] POST /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:37.653002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f6b3ce76-2c20-4d4a-8288-4196b97006b5 req-636976af-263a-40ca-a405-a8cebb769082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "17bfdecc-f15d-409d-afb7-2f1f77be3567"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:37.655823 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:37.655823 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:37.672509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6b3ce76-2c20-4d4a-8288-4196b97006b5 req-636976af-263a-40ca-a405-a8cebb769082 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.678260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6b3ce76-2c20-4d4a-8288-4196b97006b5 req-636976af-263a-40ca-a405-a8cebb769082 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.706746 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f6b3ce76-2c20-4d4a-8288-4196b97006b5 req-636976af-263a-40ca-a405-a8cebb769082 service nova] Creating event network-changed:17bfdecc-f15d-409d-afb7-2f1f77be3567 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:37.714539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f6b3ce76-2c20-4d4a-8288-4196b97006b5 req-636976af-263a-40ca-a405-a8cebb769082 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080037 Mar 29 02:16:37.719538 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 838/1647] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:37.732072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:37.735715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:37.742260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.742997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.744243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.744861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.879744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72710fbf-f179-431c-a06b-de4731931577 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.351000 Mar 29 02:16:37.896144 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 810/1648] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:37 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:37.903205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:37.906977 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:37.906977 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:37.908899 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:37.908899 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:37.910535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'deleted': False} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:37.916778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.917446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:37.918808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:37.919572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:38.047670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:16:38.208022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:38.208974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:38.473233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:38.484184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:38.485986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:38.487302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4aec255c-d0a0-407d-b5f5-7728cebf7eb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.766472 Mar 29 02:16:38.502185 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 839/1649] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:37 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:38.506947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:38.507938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:38.519560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:38.520009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:38.520829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:38.521332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:39.205924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:39.215374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9f6f4be-b857-4620-a80c-6ff45170f02c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.713939 Mar 29 02:16:39.216329 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 840/1650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:38 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:39.224352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:39.225411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:39.234039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:39.234779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:39.235673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:39.236216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.226389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:40.236223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a785f49-6a66-42df-a158-d6d809afb42c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 1.018428 Mar 29 02:16:40.246992 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 841/1651] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:39 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:40.252112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:40.256323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:40.261357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.262103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.263151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.263809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.599863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee6ae4fa-1402-4997-aaca-b8403a46c011 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19720 microversion: 2.1 time: 2.701833 Mar 29 02:16:40.601431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 811/1652] 10.222.0.36 () {58 vars in 1170 bytes} [Tue Mar 29 02:16:37 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19720 bytes in 2704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:16:40.609674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:40.610582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:40.619335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.619906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.621062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.621592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.808292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:40.830139 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc4f220a-d853-4d9f-8b64-76c128d4e469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1672 microversion: 2.1 time: 0.580379 Mar 29 02:16:40.831332 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 842/1653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:40 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1672 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:40.836802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:40.839110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:40.847173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.849236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:40.852637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:40.853310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:41.468508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:41.487178 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9cb0cb23-6cad-41af-8b6f-55a0172b59f5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1493 microversion: 2.1 time: 0.884459 Mar 29 02:16:41.487969 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 812/1654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:40 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1493 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:41.493306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:41.494160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:41.496134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:41.505181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:41.505863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:41.507376 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6eb3868-43ae-4dd8-9411-1364f13d3862 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1475 microversion: 2.1 time: 0.674215 Mar 29 02:16:41.507538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:41.507909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:41.508649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 843/1655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:40 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:41.513538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-aa29b441-619c-4108-b134-e1a988061e71 req-0471d875-fc8a-4106-9352-de4f430f4864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "a390c429-528d-446a-8b2f-5aff166b3a60"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:41.515574 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:41.515574 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:41.528688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa29b441-619c-4108-b134-e1a988061e71 req-0471d875-fc8a-4106-9352-de4f430f4864 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:41.529152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa29b441-619c-4108-b134-e1a988061e71 req-0471d875-fc8a-4106-9352-de4f430f4864 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:41.545796 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-aa29b441-619c-4108-b134-e1a988061e71 req-0471d875-fc8a-4106-9352-de4f430f4864 service nova] Creating event network-changed:a390c429-528d-446a-8b2f-5aff166b3a60 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:41.551002 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-aa29b441-619c-4108-b134-e1a988061e71 req-0471d875-fc8a-4106-9352-de4f430f4864 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040963 Mar 29 02:16:41.552302 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 844/1656] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:41.560058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:41.566525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:41.577880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:41.578295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:41.579078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:41.579510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.429149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:42.441516 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4ce8b05-0af6-4f9d-8fc0-768a0dfd0a39 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.887709 Mar 29 02:16:42.455842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 845/1657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:41 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:42.462254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "name": "network-vif-unplugged", "status": "completed", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:42.467121 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:42.467121 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:42.475353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.476282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.499697 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] Creating event network-vif-unplugged:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h2-828148-1 Mar 29 02:16:42.515214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:16:42.537195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:42.539910 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5b420429-53ec-4964-9cdd-627b934e793e req-04eb1830-2033-49e4-89a8-d174f05bf6f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082176 Mar 29 02:16:42.550949 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 846/1658] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:42.555757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:42.559508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:42.559691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:42.561286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-264ee684-0f73-4fae-983a-8b857d2499d6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 1.071901 Mar 29 02:16:42.562820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 813/1659] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:41 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:42.575429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:42.583005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:42.584916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.587275 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:42.587275 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:42.590316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'deleted': False, 'project_id': 'e3f8e7850bc44a4185d8841cab9443be'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:42.600767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.611099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.614191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.625687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.626991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.628757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.630090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.877748 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf70df9c-6884-4d28-94d2-f0adb5a805e2 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?tenant_id=4c0c4a74ba1d46dc99e030cdf41349b5" status: 200 len: 15 microversion: 2.1 time: 0.325410 Mar 29 02:16:42.878555 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 847/1660] 10.222.0.36 () {58 vars in 1230 bytes} [Tue Mar 29 02:16:42 2022] GET /compute/v2.1/servers/detail?tenant_id=4c0c4a74ba1d46dc99e030cdf41349b5 => generated 15 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:42.894612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9cee75d0-3fa2-4701-9e7c-29189961274f tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '.version_select at 0x7f8724172040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:42.896020 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:42.896020 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:42.902515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cee75d0-3fa2-4701-9e7c-29189961274f tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.908176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9cee75d0-3fa2-4701-9e7c-29189961274f tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.924358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9cee75d0-3fa2-4701-9e7c-29189961274f tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1976 microversion: 2.1 time: 0.033336 Mar 29 02:16:42.924999 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 848/1661] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:16:42 2022] GET /compute/v2.1/os-migrations => generated 1976 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:42.930181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:42.931125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:42.940063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.940784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:42.941753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:42.942344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.215115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:43.231447 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96ad0c7b-00e0-4525-9366-669e20257dd8 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.666785 Mar 29 02:16:43.232281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 814/1662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:42 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:43.245005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:43.245611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:43.253188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.253652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.254429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.254909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.553678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:43.562826 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0e7d659-6040-482f-b901-623474ac3b9b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1677 microversion: 2.1 time: 0.636572 Mar 29 02:16:43.567927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 849/1663] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:42 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1677 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:43.573195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:43.583841 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:43.583841 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:43.590757 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:43.590757 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:43.594322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'tenant_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'deleted': False} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:43.603041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.603477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.607196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.607882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.742232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:16:43.778511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:43.790425 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d66eab6a-b6fb-4c78-afa5-e3b02b17f5b7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1475 microversion: 2.1 time: 0.548963 Mar 29 02:16:43.791574 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 815/1664] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:43 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1475 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:43.796293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:43.797121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:43.811097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.811097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.811097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.811097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:43.867150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:43.867770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.016527 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d86decb-bc9c-450e-b4a0-769c79d04554 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4c0c4a74ba1d46dc99e030cdf41349b5" status: 200 len: 4827 microversion: 2.1 time: 0.447407 Mar 29 02:16:44.023232 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 850/1665] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:16:43 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=4c0c4a74ba1d46dc99e030cdf41349b5 => generated 4827 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:44.143716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5760adeb-e5fc-45ab-aaf7-1f88caf6c329 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.159351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5760adeb-e5fc-45ab-aaf7-1f88caf6c329 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.139955 Mar 29 02:16:44.159927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 851/1666] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:44.166097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.166097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:44.172469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.172946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.173705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.174142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.380805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:44.389515 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43822c67-abbc-48e0-a9d0-7467c5504ede tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.228476 Mar 29 02:16:44.390097 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 852/1667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:44.394458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.395062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:44.402143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.402588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.403344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.403797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.419053 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d4cd8c80-9fa3-4118-a2f5-97fa5936d641 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1644 microversion: 2.1 time: 0.626139 Mar 29 02:16:44.419655 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 816/1668] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:43 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1644 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:44.424347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0686630d-2d6d-4054-8d85-39c1a1278c6b req-114f7d35-76da-4d6b-987c-849001d7f858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "69740a4c-20a8-4f28-90fa-dcfaf5563c5b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:44.425845 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:44.425845 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:44.434714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0686630d-2d6d-4054-8d85-39c1a1278c6b req-114f7d35-76da-4d6b-987c-849001d7f858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.437635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0686630d-2d6d-4054-8d85-39c1a1278c6b req-114f7d35-76da-4d6b-987c-849001d7f858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.453431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0686630d-2d6d-4054-8d85-39c1a1278c6b req-114f7d35-76da-4d6b-987c-849001d7f858 service nova] Creating event network-changed:69740a4c-20a8-4f28-90fa-dcfaf5563c5b for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:44.458991 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0686630d-2d6d-4054-8d85-39c1a1278c6b req-114f7d35-76da-4d6b-987c-849001d7f858 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Mar 29 02:16:44.459934 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 817/1669] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:44.473077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.473077 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:44.473077 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:44.473077 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:detail:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:44.473077 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:44.474075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'tenant_id': 'e3f8e7850bc44a4185d8841cab9443be', 'deleted': False} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:44.479952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.480403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.481509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.482207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.602877 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-222b470e-be20-48fd-835e-540f7f529d85 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e3f8e7850bc44a4185d8841cab9443be" status: 200 len: 15 microversion: 2.1 time: 0.139850 Mar 29 02:16:44.604064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 818/1670] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e3f8e7850bc44a4185d8841cab9443be => generated 15 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:44.610553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d3bfd835-6498-4482-8e54-9346a07235f1 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.645581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d3bfd835-6498-4482-8e54-9346a07235f1 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.040220 Mar 29 02:16:44.646850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 819/1671] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:44.654350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.655448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:44.664436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.664993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.666207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.666883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.756377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:44.772948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:44.776136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:44.778553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cd742a5-217c-448b-ab62-96eee295252e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.387316 Mar 29 02:16:44.779541 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 853/1672] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:44.785001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:44.785873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:44.801368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.801919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:44.803059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:44.803591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.002290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:45.010952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1067c0a0-6c52-47e5-9806-da3ad8f18a71 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.229951 Mar 29 02:16:45.011518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 854/1673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:45.015876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9692b8ce-261b-4f97-a3e9-fefe736f9463 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:45.018933 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:45.018933 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:45.020329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9692b8ce-261b-4f97-a3e9-fefe736f9463 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.007801 Mar 29 02:16:45.020829 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 855/1674] 10.222.0.36 () {58 vars in 1188 bytes} [Tue Mar 29 02:16:45 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:45.025800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-53903979", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:45.093535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] validate_networks() for [('da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:16:45.198350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:45.207502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-334417cf-edc5-483c-ae34-26f15b6f4eca tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.558940 Mar 29 02:16:45.208080 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 820/1675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:44 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:45.213137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d7ed1a3-abd6-492d-96d6-22da57e088b4 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:45.227647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d7ed1a3-abd6-492d-96d6-22da57e088b4 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018341 Mar 29 02:16:45.228215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 821/1676] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:45.232760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}, {"name": "network-changed", "server_uuid": "b91e2442-2015-450c-bee0-3a35f2a97010", "tag": "9051414c-43c0-43ac-8448-962e8646cca3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:45.234338 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:45.234338 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:45.243511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.243945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.262935 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Creating event network-changed:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h2-828148-1 Mar 29 02:16:45.263439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Creating event network-changed:9051414c-43c0-43ac-8448-962e8646cca3 for instance b91e2442-2015-450c-bee0-3a35f2a97010 on n-h2-828148-1 Mar 29 02:16:45.270331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:16:45.283231 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2775c2b6-aed7-4463-845c-936d8dec15fd req-5b2028d6-ecd3-480c-bfd8-5dae77fb5c42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053608 Mar 29 02:16:45.288945 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 822/1677] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:45.289321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:45.289751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:45.297497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.297949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.298726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.299412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.818510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:45.828155 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64e6ccb6-109e-4596-ba3f-be6029dc0328 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1473 microversion: 2.1 time: 0.543120 Mar 29 02:16:45.828738 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 823/1678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:45 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1473 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:45.835524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:45.837434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:45.845698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.846323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.847226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.847770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.938019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6f8e0797-2a60-4963-b623-2263ea148807 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 200 len: 145 microversion: 2.1 time: 0.107559 Mar 29 02:16:45.938669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 824/1679] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:45 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 145 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:45.945005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:45.946064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:45.954746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.955205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:45.956004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:45.956443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.067090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:46.067616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:46.068618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:46.069221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:46.069736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:46.078536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.079071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.080015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.080675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.109524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:46.114090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for user 808db28af62c4400b9f28220649f0985 and project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:46.129333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:46.133748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:46.242500 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61595851-82d3-4b23-9199-b5010aea6904 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220335 Mar 29 02:16:46.243536 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 856/1680] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:16:46.257732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-004c57c2-df01-4a83-b175-98902f5c8261 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:46.274192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-004c57c2-df01-4a83-b175-98902f5c8261 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029355 Mar 29 02:16:46.275777 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 857/1681] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:46.282174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:46.283552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:46.294836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.297706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.298583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.299027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.391034 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3bf72c92-44a6-4d01-89ff-befe6401b0ff tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 0 microversion: 2.1 time: 0.450736 Mar 29 02:16:46.392474 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 825/1682] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:45 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:46.399641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:46.400360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:46.411599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.412573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.414350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.414781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.715446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:46.730059 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0727ef14-5778-49fd-9583-2ec120e77144 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.453038 Mar 29 02:16:46.730646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 858/1683] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:46 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:46.735030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:46.735767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:46.743274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.743705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:46.744541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:46.745001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.148343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.160511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.161549 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dea5ad7-9535-4b3f-bc5c-ab06b4f2b27d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.429877 Mar 29 02:16:47.173703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.181178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.181762 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 859/1684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:46 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:47.186953 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5cf1e8e9-e2ad-4881-a1b2-6179239780f9 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.793229 Mar 29 02:16:47.187534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 826/1685] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:46 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:47.189260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.191513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:47.193107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da0c9373-50b5-4a39-9660-832625d339a8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.193712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-da0c9373-50b5-4a39-9660-832625d339a8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:47.198898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.199644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.200551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.201291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.339184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-da0c9373-50b5-4a39-9660-832625d339a8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.346951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da0c9373-50b5-4a39-9660-832625d339a8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1209 microversion: 2.1 time: 0.157186 Mar 29 02:16:47.357697 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 827/1686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1209 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:47.362493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-328902ff-d6de-4b32-8b5d-c9c7e3bd9cef tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.387005 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-328902ff-d6de-4b32-8b5d-c9c7e3bd9cef tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.027923 Mar 29 02:16:47.392242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 828/1687] 10.222.0.36 () {58 vars in 1164 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:47.393313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.396718 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:47.396718 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:47.397803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.398790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:47.404424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.405127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.406099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.406706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.503656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:16:47.604484 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-26e795d4-681d-4514-9a54-2dc5ba8be109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.215108 Mar 29 02:16:47.605012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 829/1688] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:47.609620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-57a18cf3-e0ea-4030-a78c-b3c38207a684 req-f0927128-fad9-47e4-95dd-9c0f4cca500c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "7aeea8a6-cd6f-4214-8003-4d69af2e4528"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:47.613609 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:47.613609 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:47.667796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57a18cf3-e0ea-4030-a78c-b3c38207a684 req-f0927128-fad9-47e4-95dd-9c0f4cca500c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.671910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57a18cf3-e0ea-4030-a78c-b3c38207a684 req-f0927128-fad9-47e4-95dd-9c0f4cca500c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.714862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:47.727875 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-369989a1-bc3d-4215-911f-a432e75dd1ed tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.543885 Mar 29 02:16:47.728459 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 860/1689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:47.737618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-57a18cf3-e0ea-4030-a78c-b3c38207a684 req-f0927128-fad9-47e4-95dd-9c0f4cca500c service nova] Creating event network-changed:7aeea8a6-cd6f-4214-8003-4d69af2e4528 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:16:47.742391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.743007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:47.751388 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-57a18cf3-e0ea-4030-a78c-b3c38207a684 req-f0927128-fad9-47e4-95dd-9c0f4cca500c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145108 Mar 29 02:16:47.755589 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 830/1690] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:47.761039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.761274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:47.761565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.761964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:47.762248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.762675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.770310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.770757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:47.771531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:47.771963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.032998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:48.042656 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4416418-1a84-4dad-a1b1-1e75cbf80370 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1470 microversion: 2.1 time: 0.303864 Mar 29 02:16:48.049562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 861/1691] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1470 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:48.057254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82e49813-06ec-4cf9-a1cd-b9638a3bd4b8 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:48.073793 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82e49813-06ec-4cf9-a1cd-b9638a3bd4b8 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022785 Mar 29 02:16:48.075651 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 862/1692] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:48.086603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:48.088085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:48.097214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.098070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.098429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.098854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.286748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:48.295518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0b8294f-b06d-41b1-b6ab-b2f4d900a383 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.538841 Mar 29 02:16:48.296084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 831/1693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:47 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:48.300233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:48.300975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:48.309071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.311558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.311558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.311558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.442679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-edc2457c-ee09-4290-9277-2642827b88cd tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 0 microversion: 2.1 time: 0.366848 Mar 29 02:16:48.443356 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 863/1694] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:48 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:48.449192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:48.449809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:48.457560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.457994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.458755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.460696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.734683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:48.745869 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed726a50-481f-4da0-b782-d11bf67e4e0d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.448732 Mar 29 02:16:48.746458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 832/1695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:48 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:48.750879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e354977d-3138-4c8e-96c0-e86d3ed101f2 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:48.777246 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e354977d-3138-4c8e-96c0-e86d3ed101f2 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029601 Mar 29 02:16:48.777838 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 833/1696] 10.222.0.36 () {58 vars in 1168 bytes} [Tue Mar 29 02:16:48 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:48.782190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:48.782800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:48.807593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.808047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.809121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.809556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.880726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e0eb0e93-12e8-4eeb-b1fe-51619bfae6c3 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "POST /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335/action" status: 202 len: 0 microversion: 2.1 time: 0.435836 Mar 29 02:16:48.885136 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 864/1697] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:48 2022] POST /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:48.908256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:48.910795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:48.928340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.928975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:48.929760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:48.934122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.344201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:49.355748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:49.357359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:49.358870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0629f66-c661-47e6-8996-065c1ebd6f25 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.580111 Mar 29 02:16:49.359727 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 834/1698] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:48 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:49.364383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:49.365288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:49.373127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.373673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.374767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.375262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.429511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:49.440091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-773b9921-75da-4d43-bc9b-3ad9eccdd1b2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.553682 Mar 29 02:16:49.440672 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 865/1699] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:48 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:49.454303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:49.455692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:49.463600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.464048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.464866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.465289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.544951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:49.553287 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-739ef122-04cd-4b2a-b065-a6e17fdf7982 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1267 microversion: 2.1 time: 0.192253 Mar 29 02:16:49.554609 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 835/1700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:49 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:49.558982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:49.559775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:49.568768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.569281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.570179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.570669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.936272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42ca6ac7-844c-4847-8db0-6f7cc56facf3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1615 microversion: 2.1 time: 0.494010 Mar 29 02:16:49.936986 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 866/1701] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:49 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1615 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:49.941624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e36f1da-5192-498b-937a-afb72a7c38e0 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:49.960593 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e36f1da-5192-498b-937a-afb72a7c38e0 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.022477 Mar 29 02:16:49.962546 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 867/1702] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:16:49 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:49.970594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:49.970594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:49.973981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.974504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:49.976003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:49.976573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.202426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:50.212802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7d7a443-8cdc-4cb1-b103-59f3ee195e71 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.657423 Mar 29 02:16:50.217092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 836/1703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:49 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:50.224156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:50.224985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:50.248644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.249495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.250303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.250740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.576118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:50.591099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23ffcc66-74db-47b0-ac40-40020a234f1a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.628708 Mar 29 02:16:50.592367 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 868/1704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:49 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:50.606365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:50.607288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:50.617217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.617832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.618715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.619157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.789273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:50.797908 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-893ee621-d7d8-4b55-9ce4-d820dca12a39 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.583052 Mar 29 02:16:50.808971 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 837/1705] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:50 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:50.808971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:50.808971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:50.813968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.814428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:50.815381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:50.816185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:51.149468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:51.158522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2e28857-db22-44e2-ba88-2da5b3ecfcc0 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.556150 Mar 29 02:16:51.159099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 869/1706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:50 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:51.163742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0cf340b-c4e8-4d50-b97c-dae630065838 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:51.418969 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0cf340b-c4e8-4d50-b97c-dae630065838 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.258501 Mar 29 02:16:51.419859 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 870/1707] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:51 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:51.425558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:51.426259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:51.437081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:51.437525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:51.438299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:51.438726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:51.634590 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adc8924c-35c8-4c00-91fb-4713cac8907e tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1615 microversion: 2.1 time: 0.834813 Mar 29 02:16:51.639148 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 838/1708] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:50 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1615 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:51.652346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:51.653297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:51.674196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:51.675076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:51.676106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:51.679346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:51.901224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:51.910966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:51.912311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:51.914454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f541aee-e630-4c6a-bcf4-bec93e610b3e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.492112 Mar 29 02:16:51.914454 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 871/1709] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:51 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:51.918310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1107873418", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9222f6f3-d189-4e16-8c8f-3078bec78258"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:51.992965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] validate_networks() for [('9222f6f3-d189-4e16-8c8f-3078bec78258', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:16:52.206626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:52.217087 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a42be21-6249-43d2-8edb-12e45587c003 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.576560 Mar 29 02:16:52.226668 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 839/1710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:51 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:52.226668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:52.226668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:52.234954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:52.234954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:52.236076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:52.236209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:52.609749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:52.620552 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f4f3c59c-f12b-4b7e-a400-e08bf639b552 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.399685 Mar 29 02:16:52.629519 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 840/1711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:52 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:52.634276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e53c9fbe-b831-4d68-8cdc-38725e3244be tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:52.668788 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e53c9fbe-b831-4d68-8cdc-38725e3244be tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.037991 Mar 29 02:16:52.670406 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 841/1712] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:16:52 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:52.675291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "name": "network-vif-plugged", "status": "completed", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:52.677269 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:52.677269 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:52.687124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:52.687831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:52.729651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] Creating event network-vif-plugged:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h2-828148-1 Mar 29 02:16:52.736355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:16:52.747537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-88636ad2-89f0-46cf-95f7-fa1bea31d351 req-2f711349-21e3-447c-97e8-16c287bb3d9b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075807 Mar 29 02:16:52.748400 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 842/1713] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:52.754282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:52.754282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:52.761491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:52.761938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:52.762707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:52.763136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.137850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:53.138317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:53.138849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:53.139319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:53.139812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:53.151959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.152761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.153796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.154409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.160718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:53.170921 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0d6177a-37e1-4a7c-a295-80902202b934 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.421278 Mar 29 02:16:53.175210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:16:53.177270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 843/1714] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:52 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:53.182189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:16:53.187862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:53.193139 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:53.193139 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:53.194977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:16:53.195825 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:53.195825 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:53.197333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:16:53.197490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'host': 'n-h2-828148-1', 'deleted': False} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:53.203562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.209888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.209888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.209888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.317628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:16:53.371299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7dbfa7e2-6c04-49c7-ac70-0c9e9639ff0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456049 Mar 29 02:16:53.372521 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 872/1715] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:16:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:16:53.378161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:53.379201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:53.406891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.407655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.410846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.414309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.447382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77e01324-52f4-4a30-9278-2011caac8bb3 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=n-h2-828148-1&all_tenants=1" status: 200 len: 2945 microversion: 2.1 time: 0.267999 Mar 29 02:16:53.448664 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 844/1716] 10.222.0.36 () {58 vars in 1189 bytes} [Tue Mar 29 02:16:53 2022] GET /compute/v2.1/servers?host=n-h2-828148-1&all_tenants=1 => generated 2945 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:53.457437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d22e413a-f89b-4af3-9a90-12fd1555fc1f tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:53.474292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d22e413a-f89b-4af3-9a90-12fd1555fc1f tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024237 Mar 29 02:16:53.476436 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 845/1717] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:53.482477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:53.483691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:53.493209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.493850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.494681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.495109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.839507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:53.849550 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9212986d-7a30-4d17-b08d-8ebfe0b66c85 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.475646 Mar 29 02:16:53.850826 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 873/1718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:53 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:53.856626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-588152c4-a0a2-4e38-a43b-94cf8eb6813c req-79cb62d2-79fe-460d-9318-dbb3a73b4ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f26e84-cb3a-47ab-a37b-faf0c3a2c896", "tag": "020be6cb-31c2-43ca-bf79-09fffb0c481d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:53.859081 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:53.859081 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:53.886162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-588152c4-a0a2-4e38-a43b-94cf8eb6813c req-79cb62d2-79fe-460d-9318-dbb3a73b4ac8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.887202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-588152c4-a0a2-4e38-a43b-94cf8eb6813c req-79cb62d2-79fe-460d-9318-dbb3a73b4ac8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.917478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-588152c4-a0a2-4e38-a43b-94cf8eb6813c req-79cb62d2-79fe-460d-9318-dbb3a73b4ac8 service nova] Creating event network-changed:020be6cb-31c2-43ca-bf79-09fffb0c481d for instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 on n-h2-828148-1 Mar 29 02:16:53.922219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-588152c4-a0a2-4e38-a43b-94cf8eb6813c req-79cb62d2-79fe-460d-9318-dbb3a73b4ac8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069529 Mar 29 02:16:53.922818 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 874/1719] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:53.939128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:53.939128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:53.939128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.939128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.939549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:53.939549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:53.984289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:53.989930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:53.992863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:53.994422 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a047ed4-f21c-4f60-9350-8a080de49a07 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.516802 Mar 29 02:16:54.007820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 846/1720] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:53 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:54.013043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ccc4d26-ace6-4152-8058-f6a395ae94c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:54.013654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4ccc4d26-ace6-4152-8058-f6a395ae94c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:54.138824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4ccc4d26-ace6-4152-8058-f6a395ae94c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:54.147257 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4ccc4d26-ace6-4152-8058-f6a395ae94c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1215 microversion: 2.1 time: 0.137600 Mar 29 02:16:54.157580 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 847/1721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:54 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:54.162780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:54.166279 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:54.166279 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:54.168264 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:index:get_all_tenants failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:54.168264 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:16:54.169671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:16:54.183941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.185906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.185906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.185906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.279782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd3adc6b-ad10-4766-8145-ed32fea319c8 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.120906 Mar 29 02:16:54.280288 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 848/1722] 10.222.0.36 () {58 vars in 1195 bytes} [Tue Mar 29 02:16:54 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:16:54.286157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ebb0c4c3-b50d-4492-ba26-4dcfb16a0b62 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:54.308994 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ebb0c4c3-b50d-4492-ba26-4dcfb16a0b62 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.027138 Mar 29 02:16:54.310221 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 849/1723] 10.222.0.36 () {58 vars in 1143 bytes} [Tue Mar 29 02:16:54 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:54.314865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:54.323363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:54.323363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.324201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.325010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.325442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.495777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:54.505736 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2611105f-7c81-4124-aeec-0836d07e6361 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.581588 Mar 29 02:16:54.506344 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 875/1724] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:53 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:54.511554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:54.512168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:54.519398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.520069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.523510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.523510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.731667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:54.747644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16b100ca-374c-44ff-a072-8a46ba56d8df tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.435933 Mar 29 02:16:54.757714 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 850/1725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:54 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:54.757714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:54.757714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:54.768653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.769137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:54.769929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:54.770798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.005564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.016162 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d90189f-43cd-4557-9636-0aba26ede89a tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.508685 Mar 29 02:16:55.017194 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 876/1726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:54 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:55.022607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70bdc6ba-9799-49f8-9700-7d8af52dd155 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.037858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70bdc6ba-9799-49f8-9700-7d8af52dd155 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019419 Mar 29 02:16:55.038576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 877/1727] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:55.043375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-41b14afc-29ef-4511-aba9-d80df26d3dd2 req-c4abd201-b427-4e7f-b7ca-607c1426bd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91e2442-2015-450c-bee0-3a35f2a97010", "name": "network-vif-plugged", "status": "completed", "tag": "9051414c-43c0-43ac-8448-962e8646cca3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:55.045273 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:55.045273 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:55.054306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-41b14afc-29ef-4511-aba9-d80df26d3dd2 req-c4abd201-b427-4e7f-b7ca-607c1426bd55 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.054768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-41b14afc-29ef-4511-aba9-d80df26d3dd2 req-c4abd201-b427-4e7f-b7ca-607c1426bd55 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.072200 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-41b14afc-29ef-4511-aba9-d80df26d3dd2 req-c4abd201-b427-4e7f-b7ca-607c1426bd55 service nova] Creating event network-vif-plugged:9051414c-43c0-43ac-8448-962e8646cca3 for instance b91e2442-2015-450c-bee0-3a35f2a97010 on n-h2-828148-1 Mar 29 02:16:55.085621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-41b14afc-29ef-4511-aba9-d80df26d3dd2 req-c4abd201-b427-4e7f-b7ca-607c1426bd55 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 Mar 29 02:16:55.086966 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 878/1728] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:55.092971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "name": "network-vif-unplugged", "status": "completed", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:55.095009 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:55.095009 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:55.104638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.105599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.126286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] Creating event network-vif-unplugged:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h1-828148-1 Mar 29 02:16:55.135691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:16:55.147819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c3d83a47-8704-4c4e-a978-04dc566f7355 req-54671355-c162-42d6-8626-5796954f08c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058384 Mar 29 02:16:55.149200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 879/1729] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:55.150723 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21436de3-3e57-4bca-aedd-32c58d6dd4eb tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 0 microversion: 2.1 time: 0.400526 Mar 29 02:16:55.151611 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 851/1730] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:54 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:16:55.156068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.158429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.158643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.158764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.166983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.167769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.168662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.168775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.169151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.169406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.169964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.170402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.455367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.464417 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62156fdb-c390-4145-8ec5-212746487cd6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.313833 Mar 29 02:16:55.465019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 880/1731] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:55.469445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81640712-722e-4d15-b771-1ac4436d52fc tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.491210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81640712-722e-4d15-b771-1ac4436d52fc tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.025132 Mar 29 02:16:55.491780 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 881/1732] 10.222.0.36 () {58 vars in 1147 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:55.497911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:55.500158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.508072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.508759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.509556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.510148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.641360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:16:55.641360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:16:55.641360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:16:55.641732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.642328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:16:55.642907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:16:55.654360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.659971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.661139 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43e11be2-a664-4c02-b0f6-d1182c0fc868 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.508491 Mar 29 02:16:55.662776 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 852/1733] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:55.671965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.672601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.689450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.689899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.690703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.691210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.869176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:55.875777 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96e66e53-48ac-481d-98e2-43c11c626b56 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1267 microversion: 2.1 time: 0.212275 Mar 29 02:16:55.876886 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 853/1734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:55.881795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-73f1ca70-0709-43a5-81e6-0d914d9d4201 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.903329 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-73f1ca70-0709-43a5-81e6-0d914d9d4201 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025413 Mar 29 02:16:55.903905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 854/1735] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:55.909824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:55.910311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.917947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.918431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.919215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.919695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.926646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:55.949517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.950097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:55.950978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:55.951637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.030344 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95a3bf3e-ed49-419f-b87b-7cc5d4cab87e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 1068 microversion: 2.1 time: 0.536985 Mar 29 02:16:56.031227 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 882/1736] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:55 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 1068 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 29 02:16:56.036078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.036772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:56.045039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.045755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.046613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.047054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.263799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:56.277004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f6482c2-78a7-41ff-a4f9-d7e8cfcac823 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1325 microversion: 2.1 time: 0.244252 Mar 29 02:16:56.277716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 883/1737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1325 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.292447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1ab0a1f-e34a-413f-9ab9-83a0d5c308df tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.309225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1ab0a1f-e34a-413f-9ab9-83a0d5c308df tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022582 Mar 29 02:16:56.310076 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 884/1738] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:56.314122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.314830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:56.322776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.323302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.324148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.324654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.495322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:56.505032 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-282ba94e-fbef-4b08-8a83-58ff95d11729 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.600018 Mar 29 02:16:56.507013 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 855/1739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:55 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.512172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.513180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:56.521287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.522818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.523837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.524341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.551012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:56.559821 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1570bf0d-a5fe-4d35-8bbe-03fc1d16bec7 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.248883 Mar 29 02:16:56.562213 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 885/1740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.565072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-83064b4d-5fdb-487c-bf21-d6f5819675c6 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.601392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-83064b4d-5fdb-487c-bf21-d6f5819675c6 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.039248 Mar 29 02:16:56.602418 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 886/1741] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.607477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.607948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:56.616359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.617049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.618139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.618530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.869325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:56.877930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fc30fa4a-1e60-4c5b-9d02-dd64e189bc2f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.274311 Mar 29 02:16:56.878396 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 887/1742] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.883399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2accea76-e716-4593-88fa-4902edf2bc14 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.908806 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2accea76-e716-4593-88fa-4902edf2bc14 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029345 Mar 29 02:16:56.909413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 888/1743] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:56.914570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:56.914570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:56.923508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.924141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:56.925063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:56.925924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.186569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.197752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.199854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.201850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dc5e8e7-993e-4012-ba25-4922271758f0 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.291521 Mar 29 02:16:57.213222 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 889/1744] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:57.213222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:57.213222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:57.220356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.221124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.221855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.222446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.345784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.355108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4416e92c-19b7-42b5-a1a7-a14d42e5e580 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1273 microversion: 2.1 time: 0.150041 Mar 29 02:16:57.356085 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 890/1745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:57 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:57.364494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7524058-c49b-494a-8c44-2c6559c8cd39 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:57.385961 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7524058-c49b-494a-8c44-2c6559c8cd39 tempest-FlavorsV2TestJSON-600225595 tempest-FlavorsV2TestJSON-600225595-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027972 Mar 29 02:16:57.395092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.397845 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 891/1746] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:16:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:57.403149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:57.404468 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f768e90-8898-42b2-bd6d-4c7ef5251d75 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.895985 Mar 29 02:16:57.405192 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:16:57.405192 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:16:57.409438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 856/1747] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:56 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:57.414945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:57.415525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:57.416998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.417508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.433536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.433979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.438263 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] Creating event network-changed:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h1-828148-1 Mar 29 02:16:57.439739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.440297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.445901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:16:57.461952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3a714e0c-387b-4fc7-966d-21930a474a12 req-8571259a-5085-4953-860f-f678a1fe5597 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062122 Mar 29 02:16:57.463050 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 892/1748] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:16:57.527130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:57.538875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:57.544185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.545601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.546575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.547136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.887820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:57.897885 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2bf58182-924d-423f-a1af-2eff67cd408b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1522 microversion: 2.1 time: 0.487103 Mar 29 02:16:57.911887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 857/1749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:57 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:57.917431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:57.918236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:57.926591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.927218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:57.928774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:57.929438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.058599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:58.074318 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0da23381-9232-4e9c-a7b9-8fa29cf24b0b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.554487 Mar 29 02:16:58.083763 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 893/1750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:57 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:58.088510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:58.089150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:58.108999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.108999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.109525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.109953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.482643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:58.491651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cdf16c61-0aba-4a8a-963b-b5e88dd7cc37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.577832 Mar 29 02:16:58.492215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 858/1751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:57 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:58.497124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:58.498044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:58.505439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.506460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.507206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.507839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.698576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:58.705440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23c03992-a524-456f-9005-056366a65477 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.620242 Mar 29 02:16:58.706009 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 894/1752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:58 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:58.711431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:58.712038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:58.719227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.719671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:58.720552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:58.721004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.098482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.113363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.115065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.116957 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8eeedd1b-738f-4e82-9a2f-c690778ed0ed tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.409746 Mar 29 02:16:59.117895 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 895/1753] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:16:58 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:16:59.123271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:59.123940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:59.132242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.133558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.134207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.135824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.136429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.142825 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf4275c8-2d0e-413d-895a-422c54d36574 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1522 microversion: 2.1 time: 0.649251 Mar 29 02:16:59.143760 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 859/1754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:58 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1522 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:59.148766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:59.149711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:59.158870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.159636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.160669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.161358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.442428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.459626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b05b148f-4cd6-4302-9a68-97dff604276e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.340162 Mar 29 02:16:59.461011 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 896/1755] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:59 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:59.467477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:59.468371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:59.485922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.485922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.485922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.485922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.587465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.597277 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47c6e859-41ea-4892-8db4-2aea70bae600 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.452076 Mar 29 02:16:59.597855 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 860/1756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:59 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:59.605204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1746448645"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:16:59.606831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:59.616996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.617651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.618803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.619406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.797611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:16:59.807774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e3bfff1-01bb-49ec-a185-50752961f363 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.344958 Mar 29 02:16:59.808775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 897/1757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:59 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:16:59.822057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:16:59.822828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:16:59.836434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.838705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:16:59.840315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:16:59.841458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.102242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:00.110513 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-52b05809-61b4-448e-8aed-1772ec6feb93 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1469 microversion: 2.1 time: 0.299455 Mar 29 02:17:00.112919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 898/1758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:16:59 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:00.116565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a61240aa-f4e0-4005-a0aa-ee40081bebc9 req-ea4d728a-0881-4274-8214-062ebf3e0e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f26e84-cb3a-47ab-a37b-faf0c3a2c896", "name": "network-vif-plugged", "status": "completed", "tag": "020be6cb-31c2-43ca-bf79-09fffb0c481d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:00.118388 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:00.118388 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:00.126653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a61240aa-f4e0-4005-a0aa-ee40081bebc9 req-ea4d728a-0881-4274-8214-062ebf3e0e3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.127089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a61240aa-f4e0-4005-a0aa-ee40081bebc9 req-ea4d728a-0881-4274-8214-062ebf3e0e3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.143966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a61240aa-f4e0-4005-a0aa-ee40081bebc9 req-ea4d728a-0881-4274-8214-062ebf3e0e3b service nova] Creating event network-vif-plugged:020be6cb-31c2-43ca-bf79-09fffb0c481d for instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 on n-h2-828148-1 Mar 29 02:17:00.149519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a61240aa-f4e0-4005-a0aa-ee40081bebc9 req-ea4d728a-0881-4274-8214-062ebf3e0e3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036836 Mar 29 02:17:00.150882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 899/1759] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:00.156629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:00.161262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:00.170427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.170909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.177102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.177102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.336181 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13c24970-e6c8-404e-9034-2325b06c4abc tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010/action" status: 202 len: 0 microversion: 2.1 time: 0.736620 Mar 29 02:17:00.341905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 861/1760] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:16:59 2022] POST /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:17:00.345548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:00.346528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:00.362466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.362916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.363729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.364312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.495065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:00.507901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fde9a9c8-77ee-478b-b0e9-3f3e23499588 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.355629 Mar 29 02:17:00.509623 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 900/1761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:00 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:00.517920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d3e07075-6ee0-454c-b15a-64826fc92bd9 req-28302dfc-91e0-422b-84e8-6b6e593a212a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1cba646-2dd1-4148-adb8-83d799d5a83e", "tag": "26e56515-ef1f-4f3b-ac96-8d8047bdf679"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:00.525163 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:00.525163 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:00.536701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d3e07075-6ee0-454c-b15a-64826fc92bd9 req-28302dfc-91e0-422b-84e8-6b6e593a212a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.538048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d3e07075-6ee0-454c-b15a-64826fc92bd9 req-28302dfc-91e0-422b-84e8-6b6e593a212a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.557713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d3e07075-6ee0-454c-b15a-64826fc92bd9 req-28302dfc-91e0-422b-84e8-6b6e593a212a service nova] Creating event network-changed:26e56515-ef1f-4f3b-ac96-8d8047bdf679 for instance e1cba646-2dd1-4148-adb8-83d799d5a83e on n-h1-828148-1 Mar 29 02:17:00.563269 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d3e07075-6ee0-454c-b15a-64826fc92bd9 req-28302dfc-91e0-422b-84e8-6b6e593a212a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051745 Mar 29 02:17:00.564487 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 901/1762] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:00.571360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-870bb9ba-ea6a-408b-8cbc-3f99a674b327 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f8724b99820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:00.894867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:00.895694 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-870bb9ba-ea6a-408b-8cbc-3f99a674b327 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e" status: 204 len: 0 microversion: 2.1 time: 0.329478 Mar 29 02:17:00.896461 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 902/1763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:00 2022] DELETE /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:00.904764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:00.905023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:00.905727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:00.906528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:00.907680 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50c9ec68-ba03-4c30-8bf6-b05b6bb56448 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.568671 Mar 29 02:17:00.908220 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 862/1764] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:00 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:00.913011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:00.913797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:00.921296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.921739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.922510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.922936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.924997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.925405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:00.926343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:00.927337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.142954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:01.151751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f73715c7-f778-46c5-a28d-684a62d11be6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.250861 Mar 29 02:17:01.152687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 903/1765] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:00 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:01.291081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] Calling method '.version_select at 0x7f8724b999d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.301201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.301825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.302792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.303298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.326359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-33c5afb5-c613-4168-8dbe-99088989c698 tempest-AbsoluteLimitsTestJSON-565411937 tempest-AbsoluteLimitsTestJSON-565411937-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.172275 Mar 29 02:17:01.327060 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 904/1766] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/limits => generated 511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:01.333335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.334851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:01.345958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:01.353140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.357463 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5a25c8b-6d6d-4cc6-a1a1-8b8d58a32e34 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.448230 Mar 29 02:17:01.357649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.361773 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 863/1767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:00 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:01.369019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.369019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.369267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3051f41b-d0f8-4e1f-b9a5-d4c32d24223b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f8725e6cdc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.387547 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-3051f41b-d0f8-4e1f-b9a5-d4c32d24223b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Image not found. Mar 29 02:17:01.388350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3051f41b-d0f8-4e1f-b9a5-d4c32d24223b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:01.389652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3051f41b-d0f8-4e1f-b9a5-d4c32d24223b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e" status: 404 len: 62 microversion: 2.1 time: 0.029790 Mar 29 02:17:01.393384 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 864/1768] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:17:01.398208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.398860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:01.408019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.408519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.409527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.410128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.568772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:01.577083 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f034c57-f6ba-4319-8da9-cb91891c9c52 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1309 microversion: 2.1 time: 0.248952 Mar 29 02:17:01.578228 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 905/1769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:01.582490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.584827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:01.592015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.592387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.593206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.593628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.832951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:01.844456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5801f33e-12da-47b8-ae39-2dfda6e181b0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1534 microversion: 2.1 time: 0.265626 Mar 29 02:17:01.852776 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 906/1770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1534 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:01.865310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:01.865927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:01.873665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.874097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.874869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:01.875305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:01.886517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:01.901993 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-186ff137-ec1c-448d-a775-3e9613e915fd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1462 microversion: 2.1 time: 0.510454 Mar 29 02:17:01.902579 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 865/1771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1462 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:02.126257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.135795 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-521b67e9-ef85-4657-86ea-c461cee2b62f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.281632 Mar 29 02:17:02.136570 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 907/1772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:02.141108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.141720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.152176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.152768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.153504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.154100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.156809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.157517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.170185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.171060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.172081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.172934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.583270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.594153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.596096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.597615 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a233a30-e64f-4f23-8d2c-06aff6fd4457 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.460202 Mar 29 02:17:02.617297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 908/1773] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:02 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:02.643954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.649225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.664161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.664782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.667106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.667822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.676980 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6eeb27df-99c6-4bff-9a51-9c90421ba2a8 tempest-MigrationsAdminTest-2082770343 tempest-MigrationsAdminTest-2082770343-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1613 microversion: 2.1 time: 0.762846 Mar 29 02:17:02.679633 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 866/1774] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:01 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1613 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:02.686128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.687017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.705132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.705934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.706934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.707610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.956385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.965422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:02.966430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f275b90-9740-462e-9407-a5399a5b1d09 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.284778 Mar 29 02:17:02.977142 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 867/1775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:02 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:02.978621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d240fa7-7f88-4e5d-b7ac-b7829ea6cbbf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.344407 Mar 29 02:17:02.979519 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 909/1776] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:02 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:02.982631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.983240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.984268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:02.984768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:02.993034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.993246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.993479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.993635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.994371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.994725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:02.994841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:02.995278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.058153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:03.215947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:03.224181 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b8cd7ce8-6dc8-4fa6-87e4-d3af83d1b9be tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1492 microversion: 2.1 time: 0.245667 Mar 29 02:17:03.225286 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 868/1777] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:02 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1492 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:03.229711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.230321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.237614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.238061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.238837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.239273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.376316 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1648ef3e-bc7b-4e9a-ab9f-85d84efa1c29 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "DELETE /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 204 len: 0 microversion: 2.1 time: 0.395444 Mar 29 02:17:03.376965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 910/1778] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:02 2022] DELETE /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:03.382149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.382942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.392926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.393620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.394389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.394824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.468013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:03.481659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18716efb-7c86-4da0-bc1a-a0f4185a2147 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1540 microversion: 2.1 time: 0.255295 Mar 29 02:17:03.482412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 869/1779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1540 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:03.487164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.487779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.504588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.504588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.504588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.504588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.663034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:03.673214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0327f5b2-fa35-4033-8f25-b033c46660de tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.295078 Mar 29 02:17:03.674237 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 911/1780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:03.679325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.680223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.689065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.689869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.691788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.692411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.749320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-702d0cb9-a021-45c1-87c3-04c347153c70 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1643 microversion: 2.1 time: 0.265693 Mar 29 02:17:03.750817 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 870/1781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1643 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:03.767499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.768957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.778288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.779458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.780425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.780893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.923264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:03.947788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0a5989a-de85-4ab2-ab35-85f7f95632f6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1468 microversion: 2.1 time: 0.272384 Mar 29 02:17:03.951555 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 912/1782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:03.957212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:03.957831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:03.980180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.980641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:03.981467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:03.981902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.090463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.100647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.102174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.103317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a32a374f-bcda-4400-bbc7-de6ce7f73f46 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.351398 Mar 29 02:17:04.103843 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 871/1783] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:04.108314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.108932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.116154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.116608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.117400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.119446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.201099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5246deae-a92b-435b-8bc2-f601f34298d3 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1643 microversion: 2.1 time: 0.248417 Mar 29 02:17:04.201683 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 913/1784] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:03 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1643 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:04.206479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.207318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.215662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.217322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.218458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.219217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.335344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.344459 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ffa8933-2b0e-4266-9114-a927d79063ab tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.239519 Mar 29 02:17:04.345189 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 872/1785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:04.358586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.359968 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:04.359968 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:04.361504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.361957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.362756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.363188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.392126 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d9502068-0daf-4e72-8e9b-7e1738a93c7a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037109 Mar 29 02:17:04.392777 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 873/1786] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:04.402967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:04.403501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.410924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.411190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.411991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.412419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.459815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.467949 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4f44c59-75b2-429a-9580-69d14138d181 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.264961 Mar 29 02:17:04.477028 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 914/1787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:04.499453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.500087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.508345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.508787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.509603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.510205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.697733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d43e204b-bca7-4c6c-bf45-0d99ba4c4314 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896/action" status: 202 len: 0 microversion: 2.1 time: 0.294175 Mar 29 02:17:04.697733 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 874/1788] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:04 2022] POST /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:17:04.699842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.700531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.710932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.710932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.710932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.710932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.786148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.800036 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38e2da88-4c4b-4011-9aa1-516bfbfdae72 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1522 microversion: 2.1 time: 0.304278 Mar 29 02:17:04.801214 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 915/1789] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:04.818412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.819139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.833195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.833683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.834537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.834980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.928739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:04.937537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87c7d9a5-1691-44aa-8e3a-2de538f9855d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.241910 Mar 29 02:17:04.938118 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 875/1790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:04.942275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:04.942769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:04.951770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.952209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:04.953209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:04.953430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.022934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:05.154930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43f29e56-5007-41e1-889f-0e067568030c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1648 microversion: 2.1 time: 0.352566 Mar 29 02:17:05.160872 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 916/1791] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:04 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1648 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:05.160872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:05.161184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:05.169802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.170352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.171207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.171708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.419191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:05.419385 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-91bfaa5a-e6c2-4531-9155-3fd5c23159ee tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 204 len: 0 microversion: 2.1 time: 0.477552 Mar 29 02:17:05.419385 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 876/1792] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:04 2022] DELETE /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:05.423891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:05.424251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:05.433806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.433983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.434737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.435143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.437829 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63a0265e-808e-4675-a941-3c361043c342 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1468 microversion: 2.1 time: 0.280798 Mar 29 02:17:05.442763 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 917/1793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:05 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1468 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:05.455410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:05.456160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:05.466139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.467355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.468424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.470394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.710168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:05.718539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa1a2604-4e96-43ee-b87a-2e3ccdfd9d12 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.274631 Mar 29 02:17:05.719107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 918/1794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:05 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:05.723475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:05.724085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:05.731456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.731905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.732673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.733132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.929792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:05.938256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-661a1266-1b16-4a69-bb32-a2ce160cb16b tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1528 microversion: 2.1 time: 0.218213 Mar 29 02:17:05.938896 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 919/1795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:05 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1528 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:05.943824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6ec40773-f6eb-430d-b6fe-d07b67e51cf4 req-559f6355-1e2b-4f94-9208-bf86b7a81361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91e2442-2015-450c-bee0-3a35f2a97010", "name": "network-vif-plugged", "status": "completed", "tag": "9051414c-43c0-43ac-8448-962e8646cca3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:05.945497 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:05.945497 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:05.954152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6ec40773-f6eb-430d-b6fe-d07b67e51cf4 req-559f6355-1e2b-4f94-9208-bf86b7a81361 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.954750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6ec40773-f6eb-430d-b6fe-d07b67e51cf4 req-559f6355-1e2b-4f94-9208-bf86b7a81361 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.970449 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6ec40773-f6eb-430d-b6fe-d07b67e51cf4 req-559f6355-1e2b-4f94-9208-bf86b7a81361 service nova] Creating event network-vif-plugged:9051414c-43c0-43ac-8448-962e8646cca3 for instance b91e2442-2015-450c-bee0-3a35f2a97010 on n-h2-828148-1 Mar 29 02:17:05.975477 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6ec40773-f6eb-430d-b6fe-d07b67e51cf4 req-559f6355-1e2b-4f94-9208-bf86b7a81361 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Mar 29 02:17:05.976264 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 920/1796] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:05.981254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:05.981949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:05.989285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.989731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:05.991031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:05.991462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.171281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:06.184754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:06.186914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:06.188036 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-57ea3afe-aa6e-42f6-b590-0a19c61c9580 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.769357 Mar 29 02:17:06.198428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:06.199828 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 877/1797] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:05 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:06.204602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:06.205672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:06.207539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4c16b2f-0341-4bc1-b3d5-1384aee72961 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.230185 Mar 29 02:17:06.208116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 921/1798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:05 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:06.217445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:06.217445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:06.223396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.223579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.223952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.224102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.224809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.224969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.225283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.225656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.418165 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc513e4b-1730-449a-8347-a1cdf9d2ad18 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1628 microversion: 2.1 time: 0.208144 Mar 29 02:17:06.418902 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 922/1799] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:06 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1628 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:06.435458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-828148-1", "block_migration": true, "disk_over_commit": false}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:06.437465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:06.444788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.445314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.446096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.446524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.510167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lazy-loading 'flavor' on Instance uuid d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:17:06.557092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Going to try to live migrate instance to n-h1-828148-1 {{(pid=103513) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:17:06.638027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:06.642971 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d3128f0-3a68-484b-8a9f-a3e69b4bc6c7 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.441908 Mar 29 02:17:06.643521 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 878/1800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:06 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:06.654036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:06.654723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:06.678699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.679721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:06.680793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:06.681664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:07.305797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:07.318877 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-14acc3e8-6ff9-47a5-9949-eac950f15840 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 200 len: 1426 microversion: 2.1 time: 0.673998 Mar 29 02:17:07.320663 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 879/1801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:06 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 1426 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:07.327801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:07.334058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:07.338877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:07.339566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:07.340525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:07.341147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:07.586648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:07.596516 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c287966-e10f-48be-9767-c9dcc23c82af tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.274627 Mar 29 02:17:07.597644 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 880/1802] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:07 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:07.789235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fff6b5b-8272-42e8-94c5-113ea78fd160 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8717d57790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-764185162", "description": "tempest-description-2033944894"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:08.321015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0fff6b5b-8272-42e8-94c5-113ea78fd160 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.721661 Mar 29 02:17:08.321633 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 881/1803] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:07 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:08.326107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cc1a25e2-2e7b-43aa-86bc-67a5f0ad141d req-219929c8-1f1d-44cf-89cf-9fba770ca9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930ebc60-6de9-44e7-b7d2-0fa675201335", "name": "network-vif-deleted", "tag": "f0c01f74-6bb1-4f25-9f11-dac10b64418e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:08.327697 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:08.327697 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:08.335981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cc1a25e2-2e7b-43aa-86bc-67a5f0ad141d req-219929c8-1f1d-44cf-89cf-9fba770ca9f7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.336429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cc1a25e2-2e7b-43aa-86bc-67a5f0ad141d req-219929c8-1f1d-44cf-89cf-9fba770ca9f7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.352314 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cc1a25e2-2e7b-43aa-86bc-67a5f0ad141d req-219929c8-1f1d-44cf-89cf-9fba770ca9f7 service nova] Creating event network-vif-deleted:f0c01f74-6bb1-4f25-9f11-dac10b64418e for instance 930ebc60-6de9-44e7-b7d2-0fa675201335 on n-h1-828148-1 Mar 29 02:17:08.357276 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cc1a25e2-2e7b-43aa-86bc-67a5f0ad141d req-219929c8-1f1d-44cf-89cf-9fba770ca9f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Mar 29 02:17:08.358092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 882/1804] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:08.363036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:08.363714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:08.371636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.372066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.372815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.373266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.574759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:08.583389 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32e75659-ed60-47fa-8499-1cf7a222c525 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1528 microversion: 2.1 time: 0.224071 Mar 29 02:17:08.584580 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 883/1805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:08 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1528 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:08.589082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:08.590308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:08.597525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.597977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.598751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.599223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.880079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:08.890544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:08.892079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:08.893264 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-219e9135-feb3-40e7-a75e-a42dfd45ada4 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.307478 Mar 29 02:17:08.893810 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 884/1806] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:08 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:08.898148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:08.898756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:08.905947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.906400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:08.907174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:08.907613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.492130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:09.500409 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01e51551-1a6b-4c0d-809e-026b7b2efdc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.605564 Mar 29 02:17:09.501304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 885/1807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:08 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:09.505264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:09.505780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:09.513068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.513541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.514423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.514858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.721092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:09.730171 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-df422258-7c6f-450b-9833-a54462691fa2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.228308 Mar 29 02:17:09.733378 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 886/1808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:09 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:09.738298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-eda5f2c9-4f8b-4874-b87b-51ae1aee3898 req-dc143a79-782e-40c4-b044-fed73d7c451e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91e2442-2015-450c-bee0-3a35f2a97010", "name": "network-vif-unplugged", "status": "completed", "tag": "9051414c-43c0-43ac-8448-962e8646cca3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:09.739990 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:09.739990 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:09.743229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01b674f8-a29a-4590-be1e-f157d97049fd tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896/action" status: 202 len: 0 microversion: 2.1 time: 3.311597 Mar 29 02:17:09.749330 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 923/1809] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:06 2022] POST /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896/action => generated 0 bytes in 3313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:17:09.749330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb9919da-0e5d-4042-b2fe-712849680eca tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724c6ddc0>, body: {"security_group_rule": {"parent_group_id": "bfcb95ac-b63f-4416-b85b-7687a6cb0ca0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:09.751413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eda5f2c9-4f8b-4874-b87b-51ae1aee3898 req-dc143a79-782e-40c4-b044-fed73d7c451e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.751794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eda5f2c9-4f8b-4874-b87b-51ae1aee3898 req-dc143a79-782e-40c4-b044-fed73d7c451e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.768455 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-eda5f2c9-4f8b-4874-b87b-51ae1aee3898 req-dc143a79-782e-40c4-b044-fed73d7c451e service nova] Creating event network-vif-unplugged:9051414c-43c0-43ac-8448-962e8646cca3 for instance b91e2442-2015-450c-bee0-3a35f2a97010 on n-h2-828148-1 Mar 29 02:17:09.773672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-eda5f2c9-4f8b-4874-b87b-51ae1aee3898 req-dc143a79-782e-40c4-b044-fed73d7c451e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038898 Mar 29 02:17:09.776393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 887/1810] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:09.779225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:09.779916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 930ebc60-6de9-44e7-b7d2-0fa675201335] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:09.787276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.787680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.788453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.788906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.839888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] HTTP exception thrown: Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 could not be found. Mar 29 02:17:09.840495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Returning 404 to user: Instance 930ebc60-6de9-44e7-b7d2-0fa675201335 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:09.841362 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c47e178-92c4-4430-bada-479cbc9c6bff tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335" status: 404 len: 111 microversion: 2.1 time: 0.066074 Mar 29 02:17:09.841926 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 888/1811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:09 2022] GET /compute/v2.1/servers/930ebc60-6de9-44e7-b7d2-0fa675201335 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:09.846495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:09.847110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:09.854272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.856631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:09.856631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:09.856631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.057347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.066296 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e44f0d64-02bc-411c-85cd-4ca173d4a81b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.223325 Mar 29 02:17:10.066865 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 889/1812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:09 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:10.076762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e853dadd-b862-4f1f-92ef-9396c7709eae req-83b7aa95-7c07-4de3-9ca7-bcd9515c60d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91e2442-2015-450c-bee0-3a35f2a97010", "name": "network-vif-deleted", "tag": "9051414c-43c0-43ac-8448-962e8646cca3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:10.078270 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:10.078270 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:10.086869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e853dadd-b862-4f1f-92ef-9396c7709eae req-83b7aa95-7c07-4de3-9ca7-bcd9515c60d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.087308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e853dadd-b862-4f1f-92ef-9396c7709eae req-83b7aa95-7c07-4de3-9ca7-bcd9515c60d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.102824 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e853dadd-b862-4f1f-92ef-9396c7709eae req-83b7aa95-7c07-4de3-9ca7-bcd9515c60d3 service nova] Creating event network-vif-deleted:9051414c-43c0-43ac-8448-962e8646cca3 for instance b91e2442-2015-450c-bee0-3a35f2a97010 on n-h2-828148-1 Mar 29 02:17:10.107194 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e853dadd-b862-4f1f-92ef-9396c7709eae req-83b7aa95-7c07-4de3-9ca7-bcd9515c60d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039249 Mar 29 02:17:10.107764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 890/1813] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:10.112613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:10.113336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:10.120559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.121163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.121927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.122363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.196201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.196745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.197218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lazy-loading 'fault' on Instance uuid b91e2442-2015-450c-bee0-3a35f2a97010 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:17:10.270227 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb9919da-0e5d-4042-b2fe-712849680eca tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.524966 Mar 29 02:17:10.271088 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 924/1814] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:10.275681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:10.276579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:10.285689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.286479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.287786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.288463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.290504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.303042 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34ed8ba1-70ff-4273-b857-b2ad29a64443 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 200 len: 1315 microversion: 2.1 time: 0.193014 Mar 29 02:17:10.305463 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 891/1815] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:10 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:10.317554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:10.318844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:10.326553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.327092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.327835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.328280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.399682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:10.502787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.512181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d7a7808-5683-4658-bde2-0bcd1b861a21 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.239712 Mar 29 02:17:10.512656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 925/1816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:10 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:10.517308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:10.518807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:10.525127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.525593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.526348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.526781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.787810 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7880d414-ea27-4235-b0ea-48fdf3f66241 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 204 len: 0 microversion: 2.1 time: 0.481014 Mar 29 02:17:10.788425 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 892/1817] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:10 2022] DELETE /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:10.797764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-031c9588-6f1b-4587-82bd-2ff8518b763a tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724d6d790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-194409240", "description": "tempest-description-1517269854"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:10.814577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.825294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.826784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:10.828072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a080a7c-22cc-42cd-9874-c4cddc19db61 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.314130 Mar 29 02:17:10.828796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 926/1818] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:10 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:10.833028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:10.834244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:10.843242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.843915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:10.845247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:10.845767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.054975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:11.064526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6feaa850-8852-4066-bb30-a89c2a1e15d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.234730 Mar 29 02:17:11.065126 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 927/1819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:10 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:11.070291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:11.070901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:11.078108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.078920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.079703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.080137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.196233 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:17:11.384194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:11.388698 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-031c9588-6f1b-4587-82bd-2ff8518b763a tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.595231 Mar 29 02:17:11.390150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 893/1820] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:11.395373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:11.396397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:11.402134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29866773-b2eb-4ce0-adc5-e0236f143f15 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.335785 Mar 29 02:17:11.402932 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 928/1821] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:11 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:11.404767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.405465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.406569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.407209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.407642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:11.408256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:11.416738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.417230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.418014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.418625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.622596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:11.631662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be4ab62a-c0ec-42b6-b6dc-aa5a643fb46e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.227479 Mar 29 02:17:11.632388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 929/1822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:11 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:11.637136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:11.638345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:11.647068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.647939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.648809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.649370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.703335 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. Mar 29 02:17:11.704019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:11.704970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2607e2f1-6c64-484a-9351-67e1069e5d5c tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 404 len: 111 microversion: 2.1 time: 0.071379 Mar 29 02:17:11.709191 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 930/1823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:11 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:11.710740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ee35c30-5ad0-4cf6-a552-bf9d2d918fa7 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724172040>, body: {"security_group_rule": {"parent_group_id": "76f8fd51-8ecf-4e2d-acbe-729a1a9ef1a1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:11.872129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:11.880229 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3cfe806c-1585-4366-9faf-68ef97109e8b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1534 microversion: 2.1 time: 0.488751 Mar 29 02:17:11.881171 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 894/1824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:11 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1534 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:11.885296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:11.885893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:11.893038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.893485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:11.894270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:11.894683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.150650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:12.158990 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-168c1c06-157f-425b-a4fd-571c68ae5104 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.277198 Mar 29 02:17:12.159566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 895/1825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:11 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:12.164076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-86cd019b-0943-44f3-879a-99df62f2f9cc req-ea726248-7e7c-41db-b900-5ab313a3caf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cba646-2dd1-4148-adb8-83d799d5a83e", "name": "network-vif-plugged", "status": "completed", "tag": "26e56515-ef1f-4f3b-ac96-8d8047bdf679"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:12.168895 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:12.168895 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:12.173744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-86cd019b-0943-44f3-879a-99df62f2f9cc req-ea726248-7e7c-41db-b900-5ab313a3caf7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.174187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-86cd019b-0943-44f3-879a-99df62f2f9cc req-ea726248-7e7c-41db-b900-5ab313a3caf7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.190198 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-86cd019b-0943-44f3-879a-99df62f2f9cc req-ea726248-7e7c-41db-b900-5ab313a3caf7 service nova] Creating event network-vif-plugged:26e56515-ef1f-4f3b-ac96-8d8047bdf679 for instance e1cba646-2dd1-4148-adb8-83d799d5a83e on n-h1-828148-1 Mar 29 02:17:12.195310 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-86cd019b-0943-44f3-879a-99df62f2f9cc req-ea726248-7e7c-41db-b900-5ab313a3caf7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Mar 29 02:17:12.196083 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 896/1826] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:12.205022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1774714010", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:12.248166 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56056. Mar 29 02:17:12.256598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ee35c30-5ad0-4cf6-a552-bf9d2d918fa7 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.549894 Mar 29 02:17:12.258333 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 931/1827] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:12.263583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:12.264411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:12.279802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.279802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.279802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.279802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.286479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] validate_networks() for [('791b6e2f-84cc-4e53-b233-99285785bda3', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:12.529509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:12.539355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:12.540885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:12.541985 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8aeae50c-3b3b-49ca-a84e-2b36b72e4e85 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.282533 Mar 29 02:17:12.542553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 932/1828] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:12 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:12.546856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-85c24429-8000-4b67-9382-1199328f9648 req-bc98ff37-dbf3-4c28-abda-1e13078f1ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f26e84-cb3a-47ab-a37b-faf0c3a2c896", "name": "network-vif-unplugged", "status": "completed", "tag": "020be6cb-31c2-43ca-bf79-09fffb0c481d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:12.548646 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:12.548646 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:12.558752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-85c24429-8000-4b67-9382-1199328f9648 req-bc98ff37-dbf3-4c28-abda-1e13078f1ca7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.559198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-85c24429-8000-4b67-9382-1199328f9648 req-bc98ff37-dbf3-4c28-abda-1e13078f1ca7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.576059 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-85c24429-8000-4b67-9382-1199328f9648 req-bc98ff37-dbf3-4c28-abda-1e13078f1ca7 service nova] Creating event network-vif-unplugged:020be6cb-31c2-43ca-bf79-09fffb0c481d for instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 on n-h2-828148-1 Mar 29 02:17:12.580920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-85c24429-8000-4b67-9382-1199328f9648 req-bc98ff37-dbf3-4c28-abda-1e13078f1ca7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037232 Mar 29 02:17:12.581503 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 933/1829] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:12.586536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:12.587327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:12.594611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.595096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.595875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:12.596309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:12.816436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:12.824766 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d398499a-434c-467f-b441-9ae501e4a720 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1315 microversion: 2.1 time: 0.241888 Mar 29 02:17:12.825366 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 934/1830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:12 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:12.829965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8fe538c-9260-4aed-bb97-c3a7bad6a535 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724172160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1326481200", "description": "tempest-description-1910240611"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:13.191088 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8fe538c-9260-4aed-bb97-c3a7bad6a535 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.364352 Mar 29 02:17:13.192562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 935/1831] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:12 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:13.200010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:13.203095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:13.212464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.213287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.215149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.215824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.461946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:13.472153 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d391d5f9-2d14-4333-ba70-f889dc5c8c96 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.277043 Mar 29 02:17:13.483200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 936/1832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:13 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:13.483200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:13.483200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:13.492404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.493074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.495155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.495155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.565341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:13.565865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:13.566231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:13.566642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:13.567048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:13.580767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.581246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.585011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.585466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.612412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:13.620631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Getting quotas for user 7ff0139c538f4391bd0b5eb0c42f11a0 and project bcc43a2a688544ab9ac5ce25ed7ed809. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:13.640752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:13.643620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:13.760679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:13.769662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a90da8a6-60d2-4112-a82f-5a77a9ffbd62 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.295377 Mar 29 02:17:13.770550 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 937/1833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:13 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:13.775102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:13.775702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:13.779504 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08cdbd73-f10d-4e0d-bddb-801be43affe7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.571898 Mar 29 02:17:13.785223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.785223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.785510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.786001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.786734 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 897/1834] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:13.792583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:13.793470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:13.801948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.803152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:13.804253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:13.805300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.004481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.013136 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3bbd75e3-ac4b-40e8-a93d-dc9cddde0989 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1534 microversion: 2.1 time: 0.241469 Mar 29 02:17:14.014136 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 938/1835] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:13 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1534 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:14.018829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20d92360-1629-4c26-8529-18870e751d6f tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f87240cfe50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-774661929", "description": "tempest-description-1584945551"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:14.235423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.244071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-470c9ca1-4650-4e81-8e02-29858121aae6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.456032 Mar 29 02:17:14.244874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 898/1836] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:13 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:14.252726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:14.260696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:14.262319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.262919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.263917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.264506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.551528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20d92360-1629-4c26-8529-18870e751d6f tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.533720 Mar 29 02:17:14.554040 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 939/1837] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:14.560994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8270ba1d-489a-4fb5-9d0f-44cde48cddb2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:14.562547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8270ba1d-489a-4fb5-9d0f-44cde48cddb2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:14.670923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.686446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.687961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.689134 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30aa1f35-0a41-4254-a548-49de6be852c3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.440243 Mar 29 02:17:14.700762 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 899/1838] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:14 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:14.705647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:14.706662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:14.726564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.727013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.727863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.728294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.749869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8270ba1d-489a-4fb5-9d0f-44cde48cddb2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.760924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8270ba1d-489a-4fb5-9d0f-44cde48cddb2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1225 microversion: 2.1 time: 0.205559 Mar 29 02:17:14.761905 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 940/1839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:14 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:14.767110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:14.767910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:14.777839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.789098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.789098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:14.789098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:14.974389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:14.984033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e8a0fd1-5309-4910-bc24-5a94b649e25c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1503 microversion: 2.1 time: 0.281900 Mar 29 02:17:14.984908 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 900/1840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:14 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:14.998659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dfa6c7e-7ee6-4e93-82a4-bfd6bb3f9049 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724d41790>, body: {"security_group_rule": {"parent_group_id": "8aae922a-853f-481e-bdd5-a2b8806440b4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "c6c46fd8-4e1e-4f65-8f37-a6c3fc3656fe"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:15.095948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:15.104619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e527e8fe-559a-4722-9cc7-db4390978ffe tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1505 microversion: 2.1 time: 0.341443 Mar 29 02:17:15.114116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 941/1841] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:14 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:15.119920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f26e84-cb3a-47ab-a37b-faf0c3a2c896", "tag": "020be6cb-31c2-43ca-bf79-09fffb0c481d"}, {"server_uuid": "3219f754-4bc7-4c6c-990d-69861ad335e8", "name": "network-vif-deleted", "tag": "5fb4f3be-6c13-444d-b5a8-73ccd34b28b3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:15.121920 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:15.121920 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:15.131306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.132090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.156627 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] Creating event network-changed:020be6cb-31c2-43ca-bf79-09fffb0c481d for instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 on n-h2-828148-1 Mar 29 02:17:15.157331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] Creating event network-vif-deleted:5fb4f3be-6c13-444d-b5a8-73ccd34b28b3 for instance 3219f754-4bc7-4c6c-990d-69861ad335e8 on n-h1-828148-1 Mar 29 02:17:15.166589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-71cb19e6-8928-4d14-859e-62db0a699dd6 req-a8b7f35f-6529-488b-95fc-e6d230ecbde5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050217 Mar 29 02:17:15.167520 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 942/1842] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:15.172691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:15.173581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:15.182315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.183080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.183980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.184512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.526298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:15.553536 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a7ea5503-22f8-40c7-a2bd-e6655effc21f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.384945 Mar 29 02:17:15.567386 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 943/1843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:15 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:15.574279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6274a2f2-62f8-4220-9dd1-72241b1ab264 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:15.584111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6274a2f2-62f8-4220-9dd1-72241b1ab264 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.584772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6274a2f2-62f8-4220-9dd1-72241b1ab264 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.646444 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dfa6c7e-7ee6-4e93-82a4-bfd6bb3f9049 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.659690 Mar 29 02:17:15.649919 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 901/1844] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:14 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:15.658355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:15.659253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:15.674507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.686452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.686452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.686452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.687631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6274a2f2-62f8-4220-9dd1-72241b1ab264 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:17:15.834890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.835603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.836211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lazy-loading 'fault' on Instance uuid 3219f754-4bc7-4c6c-990d-69861ad335e8 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:17:15.907991 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6274a2f2-62f8-4220-9dd1-72241b1ab264 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e/action" status: 202 len: 0 microversion: 2.1 time: 0.338356 Mar 29 02:17:15.909296 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 944/1845] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:15 2022] POST /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:15.917641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:15.922187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:15.940870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.942483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:15.943373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:15.944998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.045209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.053769 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce28c008-df5b-4347-a898-2a6ea90f1d37 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 200 len: 1369 microversion: 2.1 time: 0.404586 Mar 29 02:17:16.054333 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 902/1846] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:15 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 1369 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:16.058945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2e47788-b239-45b0-b433-90fb6bc627bd tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724464ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-433310677", "description": "tempest-description-1435628943"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:16.350500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.359320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b1cd0eb-a9ba-499a-8009-dc9e47b48583 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.448398 Mar 29 02:17:16.366922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 945/1847] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:15 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:16.366922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:16.366922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:16.372679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.373176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.373960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.374409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.600107 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2e47788-b239-45b0-b433-90fb6bc627bd tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.544696 Mar 29 02:17:16.606896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 903/1848] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:16.606896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:16.606896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:16.615122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.615522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.616299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.616730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.763048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.776389 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e1f0d9ec-7347-4da5-a7bd-49036ac747ef tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1285 microversion: 2.1 time: 0.174239 Mar 29 02:17:16.781004 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 904/1849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:16 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:16.791350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:16.792080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:16.800376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.801304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.801925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.802947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.803624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.831396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.834181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:16.851116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22bdf2c4-3f69-4e6d-a3d1-e2b59c97df8e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.474782 Mar 29 02:17:16.851116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 946/1850] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:16 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:16.855357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:16.856159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:16.866824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.867517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:16.868510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:16.869128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.054718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:17.063425 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47b64989-da77-40cc-b149-acd37f1a46ee tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.275723 Mar 29 02:17:17.065178 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 905/1851] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:16 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:17.068727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:17.069406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:17.078338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.078784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.079588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.080027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.225162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:17.238454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58ac6570-19a6-45d7-b0a2-4e934f6a31a9 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1485 microversion: 2.1 time: 0.397901 Mar 29 02:17:17.256200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 947/1852] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:16 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1485 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:17.261319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f16e7dd5-802a-4aa9-bd0b-b3eee584a6f8 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724c6d040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-52661226", "description": "tempest-description-739565851"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:17.316423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:17.325466 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3b291abe-8058-4ad1-8893-618373032679 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1472 microversion: 2.1 time: 0.260334 Mar 29 02:17:17.331134 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 906/1853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:17 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:17.331134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:17.331134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 3219f754-4bc7-4c6c-990d-69861ad335e8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:17.339373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.339863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.340622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.341102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.414017 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] HTTP exception thrown: Instance 3219f754-4bc7-4c6c-990d-69861ad335e8 could not be found. Mar 29 02:17:17.415885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Returning 404 to user: Instance 3219f754-4bc7-4c6c-990d-69861ad335e8 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:17.416879 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e662f115-1458-4e18-9fdc-4c281b7db7c0 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8" status: 404 len: 111 microversion: 2.1 time: 0.089864 Mar 29 02:17:17.417401 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 907/1854] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:17 2022] GET /compute/v2.1/servers/3219f754-4bc7-4c6c-990d-69861ad335e8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:17.425561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-faaf65e5-12eb-4535-86d1-5c82b84723db req-7e22aa4d-8e6e-452d-888f-d78cec9617d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "cb4c85a2-0f06-43b8-8ca8-0980ac95e70f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:17.427705 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:17.427705 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:17.437071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-faaf65e5-12eb-4535-86d1-5c82b84723db req-7e22aa4d-8e6e-452d-888f-d78cec9617d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.437426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-faaf65e5-12eb-4535-86d1-5c82b84723db req-7e22aa4d-8e6e-452d-888f-d78cec9617d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.454044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-faaf65e5-12eb-4535-86d1-5c82b84723db req-7e22aa4d-8e6e-452d-888f-d78cec9617d5 service nova] Creating event network-vif-plugged:cb4c85a2-0f06-43b8-8ca8-0980ac95e70f for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:17.459281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-faaf65e5-12eb-4535-86d1-5c82b84723db req-7e22aa4d-8e6e-452d-888f-d78cec9617d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037533 Mar 29 02:17:17.460248 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 908/1855] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:17.465294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:17.466202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:17.474029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.474513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.493340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.493340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.859297 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f16e7dd5-802a-4aa9-bd0b-b3eee584a6f8 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.601700 Mar 29 02:17:17.862367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:17.869853 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 948/1856] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:17 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:17.871953 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad999400-6ce9-463d-9e7c-e6ad4a97714e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.410512 Mar 29 02:17:17.872505 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 909/1857] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:17 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:17.874942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1705180492", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:17.886153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:17.886758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:17.897671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.898500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.899755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:17.900615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:17.945851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] validate_networks() for [('39dfc579-1e6a-472b-9fc9-7d16e1c082d6', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:17.973204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:18.333683 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e70d12a4-1775-4721-9585-83aa100d6b57 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "DELETE /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 204 len: 0 microversion: 2.1 time: 0.459651 Mar 29 02:17:18.337269 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 910/1858] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:17 2022] DELETE /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:18.343052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:18.343879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:18.353540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:18.354123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:18.355590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:18.356464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:18.577754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:18.586334 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-512943f3-7610-4b6a-9435-93f1bde0fe33 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.250513 Mar 29 02:17:18.586896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 911/1859] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:18 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:18.592322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:18.592643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:18.600014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:18.600518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:18.601307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:18.601730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:18.863198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:18.873692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:18.875169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:18.876266 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53d06e74-85d0-4908-a576-abeaf4824a72 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.288459 Mar 29 02:17:18.876809 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 912/1860] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:18 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:18.888405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-246470d9-858b-4bc9-8a43-cb44a5ec631b tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724464ca0>, body: {"security_group_rule": {"parent_group_id": "65b042a6-59a7-4ce2-bd4b-86fa911ba194", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e11fe60a-8cf3-4393-a746-049cad5d40f6"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:19.157459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:19.158779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:19.159464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:19.160105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:19.160707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:19.170135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.170947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.171981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.172650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.191785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Getting quotas for project d10747b4b0194fb39b32e077d5ca8e49. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:19.197401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Getting quotas for user f378decc1b1a40c89114be1900f54da2 and project d10747b4b0194fb39b32e077d5ca8e49. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:19.210073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:19.212733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:19.320778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bbdd787f-1da7-456e-82a3-ed12501380c6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.449605 Mar 29 02:17:19.321878 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 949/1861] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:19.326700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:19.327718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:19.336394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.337155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.338091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.338678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.391969 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-246470d9-858b-4bc9-8a43-cb44a5ec631b tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.514076 Mar 29 02:17:19.392566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 913/1862] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:18 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:19.397512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:19.398145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:19.413663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.416031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.416031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.416031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.664017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:19.674038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-55e6b59c-aba2-4984-9635-4d60610799d6 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1468 microversion: 2.1 time: 0.280268 Mar 29 02:17:19.675374 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 914/1863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:19 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:19.680054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:19.681027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:19.689819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.690957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.692060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:19.693316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:19.979177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:19.990212 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51150c1d-36b9-440b-8dd2-96cf70e1040c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.667037 Mar 29 02:17:20.004125 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 950/1864] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:19 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:20.011829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:20.012678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:20.020625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:20.021436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:20.022444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:20.023116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:20.030088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:20.041717 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19bee42f-0018-4463-909e-5b2e94676480 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.364782 Mar 29 02:17:20.043266 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 915/1865] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:19 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:20.049337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb50af1c-9c6c-4ce1-b98f-d6acb1380abb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:20.050407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb50af1c-9c6c-4ce1-b98f-d6acb1380abb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:20.190574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb50af1c-9c6c-4ce1-b98f-d6acb1380abb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:20.198684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb50af1c-9c6c-4ce1-b98f-d6acb1380abb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1214 microversion: 2.1 time: 0.153931 Mar 29 02:17:20.203128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 916/1866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:20 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:20.204682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38e5bfdb-5de1-4ac1-86a3-77ed3b088dcb tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8724350c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:20.527553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:20.539580 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05201d83-c7bc-4902-a6f9-7b6131e2247e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.534253 Mar 29 02:17:20.560549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 951/1867] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:20 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:20.567343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1c9f6d52-e93b-4f8c-af58-2344b635d2b9 req-2a232a4f-85cc-430e-8b72-1a7aa574ed91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "f513d80e-5a27-42e8-94fa-8a78a33d2a64"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:20.569438 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:20.569438 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:20.578858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1c9f6d52-e93b-4f8c-af58-2344b635d2b9 req-2a232a4f-85cc-430e-8b72-1a7aa574ed91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:20.582271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1c9f6d52-e93b-4f8c-af58-2344b635d2b9 req-2a232a4f-85cc-430e-8b72-1a7aa574ed91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:20.599673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1c9f6d52-e93b-4f8c-af58-2344b635d2b9 req-2a232a4f-85cc-430e-8b72-1a7aa574ed91 service nova] Creating event network-vif-plugged:f513d80e-5a27-42e8-94fa-8a78a33d2a64 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:20.604887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1c9f6d52-e93b-4f8c-af58-2344b635d2b9 req-2a232a4f-85cc-430e-8b72-1a7aa574ed91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042679 Mar 29 02:17:20.605813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 952/1868] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:20.611647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:20.612553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:20.621665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:20.622359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:20.623307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:20.623894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.150729 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38e5bfdb-5de1-4ac1-86a3-77ed3b088dcb tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e11fe60a-8cf3-4393-a746-049cad5d40f6" status: 202 len: 0 microversion: 2.1 time: 0.950148 Mar 29 02:17:21.151312 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 917/1869] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:20 2022] DELETE /compute/v2.1/os-security-groups/e11fe60a-8cf3-4393-a746-049cad5d40f6 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:21.157684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:21.158471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:21.167328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.179079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.179079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.179079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.358616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:21.369000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fecf7ee6-1cef-45be-a3fd-7fb647c547d4 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.761365 Mar 29 02:17:21.383388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 953/1870] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:20 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:21.392408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-fd16efb1-48db-491d-8187-47e7594d4b49 req-47ed28ec-91b2-4296-bfa1-ce0be4ed9bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59934109-480b-4cd3-83ec-4aaa2b834013", "tag": "00adcd20-6353-4d26-b0ad-9148d7b97d1b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:21.394425 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:21.394425 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:21.405071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fd16efb1-48db-491d-8187-47e7594d4b49 req-47ed28ec-91b2-4296-bfa1-ce0be4ed9bee service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.405806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fd16efb1-48db-491d-8187-47e7594d4b49 req-47ed28ec-91b2-4296-bfa1-ce0be4ed9bee service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.426049 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-fd16efb1-48db-491d-8187-47e7594d4b49 req-47ed28ec-91b2-4296-bfa1-ce0be4ed9bee service nova] Creating event network-changed:00adcd20-6353-4d26-b0ad-9148d7b97d1b for instance 59934109-480b-4cd3-83ec-4aaa2b834013 on n-h2-828148-1 Mar 29 02:17:21.431850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-fd16efb1-48db-491d-8187-47e7594d4b49 req-47ed28ec-91b2-4296-bfa1-ce0be4ed9bee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046385 Mar 29 02:17:21.433699 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 954/1871] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:21.440064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:21.441177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:21.461640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.462393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.463981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.464630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.545430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:21.560744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:21.564412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:21.568537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f82373e-a217-4288-9d01-3589976a9df6 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.416210 Mar 29 02:17:21.571470 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 918/1872] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:21 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:21.579334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:21.579952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:21.601515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.604797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.604797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.604797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.652633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:21.669342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01f6762c-3c7f-4d4a-81bb-53fb00ec1acd tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 200 len: 1297 microversion: 2.1 time: 0.233578 Mar 29 02:17:21.672054 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 955/1873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:21 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 1297 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:21.684581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:21.685734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:21.704075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.721130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:21.724917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:21.725749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.146259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:22.155038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e538e15f-ce37-4892-830d-7a6ee3a3b3d3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.582287 Mar 29 02:17:22.155782 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 919/1874] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:21 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:22.160464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3c648964-9809-4c32-8996-03d428048be9 req-2d259b07-bb07-4340-939d-c26e55822861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c08eee-470e-43ef-b4c8-04f4e1062c6d", "name": "network-vif-deleted", "tag": "48fc5414-e28b-4259-99b1-b18ff6cf0258"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:22.163222 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:22.163222 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:22.172444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3c648964-9809-4c32-8996-03d428048be9 req-2d259b07-bb07-4340-939d-c26e55822861 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.172907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3c648964-9809-4c32-8996-03d428048be9 req-2d259b07-bb07-4340-939d-c26e55822861 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.192406 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3c648964-9809-4c32-8996-03d428048be9 req-2d259b07-bb07-4340-939d-c26e55822861 service nova] Creating event network-vif-deleted:48fc5414-e28b-4259-99b1-b18ff6cf0258 for instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d on n-h2-828148-1 Mar 29 02:17:22.194869 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3c648964-9809-4c32-8996-03d428048be9 req-2d259b07-bb07-4340-939d-c26e55822861 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037690 Mar 29 02:17:22.195781 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 920/1875] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:22.201009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-229dc934-1729-4e49-949c-dfc8a0e98a98 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8724350700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:22.274473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:22.283441 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9b7ec2a9-e5a1-4a69-a6ff-ad2dfeac2902 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.610145 Mar 29 02:17:22.284221 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 956/1876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:21 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:22.304138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:22.304573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:22.319092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.319687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.320674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.320967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.483630 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-229dc934-1729-4e49-949c-dfc8a0e98a98 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/65b042a6-59a7-4ce2-bd4b-86fa911ba194" status: 200 len: 247 microversion: 2.1 time: 0.286436 Mar 29 02:17:22.492617 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 921/1877] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:17:22 2022] GET /compute/v2.1/os-security-groups/65b042a6-59a7-4ce2-bd4b-86fa911ba194 => generated 247 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:22.498235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:22.498917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:22.499066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:22.508016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.508889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.509000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c1b0295-181e-4347-857b-66e5da225857 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1284 microversion: 2.1 time: 0.208622 Mar 29 02:17:22.509383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.509920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.520067 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 957/1878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:22 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:22.525867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:22.526342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:22.534403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.537542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.537542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:22.537542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:22.830328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:22.840041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61c3ee4b-b195-4da0-88f1-017572476ba7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.318217 Mar 29 02:17:22.840977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 958/1879] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:22 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:22.845710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00c46da9-fbd4-43ab-a57e-dec90b825584 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724badd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-620126033", "description": "tempest-description-1026584228"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:22.990154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.002568 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b17bc1b7-d4a9-4cb1-a1a0-b0ea52c32e65 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1502 microversion: 2.1 time: 0.507529 Mar 29 02:17:23.006991 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 922/1880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:22 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1502 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:23.021471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:23.022837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:23.030649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.031359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.032726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.033407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.320580 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00c46da9-fbd4-43ab-a57e-dec90b825584 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.477803 Mar 29 02:17:23.326675 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 959/1881] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:17:22 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:23.328052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a4e135d5-13b7-436b-8219-96ee168f9e77 req-d2106ead-b3a7-44bb-bdd1-32553e6f5b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-unplugged", "status": "completed", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:23.329803 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:23.329803 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:23.339224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a4e135d5-13b7-436b-8219-96ee168f9e77 req-d2106ead-b3a7-44bb-bdd1-32553e6f5b0e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.339996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a4e135d5-13b7-436b-8219-96ee168f9e77 req-d2106ead-b3a7-44bb-bdd1-32553e6f5b0e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.358439 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a4e135d5-13b7-436b-8219-96ee168f9e77 req-d2106ead-b3a7-44bb-bdd1-32553e6f5b0e service nova] Creating event network-vif-unplugged:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:17:23.363755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a4e135d5-13b7-436b-8219-96ee168f9e77 req-d2106ead-b3a7-44bb-bdd1-32553e6f5b0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040855 Mar 29 02:17:23.365666 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 960/1882] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:23.370908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:23.371735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: 55c08eee-470e-43ef-b4c8-04f4e1062c6d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:23.380157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.381301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.382289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.382468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.437944 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] HTTP exception thrown: Instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d could not be found. Mar 29 02:17:23.438577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Returning 404 to user: Instance 55c08eee-470e-43ef-b4c8-04f4e1062c6d could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:23.439419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b1ce8a5-5a9e-4d2b-b805-6695bb947c71 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d" status: 404 len: 111 microversion: 2.1 time: 0.072923 Mar 29 02:17:23.440887 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 961/1883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:23 2022] GET /compute/v2.1/servers/55c08eee-470e-43ef-b4c8-04f4e1062c6d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:23.445215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:23.446122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:23.454064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.454516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.455303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.455747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.674137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.683531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04da4805-09d3-44dd-bde5-a771c8dc9f2b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.242514 Mar 29 02:17:23.696679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 962/1884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:23 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:23.697843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:23.698463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:23.706078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.706529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.707304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.708545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.766523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.782959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.784481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.785706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bf7a877-b05a-4a3e-ab29-ad31d5f04c64 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.777459 Mar 29 02:17:23.787007 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 923/1885] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:23 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:23.795032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e14dc4ae-1b12-44b0-987e-12cb15e11675 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8717d570d0>, body: {"security_group_rule": {"parent_group_id": "d9b3681e-a557-466b-9adc-fa173e8a739f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:23.955520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:23.964709 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5586ce42-6990-4483-8d35-55cd146a0e70 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.270300 Mar 29 02:17:23.965523 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 963/1886] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:23 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:23.969836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:23.973992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:23.978620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.979069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:23.979854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:23.980287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.046227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:24.579514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e14dc4ae-1b12-44b0-987e-12cb15e11675 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.789945 Mar 29 02:17:24.580262 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 924/1887] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:24.585996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:24.586609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:24.596294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.597043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.598032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.598511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.653099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1effc91f-9554-472e-9c34-36ad9e2cf61b tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "DELETE /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 204 len: 0 microversion: 2.1 time: 0.686389 Mar 29 02:17:24.654027 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 964/1888] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:23 2022] DELETE /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:24.659016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:24.659717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:24.674724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.675172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.675959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.676952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.904384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:24.916696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f18cbf7f-024b-495a-a681-c9a37320b2a0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.261280 Mar 29 02:17:24.919496 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 965/1889] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:24 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:24.933484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:24.934126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:24.941811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.942513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:24.943410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:24.944126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:25.167344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:25.177684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2a6b808-93c4-415e-8107-a3873086e893 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.595839 Mar 29 02:17:25.181844 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 925/1890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:24 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:25.189725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a1f98d62-4698-4ef0-bf0d-acf28d1e4dce tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Action: 'create', calling method: .version_select at 0x7f8724d6dc10>, body: {"security_group_rule": {"parent_group_id": "d9b3681e-a557-466b-9adc-fa173e8a739f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:25.336435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:25.354018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ff0696a3-cf7c-4532-8980-f568100424ef tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1477 microversion: 2.1 time: 0.426997 Mar 29 02:17:25.355546 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 966/1891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:24 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1477 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:25.376724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:25.388760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:25.405076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:25.408237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:25.410128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:25.412073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.108133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.126273 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1fc3fa82-4ed5-4e5c-a935-29bca60dfb00 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1468 microversion: 2.1 time: 0.766371 Mar 29 02:17:26.132402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 967/1892] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:25 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1468 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:26.137846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.138829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:26.152889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.152889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.152889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.152889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.215400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a1f98d62-4698-4ef0-bf0d-acf28d1e4dce tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.031991 Mar 29 02:17:26.216415 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 926/1893] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:17:25 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:26.221174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.221883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:26.230407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.231141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.231929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.232367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.405800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.420068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95f1df97-969f-46ac-9c10-656512f39c8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.286257 Mar 29 02:17:26.421463 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 968/1894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:26.427057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.428057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:26.437435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.442563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.442563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.442563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.716402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.724775 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2160ce4f-0d47-4f7b-a9d4-ca482d234e27 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.301977 Mar 29 02:17:26.725365 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 969/1895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:26.729816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8db9f47d-8145-4d7d-b9f9-96eb4c3db468 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '.version_select at 0x7f87240cfe50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.731119 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:26.731119 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:26.732771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db9f47d-8145-4d7d-b9f9-96eb4c3db468 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.733241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db9f47d-8145-4d7d-b9f9-96eb4c3db468 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.742887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8db9f47d-8145-4d7d-b9f9-96eb4c3db468 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1178 microversion: 2.1 time: 0.016431 Mar 29 02:17:26.743456 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 970/1896] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/os-migrations => generated 1178 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:26.747986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "7aeea8a6-cd6f-4214-8003-4d69af2e4528"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "105600a4-c888-4283-8455-59177e972415"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "a390c429-528d-446a-8b2f-5aff166b3a60"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "69740a4c-20a8-4f28-90fa-dcfaf5563c5b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:26.749762 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:26.749762 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:26.758388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.758945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.759564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.770288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.777285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:26.777285 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22f18599-b71d-4508-9152-cee2cb58a882 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.556823 Mar 29 02:17:26.777285 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 927/1897] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:26.777630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Creating event network-vif-plugged:7aeea8a6-cd6f-4214-8003-4d69af2e4528 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:26.777630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Creating event network-vif-plugged:105600a4-c888-4283-8455-59177e972415 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:26.777630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Creating event network-vif-plugged:a390c429-528d-446a-8b2f-5aff166b3a60 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:26.778031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] Creating event network-vif-plugged:69740a4c-20a8-4f28-90fa-dcfaf5563c5b for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:26.781299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.782098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:26.788690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-579aa24c-f4a8-44c4-a6e9-88a3b981b9ff req-9ea67791-7ab4-422a-aa5f-b3a9112d78da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.043768 Mar 29 02:17:26.789497 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 971/1898] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:26.789750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.790162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.790944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.791820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.795067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-bd1f7144-f2ae-4e7b-a0a6-b82558fd5d47 req-f994a0aa-11fa-4e6e-baaa-f5948b488cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a265c13-888e-4d8e-8b07-02db7d873c2e", "tag": "95dabd24-d72b-4610-a210-f5242c98ab21"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:26.797038 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:26.797038 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:26.806234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bd1f7144-f2ae-4e7b-a0a6-b82558fd5d47 req-f994a0aa-11fa-4e6e-baaa-f5948b488cdb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.811740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bd1f7144-f2ae-4e7b-a0a6-b82558fd5d47 req-f994a0aa-11fa-4e6e-baaa-f5948b488cdb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.825250 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-bd1f7144-f2ae-4e7b-a0a6-b82558fd5d47 req-f994a0aa-11fa-4e6e-baaa-f5948b488cdb service nova] Creating event network-changed:95dabd24-d72b-4610-a210-f5242c98ab21 for instance 3a265c13-888e-4d8e-8b07-02db7d873c2e on n-h1-828148-1 Mar 29 02:17:26.830351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-bd1f7144-f2ae-4e7b-a0a6-b82558fd5d47 req-f994a0aa-11fa-4e6e-baaa-f5948b488cdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038942 Mar 29 02:17:26.831388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 972/1899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:26.837229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:26.838378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:26.846916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.847419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:26.848267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:26.848728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.076506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:27.085008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f985205-e547-4c3b-bc2d-d59b5be1ce46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.252425 Mar 29 02:17:27.085585 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 973/1900] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:27.089792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5745ca07-bb8b-4009-9e95-0b696b5f8777 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f87242e8700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:27.131386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:27.140162 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-788eaf1a-6b6c-4d4d-8890-5d10cb8a9a12 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.363518 Mar 29 02:17:27.140738 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 928/1901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:26 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:27.145244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1dbe64e2-b059-421a-8bc4-5a343cfb3464 req-6e2cc294-30ad-457c-8d1b-972c9e6c9053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db329457-1bd1-43c4-a0db-66492ded36c3", "name": "network-vif-deleted", "tag": "54095db4-2740-4c89-9cf8-966244d33752"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:27.147599 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:27.147599 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:27.155487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1dbe64e2-b059-421a-8bc4-5a343cfb3464 req-6e2cc294-30ad-457c-8d1b-972c9e6c9053 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.155929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1dbe64e2-b059-421a-8bc4-5a343cfb3464 req-6e2cc294-30ad-457c-8d1b-972c9e6c9053 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.161016 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5745ca07-bb8b-4009-9e95-0b696b5f8777 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/d9b3681e-a557-466b-9adc-fa173e8a739f" status: 200 len: 664 microversion: 2.1 time: 0.073856 Mar 29 02:17:27.161591 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 974/1902] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:17:27 2022] GET /compute/v2.1/os-security-groups/d9b3681e-a557-466b-9adc-fa173e8a739f => generated 664 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:27.166516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:27.170496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:27.172767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1dbe64e2-b059-421a-8bc4-5a343cfb3464 req-6e2cc294-30ad-457c-8d1b-972c9e6c9053 service nova] Creating event network-vif-deleted:54095db4-2740-4c89-9cf8-966244d33752 for instance db329457-1bd1-43c4-a0db-66492ded36c3 on n-h2-828148-1 Mar 29 02:17:27.175355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.175847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.177270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.177688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.177921 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1dbe64e2-b059-421a-8bc4-5a343cfb3464 req-6e2cc294-30ad-457c-8d1b-972c9e6c9053 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036064 Mar 29 02:17:27.178651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 929/1903] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:27.183599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:27.184289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:27.193361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.193361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.193361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.193361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.262664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.263335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.263548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lazy-loading 'fault' on Instance uuid db329457-1bd1-43c4-a0db-66492ded36c3 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:17:27.375268 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20d4bcbd-99f8-4895-beaf-10fb27b144bb tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1628 microversion: 2.1 time: 0.212371 Mar 29 02:17:27.375904 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 975/1904] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:27 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1628 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:27.400725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-771d7648-20b8-42a6-9fa5-574dc88080ba tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8717fbd3a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:27.463250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '035be210e94e4072b31cb011a5189ee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f9ebef1d2254e5196cc9ae764956d25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:27.473306 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98abad6a-4386-47a1-9a63-380a1af96817 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 200 len: 1302 microversion: 2.1 time: 0.293584 Mar 29 02:17:27.483947 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 930/1905] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:27 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 1302 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:27.489863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:27.491206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:27.501831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.502516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.503904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:27.506912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:27.723103 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-771d7648-20b8-42a6-9fa5-574dc88080ba tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/cd21b2b9-7eb9-40e1-bfdd-828bf6eaffc4" status: 202 len: 0 microversion: 2.1 time: 0.335329 Mar 29 02:17:27.723683 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 976/1906] 10.222.0.36 () {58 vars in 1286 bytes} [Tue Mar 29 02:17:27 2022] DELETE /compute/v2.1/os-security-group-rules/cd21b2b9-7eb9-40e1-bfdd-828bf6eaffc4 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:27.728349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2120810542", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:27.797101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] validate_networks() for [('da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:28.042122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.050826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51a312ef-6a38-41dd-8221-20c599642139 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.565537 Mar 29 02:17:28.052179 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 931/1907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:27 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:28.064540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a9c55bc-97c0-4856-b339-134787bc3631 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8717d579d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:28.347264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:28.347683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:28.348153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:28.348559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:28.348993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:28.357348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.357873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.358712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.359167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.379930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:28.384981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for user 808db28af62c4400b9f28220649f0985 and project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:28.396262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:28.398574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:28.475199 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a9c55bc-97c0-4856-b339-134787bc3631 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d9b3681e-a557-466b-9adc-fa173e8a739f" status: 202 len: 0 microversion: 2.1 time: 0.421572 Mar 29 02:17:28.475806 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 932/1908] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:28 2022] DELETE /compute/v2.1/os-security-groups/d9b3681e-a557-466b-9adc-fa173e8a739f => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:28.480487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:28.481127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:28.489561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.490115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.490766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.491194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.540485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a233bc96-d254-4dd7-8861-3ba47966c698 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815637 Mar 29 02:17:28.546955 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 977/1909] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:28.546955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:28.546955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:28.554553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.555017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.555787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.556228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.722692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.733104 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05b656a4-f248-41a8-85f1-7fe2cc0c7715 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.256248 Mar 29 02:17:28.733981 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 933/1910] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:28 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:28.740831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:28.741558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:28.749071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.749519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.750279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.750708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.823504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.833418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.834932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.836049 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd0ca19b-372a-4df5-840e-4c4c6b505ea2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.293938 Mar 29 02:17:28.836603 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 978/1911] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:28 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:28.841149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:28.841756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:28.852932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.853403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.854158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:28.854593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:28.957856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:28.965968 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a0e2d01-b72e-4cca-829f-8c8379cf90df tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.231030 Mar 29 02:17:28.966532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 934/1912] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:28 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:28.975940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f87243503a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.007694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e11fe60a-8cf3-4393-a746-049cad5d40f6 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:17:29.008647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Neutron security group e11fe60a-8cf3-4393-a746-049cad5d40f6 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:17:29.009318 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] HTTP exception thrown: Security group e11fe60a-8cf3-4393-a746-049cad5d40f6 does not exist Mar 29 02:17:29.009318 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-80d2a149-1d7a-44c4-81ef-bfe1379516bb'] Mar 29 02:17:29.010534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Returning 404 to user: Security group e11fe60a-8cf3-4393-a746-049cad5d40f6 does not exist Mar 29 02:17:29.010534 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-80d2a149-1d7a-44c4-81ef-bfe1379516bb'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:29.012019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62ac90bd-7d39-4943-9a91-74e744d78006 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/e11fe60a-8cf3-4393-a746-049cad5d40f6" status: 404 len: 194 microversion: 2.1 time: 0.040234 Mar 29 02:17:29.012706 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 935/1913] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:28 2022] DELETE /compute/v2.1/os-security-groups/e11fe60a-8cf3-4393-a746-049cad5d40f6 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:29.017686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.018492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] [instance: db329457-1bd1-43c4-a0db-66492ded36c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:29.028631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.029129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.029951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.030955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.059904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:29.069156 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-efec3f3e-0a44-40d3-8346-f0fb5cf81871 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.231496 Mar 29 02:17:29.069816 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 979/1914] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:28 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:29.074188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa934958-d322-4b28-abd8-ac521303d2cf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.074796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa934958-d322-4b28-abd8-ac521303d2cf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:29.094127 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] HTTP exception thrown: Instance db329457-1bd1-43c4-a0db-66492ded36c3 could not be found. Mar 29 02:17:29.094732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] Returning 404 to user: Instance db329457-1bd1-43c4-a0db-66492ded36c3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:29.095556 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4c83b17-374d-4520-bd2e-64a5272e5d81 tempest-MigrationsAdminTest-2120441908 tempest-MigrationsAdminTest-2120441908-project] 10.222.0.36 "GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3" status: 404 len: 111 microversion: 2.1 time: 0.081770 Mar 29 02:17:29.096112 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 936/1915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:29 2022] GET /compute/v2.1/servers/db329457-1bd1-43c4-a0db-66492ded36c3 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:29.101788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-plugged", "status": "completed", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-plugged", "status": "completed", "tag": "17bfdecc-f15d-409d-afb7-2f1f77be3567"}, {"server_uuid": "59934109-480b-4cd3-83ec-4aaa2b834013", "name": "network-vif-plugged", "status": "completed", "tag": "00adcd20-6353-4d26-b0ad-9148d7b97d1b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:29.103217 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:29.103217 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:29.112898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.113377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.132807 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Creating event network-vif-plugged:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:17:29.133334 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Creating event network-vif-plugged:17bfdecc-f15d-409d-afb7-2f1f77be3567 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:29.133869 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] Creating event network-vif-plugged:00adcd20-6353-4d26-b0ad-9148d7b97d1b for instance 59934109-480b-4cd3-83ec-4aaa2b834013 on n-h2-828148-1 Mar 29 02:17:29.143857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa934958-d322-4b28-abd8-ac521303d2cf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:29.145659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f00b3930-4051-41da-bf64-425035d035d9 req-f1c18bd2-25b3-4fa5-be42-9f18d5128ada service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047646 Mar 29 02:17:29.147147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 937/1916] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:29.152967 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa934958-d322-4b28-abd8-ac521303d2cf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1211 microversion: 2.1 time: 0.082012 Mar 29 02:17:29.163837 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 980/1917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:29 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:29.167833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1810e827-fab5-4b8c-bff6-1100fa50b88a tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8717d57670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.168890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.169573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:29.177899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.178412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.179828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.179828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.652528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1810e827-fab5-4b8c-bff6-1100fa50b88a tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/65b042a6-59a7-4ce2-bd4b-86fa911ba194" status: 202 len: 0 microversion: 2.1 time: 0.504193 Mar 29 02:17:29.653132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 938/1918] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:29 2022] DELETE /compute/v2.1/os-security-groups/65b042a6-59a7-4ce2-bd4b-86fa911ba194 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:29.660947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63162e05-e9b4-428e-807f-d729cf8a5eb2 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8724d1b040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.680181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:29.692345 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a647ca78-e5c0-4f1d-83de-05caaef3e6f7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.525506 Mar 29 02:17:29.704497 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 981/1919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:29 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:29.750632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.751344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:29.760236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.762649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.762649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.762649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.973829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:29.982497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-98e0d50c-b837-40fa-aa55-b002886e125b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.235578 Mar 29 02:17:29.983371 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 982/1920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:29 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:29.987924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:29.989251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:29.996677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.997159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:29.997931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:29.998366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.159398 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63162e05-e9b4-428e-807f-d729cf8a5eb2 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c6c46fd8-4e1e-4f65-8f37-a6c3fc3656fe" status: 202 len: 0 microversion: 2.1 time: 0.501808 Mar 29 02:17:30.159973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 939/1921] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:29 2022] DELETE /compute/v2.1/os-security-groups/c6c46fd8-4e1e-4f65-8f37-a6c3fc3656fe => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:30.167037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:30.167830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:30.184401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.184401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.184401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.184401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.263991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.274477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.276012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.277347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e554ebb-b971-473c-bf11-95cfe3e82850 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.292783 Mar 29 02:17:30.277900 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 983/1922] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:29 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:30.292457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:30.293362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:30.300668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.303201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.303201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.303201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.400970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.409319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f4975d97-ec6f-426b-bafd-365685ea7df5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.247535 Mar 29 02:17:30.409881 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 940/1923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:30 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:30.416210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da52f0da-9456-48af-9fb2-0a1a977994d0 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8724d1b040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:30.510139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.521897 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-edcc2328-5056-46d6-861a-7b87bc1dddc0 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1325 microversion: 2.1 time: 0.239747 Mar 29 02:17:30.522594 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 984/1924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:30 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:30.527451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:30.528107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:30.536875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.537392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.538229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.538727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.683354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:30.692589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-83d71d2d-3a75-4412-987a-19002ea5db5a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1263 microversion: 2.1 time: 0.169091 Mar 29 02:17:30.693261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 985/1925] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:30 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:30.709440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:30.716953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:30.717216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.717663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.718496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:30.718936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:30.733620 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da52f0da-9456-48af-9fb2-0a1a977994d0 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/8aae922a-853f-481e-bdd5-a2b8806440b4" status: 202 len: 0 microversion: 2.1 time: 0.321927 Mar 29 02:17:30.738602 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 941/1926] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:30 2022] DELETE /compute/v2.1/os-security-groups/8aae922a-853f-481e-bdd5-a2b8806440b4 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:30.744572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5183d61-8c05-4808-b0bb-e76f0e1f3531 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f872405d820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:31.080417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:31.097299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-442a8120-6093-481a-b5c4-bce2a620c7ae tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.391928 Mar 29 02:17:31.097938 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 986/1927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:30 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:31.111294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:31.115302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:31.125996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.126437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:31.130560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.131036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:31.219187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5183d61-8c05-4808-b0bb-e76f0e1f3531 tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/76f8fd51-8ecf-4e2d-acbe-729a1a9ef1a1" status: 202 len: 0 microversion: 2.1 time: 0.479253 Mar 29 02:17:31.219766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 942/1928] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:30 2022] DELETE /compute/v2.1/os-security-groups/76f8fd51-8ecf-4e2d-acbe-729a1a9ef1a1 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:31.227786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bd05a6cc-916c-4d17-9abc-e6402916871e tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] Calling method '.version_select at 0x7f8717d57ee0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:31.596548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:31.605462 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac1f1bd5-fded-4f36-9dc0-876513e5a109 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1478 microversion: 2.1 time: 0.497824 Mar 29 02:17:31.606166 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 987/1929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:31 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1478 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:31.610832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:31.614223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:31.623268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.623949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:31.624890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.625404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:31.726880 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bd05a6cc-916c-4d17-9abc-e6402916871e tempest-SecurityGroupRulesTestJSON-1939062016 tempest-SecurityGroupRulesTestJSON-1939062016-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/bfcb95ac-b63f-4416-b85b-7687a6cb0ca0" status: 202 len: 0 microversion: 2.1 time: 0.502796 Mar 29 02:17:31.728023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 943/1930] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:17:31 2022] DELETE /compute/v2.1/os-security-groups/bfcb95ac-b63f-4416-b85b-7687a6cb0ca0 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:31.740774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:31.740774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:31.748808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.749316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:31.750119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:31.750585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.067079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.081960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.085225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.086904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d23973a-d28c-4ba2-9443-6e7142bc56f2 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.479527 Mar 29 02:17:32.087719 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 988/1931] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:31 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:32.093414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.094412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.106030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.106359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.106798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.107636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.108062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.115444 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bcb3d3a-d932-4be9-99f1-b1c9fe427a1d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.386043 Mar 29 02:17:32.116624 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 944/1932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:31 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:32.121389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.122933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.131725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.132447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.139347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.139347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.308294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.318402 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec2d8dad-97df-42cd-b6af-c53db30c3038 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1269 microversion: 2.1 time: 0.200489 Mar 29 02:17:32.329126 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 945/1933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:32 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:32.329126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.329126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.335843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.336344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.337085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.337513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.467369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.480425 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58a3d7c6-8658-4bd1-9afb-7f495f0736e7 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1522 microversion: 2.1 time: 0.390971 Mar 29 02:17:32.481330 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 989/1934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:32 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:32.505173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.505672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.513490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.514015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.514699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.515128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.584553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:17:32.813585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:32.819841 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab904be4-1ae4-42d9-afb6-1a8c316426a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.498344 Mar 29 02:17:32.820413 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 946/1935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:32 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:32.826083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.826850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.845107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.845107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.845107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.845107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.923423 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-897922b9-0f92-4b48-a7e3-a203fab11a81 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 204 len: 0 microversion: 2.1 time: 0.422417 Mar 29 02:17:32.924014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 990/1936] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:32 2022] DELETE /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:17:32.933673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:32.934717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:32.943198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.943556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:32.944936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:32.945380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.126266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.135509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee94217b-12d8-4a02-bd62-c5ea2c06e3d1 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1464 microversion: 2.1 time: 0.313860 Mar 29 02:17:33.146290 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 947/1937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:32 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:33.152875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:33.153753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:33.162410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.163068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.163845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.164272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.381410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.390679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8590813b-429c-49e6-9407-16deed997f93 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1528 microversion: 2.1 time: 0.462214 Mar 29 02:17:33.391607 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 991/1938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:32 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1528 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:33.397073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:33.397862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:33.405531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.406222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.407205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.407795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.434087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.447574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.449164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.450472 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6501079e-ddc4-442d-89a2-0ed166bf7b89 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1879 microversion: 2.32 time: 0.303011 Mar 29 02:17:33.451400 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 948/1939] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:33 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1879 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:33.465389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:33.466296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:33.482586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.484579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.485588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.486281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.702539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.717954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84f448dc-d7a1-4463-be59-d4183522b182 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1464 microversion: 2.1 time: 0.265119 Mar 29 02:17:33.718843 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 949/1940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:33 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1464 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:33.734777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:33.737313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:33.745932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.746157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.747093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.750286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.757440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:33.766167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-036eb7eb-d1c4-4d58-ace7-fb2e96ef121c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.373188 Mar 29 02:17:33.776179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 992/1941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:33 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:33.776179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:33.776179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:33.793188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.795147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.796013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:33.796516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:33.950225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:33.950646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:33.951121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:33.951531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:33.951941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:34.111099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:34.133677 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eabf418c-16e6-497f-acd0-a1692e94b8e6 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.413385 Mar 29 02:17:34.134286 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 950/1942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:33 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:34.140143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:34.140755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:34.159151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.159607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.167842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.168299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.328512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:34.350287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.351321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.352815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.353944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.449295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:34.466023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05599dc5-230b-49d5-b0a6-c3e19e095f7b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.323952 Mar 29 02:17:34.467052 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 951/1943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:34 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:34.502127 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e2b6fd3d-1693-443c-b504-91d667578bcc tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 1068 microversion: 2.1 time: 0.724067 Mar 29 02:17:34.503270 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 993/1944] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:33 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 1068 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 29 02:17:34.508868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:34.509473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:34.518898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.520484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.521553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.522370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.653824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffabe570-0165-4946-8ea8-18d280fdf2d6 tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] Calling method '.version_select at 0x7f872405d9d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:34.654325 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:34.654325 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:34.670171 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffabe570-0165-4946-8ea8-18d280fdf2d6 tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.199683 Mar 29 02:17:34.671052 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 952/1945] 10.222.0.36 () {60 vars in 1225 bytes} [Tue Mar 29 02:17:34 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:17:34.676394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:34.677177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:34.687440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.688341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.689134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:34.689570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:34.986603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:34.997553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:34.999161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:35.000437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84ce2c85-20bb-4558-bf5d-7ea3ea351ade tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2831 microversion: 2.32 time: 0.328221 Mar 29 02:17:35.001254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 953/1946] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:17:34 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2831 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:35.006615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:35.010842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:35.016546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.017243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.018267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.018923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.214082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:35.224490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d8b48fe-f4be-48ca-a1d6-929dc8205b23 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1528 microversion: 2.1 time: 0.720617 Mar 29 02:17:35.236909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 994/1947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:34 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1528 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:35.241825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cc71b683-305c-43be-8374-3006c89f1288 req-31b4b742-3b9f-4ec4-9a52-19959be7165a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7781b7-c582-43ee-9cb7-d94dbca08133", "tag": "0d3962b5-57c5-452a-8526-28529acaea6c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:35.243574 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:35.243574 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:35.254859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cc71b683-305c-43be-8374-3006c89f1288 req-31b4b742-3b9f-4ec4-9a52-19959be7165a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.255494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cc71b683-305c-43be-8374-3006c89f1288 req-31b4b742-3b9f-4ec4-9a52-19959be7165a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.299048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:35.307597 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d39a85b-efef-449d-9ef0-a9fbf125e004 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.305086 Mar 29 02:17:35.308205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 954/1948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:35 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:35.312509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bce6ebac-4224-4633-b1f1-10fc8ae56ecb tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] Action: 'update', calling method: .version_select at 0x7f8717d57ee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:35.314982 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:35.314982 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:35.337922 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cc71b683-305c-43be-8374-3006c89f1288 req-31b4b742-3b9f-4ec4-9a52-19959be7165a service nova] Creating event network-changed:0d3962b5-57c5-452a-8526-28529acaea6c for instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 on n-h2-828148-1 Mar 29 02:17:35.342665 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cc71b683-305c-43be-8374-3006c89f1288 req-31b4b742-3b9f-4ec4-9a52-19959be7165a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104371 Mar 29 02:17:35.343369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 995/1949] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:35.348504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:35.349269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:35.356737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.357242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.358010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.358466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.928463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:35.937206 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24802256-74d1-4ce5-916d-93db90d12230 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.592588 Mar 29 02:17:35.937973 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 996/1950] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:35 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:35.942936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:35.943460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:35.950735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.951115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:35.951888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:35.952318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.045659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bce6ebac-4224-4633-b1f1-10fc8ae56ecb tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.736379 Mar 29 02:17:36.046465 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 955/1951] 10.222.0.36 () {62 vars in 1246 bytes} [Tue Mar 29 02:17:35 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:17:36.052508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:36.053389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:36.061478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.061985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.062977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.063632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.297883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:36.307046 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dff7113d-76f2-40fc-b003-9a9dee524cad tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.258892 Mar 29 02:17:36.316327 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 956/1952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:36 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:36.321975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3317453a-8f69-4711-9f13-947e6e3bdc90 req-18e68cdd-c8d9-42a9-b9e7-f8165f4ce987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a265c13-888e-4d8e-8b07-02db7d873c2e", "name": "network-vif-plugged", "status": "completed", "tag": "95dabd24-d72b-4610-a210-f5242c98ab21"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:36.323391 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:36.323391 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:36.331742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3317453a-8f69-4711-9f13-947e6e3bdc90 req-18e68cdd-c8d9-42a9-b9e7-f8165f4ce987 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.332307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3317453a-8f69-4711-9f13-947e6e3bdc90 req-18e68cdd-c8d9-42a9-b9e7-f8165f4ce987 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.340800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31a6ae11-ba85-45a3-80da-542ae89da305 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.401383 Mar 29 02:17:36.342153 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 997/1953] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:17:35 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1/os-interface => generated 1830 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:17:36.353643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:36.354461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3317453a-8f69-4711-9f13-947e6e3bdc90 req-18e68cdd-c8d9-42a9-b9e7-f8165f4ce987 service nova] Creating event network-vif-plugged:95dabd24-d72b-4610-a210-f5242c98ab21 for instance 3a265c13-888e-4d8e-8b07-02db7d873c2e on n-h1-828148-1 Mar 29 02:17:36.354818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:36.359843 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3317453a-8f69-4711-9f13-947e6e3bdc90 req-18e68cdd-c8d9-42a9-b9e7-f8165f4ce987 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041771 Mar 29 02:17:36.364608 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 957/1954] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:36.365360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.365647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.366779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.367481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.372150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34659bee-edf2-4031-9ee5-1cc005a24292 tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] Calling method '.version_select at 0x7f8724d1b5e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:36.375207 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:36.375207 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:36.395836 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34659bee-edf2-4031-9ee5-1cc005a24292 tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.032154 Mar 29 02:17:36.397058 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 958/1955] 10.222.0.36 () {60 vars in 1225 bytes} [Tue Mar 29 02:17:36 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:17:36.406101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:36.410040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:36.418815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.419272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.420090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.420568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.700304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff0139c538f4391bd0b5eb0c42f11a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcc43a2a688544ab9ac5ce25ed7ed809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:36.714926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44909beb-2468-479d-92b6-82aed4388348 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 200 len: 1486 microversion: 2.1 time: 0.316412 Mar 29 02:17:36.716163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 959/1956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:36 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 1486 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:36.728068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:36.728687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:36.737437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.737880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:36.739182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:36.739610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.009316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:37.029992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74351e86-c99d-4d57-84ea-f5568ba2391b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.312490 Mar 29 02:17:37.040319 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 960/1957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:36 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:37.040319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e948a6e-2338-449d-a708-6608f72b1f7e tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] Action: 'update', calling method: .version_select at 0x7f872405d280>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:37.042487 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-quota-class-sets:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:37.042487 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:37.225660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:37.233813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30b36fb7-8dbd-4b15-8d49-4b2b7b359560 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.890228 Mar 29 02:17:37.243163 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 998/1958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:36 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:37.248046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:37.248712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:37.256123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.256566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.257389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.257809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.612796 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e948a6e-2338-449d-a708-6608f72b1f7e tempest-QuotaClassesAdmin257Test-623953814 tempest-QuotaClassesAdmin257Test-623953814-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.580975 Mar 29 02:17:37.621430 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 961/1959] 10.222.0.36 () {62 vars in 1246 bytes} [Tue Mar 29 02:17:37 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:17:37.621430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:37.621430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:37.627007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.627453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.628220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.629165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.863948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:37.872493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75f4ff5a-6237-4aac-9efa-640265814dc2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1314 microversion: 2.1 time: 0.627982 Mar 29 02:17:37.877217 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 999/1960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:37 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:37.886831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-720689df-2422-466c-97ad-cac99877f0e7 req-2bb383c6-4791-4ae4-8de4-acfb48bedb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59934109-480b-4cd3-83ec-4aaa2b834013", "name": "network-vif-deleted", "tag": "00adcd20-6353-4d26-b0ad-9148d7b97d1b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:37.888625 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:37.888625 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:37.897931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:37.906710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-720689df-2422-466c-97ad-cac99877f0e7 req-2bb383c6-4791-4ae4-8de4-acfb48bedb88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.908655 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fce8e4f-48ea-4a51-b0a0-6fc3913fc739 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.293216 Mar 29 02:17:37.910809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-720689df-2422-466c-97ad-cac99877f0e7 req-2bb383c6-4791-4ae4-8de4-acfb48bedb88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.910961 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 962/1961] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:37 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:37.923990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:37.923990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 59934109-480b-4cd3-83ec-4aaa2b834013] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:37.925099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.926870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.927739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:37.928334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:37.945740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-720689df-2422-466c-97ad-cac99877f0e7 req-2bb383c6-4791-4ae4-8de4-acfb48bedb88 service nova] Creating event network-vif-deleted:00adcd20-6353-4d26-b0ad-9148d7b97d1b for instance 59934109-480b-4cd3-83ec-4aaa2b834013 on n-h2-828148-1 Mar 29 02:17:37.959024 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-720689df-2422-466c-97ad-cac99877f0e7 req-2bb383c6-4791-4ae4-8de4-acfb48bedb88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080425 Mar 29 02:17:37.959650 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1000/1962] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:38.052067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:38.053664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:38.064812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.065773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:38.068070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.069077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:38.168372 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance 59934109-480b-4cd3-83ec-4aaa2b834013 could not be found. Mar 29 02:17:38.169270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance 59934109-480b-4cd3-83ec-4aaa2b834013 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:38.170508 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5592c6da-158f-4f6a-9343-be2105eec0be tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013" status: 404 len: 111 microversion: 2.1 time: 0.259450 Mar 29 02:17:38.171234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 963/1963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:37 2022] GET /compute/v2.1/servers/59934109-480b-4cd3-83ec-4aaa2b834013 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:38.406153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:38.412076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-605234700", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "ee73fc18-be50-4eb7-83d5-03673a6b755d"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:38.427859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-957a3a73-66d6-44e8-828a-77bc9d85e9b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.379768 Mar 29 02:17:38.428702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1001/1964] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:38 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:38.435005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a0cde97-3e25-4266-910e-b3a70dc0c6b2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f87240cf790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:38.481140 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2a0cde97-3e25-4266-910e-b3a70dc0c6b2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Image not found. Mar 29 02:17:38.481140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a0cde97-3e25-4266-910e-b3a70dc0c6b2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:38.481140 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a0cde97-3e25-4266-910e-b3a70dc0c6b2 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e" status: 404 len: 62 microversion: 2.1 time: 0.048701 Mar 29 02:17:38.481140 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1002/1965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:38 2022] DELETE /compute/v2.1/images/ed188a22-20c6-4ecc-9324-ef9357e5957e => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:17:38.485711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:38.486657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:38.496036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.496814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:38.497878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.498614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:38.528702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] validate_networks() for [('ee73fc18-be50-4eb7-83d5-03673a6b755d', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:38.970838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:38.979628 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68a84806-c038-47a7-9407-5e5592792b12 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.499490 Mar 29 02:17:38.980206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1003/1966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:38 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:38.985091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:38.985806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:38.996216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.997060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:38.998044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:38.998687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.049831 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. Mar 29 02:17:39.051091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:39.052116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60011606-5c35-47a7-8f24-f36910293e9f tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 404 len: 111 microversion: 2.1 time: 0.070552 Mar 29 02:17:39.052671 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1004/1967] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:38 2022] DELETE /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:39.057932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:39.058700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:39.065896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.066406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.067177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.067965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.269328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:39.269830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:39.270204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:39.270676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:39.271082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:39.279628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.280068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.280892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.281328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.303020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Getting quotas for project 90474fce71f04040b0774dffcdcc49f9. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:39.308640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Getting quotas for user 7ec4aa0cd2914f1c9b92c7abf0fc8bed and project 90474fce71f04040b0774dffcdcc49f9. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:39.329323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:39.331732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:39.502867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:39.512371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5e5aec8-a98c-404e-9dcb-eded6e0188da tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1499 microversion: 2.1 time: 0.458483 Mar 29 02:17:39.515634 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1005/1968] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:39 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1499 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:39.531409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:39.532268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:39.544631 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66c7f301-eedb-4b36-9519-635e187cf8d3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372155 Mar 29 02:17:39.545390 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 964/1969] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:39.545930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.546677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.547895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.548549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.559585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:39.560264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: b91e2442-2015-450c-bee0-3a35f2a97010] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:39.578864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.580658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.585003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.585465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.677619 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. Mar 29 02:17:39.678293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance b91e2442-2015-450c-bee0-3a35f2a97010 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:39.679126 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4321263a-e6ae-4dad-97f6-0f416ad199ec tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010" status: 404 len: 111 microversion: 2.1 time: 0.132578 Mar 29 02:17:39.680163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 965/1970] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:39 2022] GET /compute/v2.1/servers/b91e2442-2015-450c-bee0-3a35f2a97010 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:39.685298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:39.685908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:39.695172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.702116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.702116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.702116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.932709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:39.941159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af8ceb02-fe56-4a46-8cbb-1b033fe3f038 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.259897 Mar 29 02:17:39.941944 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 966/1971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:39 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:39.946482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:39.947668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:39.954755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.955205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:39.955980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:39.956416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.016872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lazy-loading 'flavor' on Instance uuid 3a265c13-888e-4d8e-8b07-02db7d873c2e {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:17:40.088751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:40.099018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7bbb77a3-d727-4ced-aa23-3e8c58f7c191 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.581659 Mar 29 02:17:40.109393 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1006/1972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:39 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:40.115318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a49d34df-3920-4bc2-ad97-0aa767724eb5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:40.116363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a49d34df-3920-4bc2-ad97-0aa767724eb5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:40.203311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a49d34df-3920-4bc2-ad97-0aa767724eb5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:40.211234 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a49d34df-3920-4bc2-ad97-0aa767724eb5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1216 microversion: 2.1 time: 0.100108 Mar 29 02:17:40.212074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1007/1973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:40 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:40.216456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b431dc13-6a49-47c5-b5b7-9726566a3844 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f8724d17790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:40.358831 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b431dc13-6a49-47c5-b5b7-9726566a3844 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-350972814" status: 202 len: 0 microversion: 2.1 time: 0.145548 Mar 29 02:17:40.360046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1008/1974] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:17:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-350972814 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:40.366237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4134a525-6f07-463a-8a5d-0c1863d248b1 req-d1fa8808-24c8-471c-bae8-330a14a5a845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "tag": "f513d80e-5a27-42e8-94fa-8a78a33d2a64"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:40.367132 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:40.367132 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:17:40.382054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4134a525-6f07-463a-8a5d-0c1863d248b1 req-d1fa8808-24c8-471c-bae8-330a14a5a845 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.382661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4134a525-6f07-463a-8a5d-0c1863d248b1 req-d1fa8808-24c8-471c-bae8-330a14a5a845 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.455205 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4134a525-6f07-463a-8a5d-0c1863d248b1 req-d1fa8808-24c8-471c-bae8-330a14a5a845 service nova] Creating event network-changed:f513d80e-5a27-42e8-94fa-8a78a33d2a64 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:17:40.464688 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4134a525-6f07-463a-8a5d-0c1863d248b1 req-d1fa8808-24c8-471c-bae8-330a14a5a845 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103313 Mar 29 02:17:40.470032 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1009/1975] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:40.493971 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-128dfd5b-7de2-4548-a1e3-98e42dcaec46 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "POST /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e/action" status: 200 len: 32 microversion: 2.1 time: 0.550934 Mar 29 02:17:40.495242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 967/1976] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:39 2022] POST /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:17:40.520607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:40.521493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:40.524690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:40.528388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:40.538592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.540438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.541455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.542053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.543801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.544315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.545427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.546033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.883169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:40.897075 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-755ed264-f02a-41df-b9ab-5596a2804d91 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.424780 Mar 29 02:17:40.897943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1010/1977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:40 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:40.957082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:40.958057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:40.966109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.966866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:40.969839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:40.969839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:41.486829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:41.495527 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0fe90be-66c0-4144-b7e3-c6496c65b942 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.983011 Mar 29 02:17:41.500939 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 968/1978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:40 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:41.509530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:41.510143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:41.530669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:41.531011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:41.531942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:41.532387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:41.913465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:41.923545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8246a1f2-a8c8-4941-9d44-2866d58ed6bf tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.969123 Mar 29 02:17:41.924130 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1011/1979] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:40 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:41.929850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:41.930470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:41.938917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:41.939362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:41.940331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:41.941029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.150488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:42.158581 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d48663a1-ffad-42ba-a0f8-e58f80e44d8d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1268 microversion: 2.1 time: 0.233390 Mar 29 02:17:42.159501 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1012/1980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:41 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:42.166586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.167489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:42.178989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.179446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.180238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.180911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.268899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:42.281947 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bb799985-845e-43c0-99c3-bbe5303fed6e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.779340 Mar 29 02:17:42.285727 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 969/1981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:41 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:42.292887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fd2dc5d9-f905-4b8c-9604-a602e564495f req-2a2e31b2-88d9-459a-905c-a9bab24c197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7781b7-c582-43ee-9cb7-d94dbca08133", "name": "network-vif-plugged", "status": "completed", "tag": "0d3962b5-57c5-452a-8526-28529acaea6c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:42.298764 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:42.298764 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:42.307327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd2dc5d9-f905-4b8c-9604-a602e564495f req-2a2e31b2-88d9-459a-905c-a9bab24c197b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.308125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd2dc5d9-f905-4b8c-9604-a602e564495f req-2a2e31b2-88d9-459a-905c-a9bab24c197b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.330213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fd2dc5d9-f905-4b8c-9604-a602e564495f req-2a2e31b2-88d9-459a-905c-a9bab24c197b service nova] Creating event network-vif-plugged:0d3962b5-57c5-452a-8526-28529acaea6c for instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 on n-h2-828148-1 Mar 29 02:17:42.337743 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fd2dc5d9-f905-4b8c-9604-a602e564495f req-2a2e31b2-88d9-459a-905c-a9bab24c197b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049268 Mar 29 02:17:42.338231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 970/1982] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:42.346881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44ffa0a4-5e8c-4f2d-b4a2-04f6c63ccfb9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '.version_select at 0x7f87242e94c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.383850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-44ffa0a4-5e8c-4f2d-b4a2-04f6c63ccfb9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Image not found. Mar 29 02:17:42.383850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44ffa0a4-5e8c-4f2d-b4a2-04f6c63ccfb9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:42.383850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44ffa0a4-5e8c-4f2d-b4a2-04f6c63ccfb9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/images/d62b2fdc-f65e-4b00-bd1f-58e5f156ba41" status: 404 len: 62 microversion: 2.1 time: 0.041329 Mar 29 02:17:42.383850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 971/1983] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:42 2022] DELETE /compute/v2.1/images/d62b2fdc-f65e-4b00-bd1f-58e5f156ba41 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:17:42.391681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.392856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:42.406376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.407311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.409083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.410533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.473997 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. Mar 29 02:17:42.474928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:42.475938 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e20f4f62-fb07-4579-a598-0f5838b0b1b9 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 404 len: 111 microversion: 2.1 time: 0.088583 Mar 29 02:17:42.477011 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 972/1984] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:17:42 2022] DELETE /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:17:42.484640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.485531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] [instance: 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:42.495009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.495780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.497412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.498241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.536521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:42.562389 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bbb4a20d-81a1-4016-b8e3-9857fb601c27 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.393945 Mar 29 02:17:42.564323 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] HTTP exception thrown: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. Mar 29 02:17:42.565320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] Returning 404 to user: Instance 4cbf5ec3-94f8-4cd9-8c97-cfead97c717f could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:17:42.566962 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be0574bb-9ab4-4efb-b694-899fdebd6f36 tempest-ImagesOneServerNegativeTestJSON-134348060 tempest-ImagesOneServerNegativeTestJSON-134348060-project] 10.222.0.36 "GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f" status: 404 len: 111 microversion: 2.1 time: 0.086158 Mar 29 02:17:42.568021 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 973/1985] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:42 2022] GET /compute/v2.1/servers/4cbf5ec3-94f8-4cd9-8c97-cfead97c717f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:17:42.573229 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1013/1986] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:42 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:42.574931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.575837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:42.585234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.586001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.587158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.587765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.930056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:42.940904 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12ef1084-05f5-4185-8637-34fef65e7609 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.371260 Mar 29 02:17:42.942688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:42.943924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:42.957526 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 974/1987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:42 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:42.966251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.966964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:42.968452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:42.969155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.178436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:43.179531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:43.203262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.203972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.204944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.205576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.430227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:43.430227 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13bdcafb-d7f1-4966-83f7-65cfabe31ce0 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1274 microversion: 2.1 time: 0.231210 Mar 29 02:17:43.430227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 975/1988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:43 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1274 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:43.430227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:43.432022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:43.432022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.432022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.432022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.433114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.444950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:43.455063 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cc92783-78c8-4c99-ad92-a855cf7684e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.516620 Mar 29 02:17:43.455642 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1014/1989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:42 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:43.575127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:43.576315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:43.592700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.593817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.594869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:43.596502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:43.720292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:43.730123 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1d613f8-47d2-4654-9c3a-9bac6db27f43 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1311 microversion: 2.1 time: 0.325191 Mar 29 02:17:43.730963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 976/1990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:43 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:43.965909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1290703947", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:44.034402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:44.058953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:44.070567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70da2994-ce89-4745-a447-09610c6d8c4d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.501451 Mar 29 02:17:44.072137 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1015/1991] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:43 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:44.077291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:44.078070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:44.087350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.087813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.089423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.089892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.390234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:44.399553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-16f57208-8d33-40b8-914e-a8f67f9c5853 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.326161 Mar 29 02:17:44.400135 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1016/1992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:44 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:44.428668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:44.429429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:44.437306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.437751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.438770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.439205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.569051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:44.569615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:44.570097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:44.570574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:44.571358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:44.580542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.581133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.582719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.583221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.601821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Getting quotas for project 0e43e0064c06475789bff466e2d4e943. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:44.607420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Getting quotas for user 03e0dac11d8b4f7cbb34140781eed3b9 and project 0e43e0064c06475789bff466e2d4e943. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:44.621126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:44.624201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:44.744647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-630cd57a-aa00-4ca9-8ef9-33dd53c14ea1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930020 Mar 29 02:17:44.748283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 977/1993] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:17:44.753439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:44.754550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:44.761879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.762316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.763902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.764491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.946274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:44.958265 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb3e133d-664f-4e3f-ba5a-0592eac47202 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.533116 Mar 29 02:17:44.960890 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1017/1994] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:44 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:44.965230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:44.965834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:44.977702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.983451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:44.983451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:44.983451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.008687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:45.017324 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78d661a3-3f08-4c48-a204-a79de1f78684 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.267773 Mar 29 02:17:45.027387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 978/1995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:44 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:45.032410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f7b8d528-a06e-4c35-922a-05d8d6bd3aa9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.033272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f7b8d528-a06e-4c35-922a-05d8d6bd3aa9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:45.111903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f7b8d528-a06e-4c35-922a-05d8d6bd3aa9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:45.119821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f7b8d528-a06e-4c35-922a-05d8d6bd3aa9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1222 microversion: 2.1 time: 0.091198 Mar 29 02:17:45.120383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 979/1996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:45.124774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.125397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:45.133177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.133619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.134385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.134805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.337960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:45.346025 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3af4f791-576a-43a0-bb48-42b7bade044a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.224571 Mar 29 02:17:45.346588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 980/1997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:45.370557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:45.379992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f32bbf79-a17c-411b-a08b-db6ef9b799fc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1493 microversion: 2.1 time: 0.418053 Mar 29 02:17:45.381176 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1018/1998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:44 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1493 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:45.397563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.398516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:45.406216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.411629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.411629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.411629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.419078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.419796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:45.430796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.430796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.430796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.431709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.712983 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee904dbd-cf10-4837-a72f-f2048ea43dba tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1644 microversion: 2.1 time: 0.319422 Mar 29 02:17:45.713540 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 981/1999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1644 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:45.728619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.730170 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:45.730170 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:45.731666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.732115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.732940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.733376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.772938 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ca3d447-8d0f-41d4-aab4-d93eee3a963d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047719 Mar 29 02:17:45.778236 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 982/2000] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:17:45.811606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:45.821576 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee8e19dd-2c7d-4eea-b1bc-dde1809e5ddb tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.408223 Mar 29 02:17:45.822781 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1019/2001] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:45.986044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:45.986044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:45.991680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.992545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:45.994045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:45.994823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.035917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:46.036564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:46.047277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.047731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.048975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.049589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.392501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:46.404790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29b63a3b-457d-4e9c-a7f4-b1596ec9ed8f tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.430822 Mar 29 02:17:46.405538 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 983/2002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:45 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:46.423662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:46.426621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:46.440176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.440962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.441994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.442206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:46.442802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.453046 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d128df8-4d3e-430c-a5e7-b56f97bcaae8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.421921 Mar 29 02:17:46.453959 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1020/2003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:46 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:46.459131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:46.459731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:46.468609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.469130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.470128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.470552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.629435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:46.640831 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1b1dad0a-f529-4efc-908d-e5870a5dcfd8 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1218 microversion: 2.1 time: 0.233687 Mar 29 02:17:46.647402 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 984/2004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:46 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1218 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:46.652304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3d449ccc-16f0-4815-95db-59ac6174436f req-c11ff010-593e-4a90-bede-9037e275e690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76dcbdbd-fa81-4297-a389-6795b4c9d1e9", "tag": "431acba1-567e-4716-b6b7-9f46cc0b932e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:46.653807 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:46.653807 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:46.670379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3d449ccc-16f0-4815-95db-59ac6174436f req-c11ff010-593e-4a90-bede-9037e275e690 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.671043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3d449ccc-16f0-4815-95db-59ac6174436f req-c11ff010-593e-4a90-bede-9037e275e690 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.751662 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3d449ccc-16f0-4815-95db-59ac6174436f req-c11ff010-593e-4a90-bede-9037e275e690 service nova] Creating event network-changed:431acba1-567e-4716-b6b7-9f46cc0b932e for instance 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 on n-h2-828148-1 Mar 29 02:17:46.764538 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3d449ccc-16f0-4815-95db-59ac6174436f req-c11ff010-593e-4a90-bede-9037e275e690 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115161 Mar 29 02:17:46.765915 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 985/2005] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:46.809153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:46.818233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11492296-cfdd-4cf6-9813-4af2908b3782 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1513 microversion: 2.1 time: 0.363206 Mar 29 02:17:46.819026 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1021/2006] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:46 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:46.838692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:46.839393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:46.846960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.847738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:46.848187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:46.848618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.082432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:47.096314 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8769944c-c797-49b8-93b0-9b24033086d3 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.257809 Mar 29 02:17:47.096314 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 986/2007] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:46 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:47.422653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:47.423363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:47.435733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.436417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.437230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.444047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.469930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:47.470462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:47.477811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.478510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.479479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.480077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.795417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:47.795417 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f5f73f3-5fa4-425f-b185-c6f8ff457139 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.321688 Mar 29 02:17:47.795417 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 987/2008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:47 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:47.822503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:47.822503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:47.842299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.855911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:47.857273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:47.861596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.025924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:48.033790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fb681f5-a9c3-4f06-bd6b-badba780fc7d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1292 microversion: 2.1 time: 0.244218 Mar 29 02:17:48.035734 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 988/2009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:47 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1292 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:48.042873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:48.043080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:48.052120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.059261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.059261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.059261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.278880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:48.288144 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e45260c-2cd1-4696-a05e-42d0477a91cc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1490 microversion: 2.1 time: 0.251317 Mar 29 02:17:48.288653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 989/2010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:48 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1490 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:48.309933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:48.315319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:48.315499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:48.315691 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85d065ef-b688-4a9e-8d88-30cc3e9cf687 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.896694 Mar 29 02:17:48.316456 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1022/2011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:47 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:48.329451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:48.329451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:48.332019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.332019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.332019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.332019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.334965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.334965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.335521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.336878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.448039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-026954c9-2cf8-472a-b2f4-f7e098ccb871 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 200 len: 147 microversion: 2.1 time: 0.130394 Mar 29 02:17:48.449268 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1023/2012] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:48 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 147 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:48.468763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:48.468763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:48.481697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.481697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.481697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.481697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.605990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:48.605990 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59a41b0d-9333-47d9-8080-a9c96babec23 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.296980 Mar 29 02:17:48.605990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 990/2013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:48 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:48.807631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:48.817258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:48.829577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.829577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:48.829577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:48.829577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.107635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:49.120994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c439784f-5991-4ba7-9a49-64623401e293 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.666111 Mar 29 02:17:49.121790 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1024/2014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:48 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:49.144554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "225ef829-d35d-483a-9bca-0af30e220da7", "device": "/dev/xvdb"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:49.144554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:49.162376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.162376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.168994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.168994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.209068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:49.218564 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b09b83e-1449-48e0-9266-7845880280b4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.412031 Mar 29 02:17:49.218564 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 991/2015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:48 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:49.223296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:49.223857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:49.240126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.240654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.241480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.241989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.359378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:49.368860 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0717ff5c-02f5-4e37-8848-50472a530db5 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1280 microversion: 2.1 time: 0.149605 Mar 29 02:17:49.372899 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 992/2016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:49 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1280 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:49.378365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:49.378980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:49.388921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.388921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.388921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.389391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.618856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:49.631060 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c07326b2-3c77-4752-a8e3-1acc2a620c79 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.257003 Mar 29 02:17:49.631779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 993/2017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:49 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:49.637154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:49.638230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:49.646369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.646826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.647616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.648185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.868533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:49.876918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e43ea2f1-8240-41d2-9784-73fe568bcc43 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.243671 Mar 29 02:17:49.887004 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 994/2018] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:49 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:49.887004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53086bfa-177b-4558-a679-82e7b2058158 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717e55c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:49.936394 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53086bfa-177b-4558-a679-82e7b2058158 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f" status: 200 len: 662 microversion: 2.1 time: 0.057732 Mar 29 02:17:49.937012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 995/2019] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:49 2022] GET /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:49.952242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:49.953028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:49.960742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.961466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:49.962261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:49.962702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.139454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3dd1b52-05db-41f6-8590-3bb5dd732f07 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "POST /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.011683 Mar 29 02:17:50.140734 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1025/2020] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:17:49 2022] POST /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:50.161692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:50.162934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:50.177046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.180283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.180283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.180283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.328597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:50.336282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4570550-74a4-4f79-900b-a2f7b01a1be2 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.389854 Mar 29 02:17:50.337240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 996/2021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:49 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:50.341545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-68564d99-1005-4f24-b2ff-0c033b7e60c4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d5caf0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:50.396408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-68564d99-1005-4f24-b2ff-0c033b7e60c4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f" status: 200 len: 662 microversion: 2.1 time: 0.058112 Mar 29 02:17:50.400984 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 997/2022] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:50 2022] GET /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f => generated 662 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:50.416092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:50.416708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:50.434645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.435232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.437357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.437357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.622148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:50.651356 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-995c36a8-cdb0-4a99-8246-7cbedbc28703 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.509207 Mar 29 02:17:50.654713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1026/2023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:50 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:50.667813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:50.670862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:50.689418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:50.694902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.696013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.698177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.700879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.701226 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b76c07ee-4c6e-4de5-9b38-4b04c1bf2b94 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.298854 Mar 29 02:17:50.701987 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 998/2024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:50 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:50.713972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:50.715114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:50.734750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.739351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:50.741093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:50.741741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:51.051467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:51.076414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9abdbbde-9706-4cca-b4d9-c75bfb0225be tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.371164 Mar 29 02:17:51.080925 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 999/2025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:50 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:51.089307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:51.089936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:51.110264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:51.113034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:51.113862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:51.114301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:51.539372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:51.559675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88118423-a63c-4e65-a001-8858e6d65ae9 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.476982 Mar 29 02:17:51.575187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1000/2026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:51 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:51.591382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-79956529", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9222f6f3-d189-4e16-8c8f-3078bec78258"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:51.745818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] validate_networks() for [('9222f6f3-d189-4e16-8c8f-3078bec78258', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:52.013307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:52.024369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-106db5fc-595a-472b-a66d-24c639369037 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 1.368314 Mar 29 02:17:52.025603 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1027/2027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:50 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:52.032683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:52.034002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:52.066211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.068229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.071613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.071990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.736322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:52.757078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f966cd54-932a-48a9-ba23-79989b831b6d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.726468 Mar 29 02:17:52.757078 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1028/2028] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:52 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:52.761939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:52.763770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:52.776755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.776755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.777159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.777596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.888087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:52.888633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:52.889126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:52.889597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:52.890512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:52.901870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.902419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.903278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:52.903774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:52.922557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:52.930964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:52.943011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:52.945306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:53.072963 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-784bec69-0c81-48d7-ad6b-fec563ef8a81 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.496595 Mar 29 02:17:53.073672 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1001/2029] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:53.097988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-644cbf8e-54e1-444f-a422-380fa9d9f8ad req-c55d9501-f981-4823-a21c-0dae0790eaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76dcbdbd-fa81-4297-a389-6795b4c9d1e9", "name": "network-vif-plugged", "status": "completed", "tag": "431acba1-567e-4716-b6b7-9f46cc0b932e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:53.097988 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:53.097988 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:53.097988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-644cbf8e-54e1-444f-a422-380fa9d9f8ad req-c55d9501-f981-4823-a21c-0dae0790eaea service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.097988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-644cbf8e-54e1-444f-a422-380fa9d9f8ad req-c55d9501-f981-4823-a21c-0dae0790eaea service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.108434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-644cbf8e-54e1-444f-a422-380fa9d9f8ad req-c55d9501-f981-4823-a21c-0dae0790eaea service nova] Creating event network-vif-plugged:431acba1-567e-4716-b6b7-9f46cc0b932e for instance 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 on n-h2-828148-1 Mar 29 02:17:53.113112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-644cbf8e-54e1-444f-a422-380fa9d9f8ad req-c55d9501-f981-4823-a21c-0dae0790eaea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038037 Mar 29 02:17:53.114566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1002/2030] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:53.128600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b19d08c-f4d7-48c8-ae6d-ca08d3ba681a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87242e9e50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.189872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b19d08c-f4d7-48c8-ae6d-ca08d3ba681a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc" status: 200 len: 662 microversion: 2.1 time: 0.063770 Mar 29 02:17:53.189872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1003/2031] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc => generated 662 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:53.189872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.189872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:53.196732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.197163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.198148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.198347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.410473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:53.413671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:53.421001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc9c775b-c23d-4866-9110-0436f31be192 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.665444 Mar 29 02:17:53.421762 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1029/2032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:52 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:53.431551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6cd0eb45-c270-4c60-a975-06e182471d36 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.238478 Mar 29 02:17:53.431551 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1004/2033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:53.431551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-73b3d150-8016-480a-8493-f44778ace245 req-8d6525c0-89fe-4d8e-995b-e39b2f791896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f587694-428a-4d10-859d-5d981bb0753c", "tag": "037948f4-c2c8-40f9-9fac-2aca2c7fb5f5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:53.431551 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:53.431551 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:53.437437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.439162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:53.439293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-73b3d150-8016-480a-8493-f44778ace245 req-8d6525c0-89fe-4d8e-995b-e39b2f791896 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.439659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-73b3d150-8016-480a-8493-f44778ace245 req-8d6525c0-89fe-4d8e-995b-e39b2f791896 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.457619 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-73b3d150-8016-480a-8493-f44778ace245 req-8d6525c0-89fe-4d8e-995b-e39b2f791896 service nova] Creating event network-changed:037948f4-c2c8-40f9-9fac-2aca2c7fb5f5 for instance 7f587694-428a-4d10-859d-5d981bb0753c on n-h2-828148-1 Mar 29 02:17:53.461088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.461607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.462397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.462841 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-73b3d150-8016-480a-8493-f44778ace245 req-8d6525c0-89fe-4d8e-995b-e39b2f791896 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038416 Mar 29 02:17:53.463506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1005/2034] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:53.469522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66d0216a-8034-41a6-aeaa-ddd5ae965e38 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.470336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66d0216a-8034-41a6-aeaa-ddd5ae965e38 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:53.473290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.564380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-66d0216a-8034-41a6-aeaa-ddd5ae965e38 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:53.572450 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66d0216a-8034-41a6-aeaa-ddd5ae965e38 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1213 microversion: 2.1 time: 0.107295 Mar 29 02:17:53.581531 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1006/2035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:53.581531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-912a52d5-b782-4a3a-bc9c-aca25269e3b4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d1b040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.629647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-912a52d5-b782-4a3a-bc9c-aca25269e3b4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc" status: 200 len: 662 microversion: 2.1 time: 0.055092 Mar 29 02:17:53.630210 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1007/2036] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:53.771551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:53.772397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:53.779875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.780317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.781111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:53.781545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:53.880883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:53.889770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d42a5e75-03a1-4cb9-8f00-90763751ec22 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.456372 Mar 29 02:17:53.890604 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1030/2037] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:53.981278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:53.989925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9297b694-37b8-49c3-bbbd-666922a63a24 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.222649 Mar 29 02:17:53.990481 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1008/2038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:53 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:54.441352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:54.441845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:54.441968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:54.442211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:54.449804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.450591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.451105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.451564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.452067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.452342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.452777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.453211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.835247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:54.861677 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96500845-236c-4392-8a53-1e0ac47c07b2 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.419780 Mar 29 02:17:54.861925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:54.872311 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1009/2039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:54 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:54.874027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86f87c24-08da-40c6-9ebc-d92874f41aa8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1316 microversion: 2.1 time: 0.436726 Mar 29 02:17:54.884818 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1031/2040] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:54 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1316 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:54.885644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:54.885644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:54.895185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.895638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.896419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.896984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.907687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:54.909130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:54.917883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.921249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:54.921249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:54.921249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:55.019681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:55.028340 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-092e755a-98b5-4280-b725-b3cdb0abf751 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1265 microversion: 2.1 time: 0.154809 Mar 29 02:17:55.029168 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1010/2041] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:54 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:55.033841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:55.034553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:55.045972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:55.046437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:55.047236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:55.047678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:55.260177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:55.261544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:55.269598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cae9bd3-197d-48fb-9f6c-7b4e96a8f647 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.365814 Mar 29 02:17:55.270259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1032/2042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:54 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:55.271058 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-702402a4-9551-49d2-aaaf-536d3de513fa tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.240636 Mar 29 02:17:55.271676 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1011/2043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:55 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:55.545611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11b81c39-9624-4365-bbb3-24deef034fe7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c6d040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:55.603290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11b81c39-9624-4365-bbb3-24deef034fe7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285" status: 200 len: 660 microversion: 2.1 time: 0.061414 Mar 29 02:17:55.603977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1033/2044] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:55 2022] GET /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285 => generated 660 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:55.615967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12491432-780a-45cf-89ee-1b4477b19896 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d4db80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:55.670235 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12491432-780a-45cf-89ee-1b4477b19896 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285" status: 200 len: 660 microversion: 2.1 time: 0.058795 Mar 29 02:17:55.671114 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1012/2045] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:17:55 2022] GET /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285 => generated 660 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:55.726339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1334929316", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:55.795287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:55.876645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:55.877396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:55.887474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:55.888194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:55.889232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:55.889900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.089332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:56.089875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:56.090350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:56.090758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:56.091202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:56.099605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.100149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.100980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.101405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.118457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Getting quotas for project b5470d84721448dbbef995c3e5c4748a. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:56.124132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Getting quotas for user 283a9a04d31043dfa14f90328f0e38eb and project b5470d84721448dbbef995c3e5c4748a. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:56.147800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:56.147800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:56.190698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:56.200169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fe19496-cbf7-4023-a35e-678db486efbd tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.327301 Mar 29 02:17:56.201229 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1013/2046] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:55 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:17:56.205440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:56.206780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:56.218874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.218874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.218874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.218874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.316304 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e2d952d-5c1a-47f8-bd71-6378236056c2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593465 Mar 29 02:17:56.317068 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1034/2047] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:56.321338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:56.321961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:56.329870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.330325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.331904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.332353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.495191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:56.504315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3930e1e8-ca74-4b66-a26c-a86602158980 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1271 microversion: 2.1 time: 0.180012 Mar 29 02:17:56.504315 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1035/2048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:56 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1271 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:56.504315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:56.507884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:56.523972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.523972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.523972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.523972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.697265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:56.709722 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff48608b-4fe5-45ae-9eba-5a0feef2a8c8 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1505 microversion: 2.1 time: 0.507480 Mar 29 02:17:56.711084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1014/2049] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:56 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:56.716011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:56.716923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:56.733758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.733758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.733758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:56.733758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:56.802089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:56.811389 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21abe6b9-1852-476a-b4df-be80d976748b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.311146 Mar 29 02:17:56.812992 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1036/2050] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:56 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:56.834324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1735485756", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:56.943664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:17:57.136415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:57.144218 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-45d028fa-584c-4d59-8044-755e8c178b65 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.424149 Mar 29 02:17:57.144218 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1015/2051] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:56 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:57.166991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:57.166991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:57.166991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.176996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.176996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.176996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.276279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:57.276279 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8752ad4e-4d02-4b83-a132-8461d5e332e3 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/os-instance-actions/req-66c7f301-eedb-4b36-9519-635e187cf8d3" status: 200 len: 313 microversion: 2.1 time: 0.130466 Mar 29 02:17:57.282164 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1016/2052] 10.222.0.36 () {58 vars in 1418 bytes} [Tue Mar 29 02:17:57 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/os-instance-actions/req-66c7f301-eedb-4b36-9519-635e187cf8d3 => generated 313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:57.285753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:57.288985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:57.294179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.294626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.295400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.296009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.363591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:17:57.363591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:17:57.363591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:17:57.363591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:17:57.370047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:17:57.389857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.389857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.389857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.389857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.404069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Getting quotas for project b5470d84721448dbbef995c3e5c4748a. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:17:57.413007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Getting quotas for user 283a9a04d31043dfa14f90328f0e38eb and project b5470d84721448dbbef995c3e5c4748a. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:17:57.422127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:17:57.422127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:17:57.604935 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80e5e932-04e9-4cb4-be33-3fb4eb1aa670 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.785367 Mar 29 02:17:57.604935 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1037/2053] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:17:57.604935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:57.604935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:57.639985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.639985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.639985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:57.639985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:57.970581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:57.970581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d7e093d0-20f5-42ea-9381-4f9ddf3832f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.687780 Mar 29 02:17:57.977574 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1017/2054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:57 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:57.989441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:57.989441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:58.008575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.008575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.008575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.008575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.027847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae0affad-fc59-42e3-93a1-cf3dc3d82dba tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "POST /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/action" status: 202 len: 0 microversion: 2.1 time: 0.422933 Mar 29 02:17:58.027847 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1038/2055] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:17:57 2022] POST /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:17:58.051603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e88d2e5f-bcbc-49ff-a7af-308c5e25d22f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:58.051603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e88d2e5f-bcbc-49ff-a7af-308c5e25d22f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:58.285600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e88d2e5f-bcbc-49ff-a7af-308c5e25d22f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:58.295890 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e88d2e5f-bcbc-49ff-a7af-308c5e25d22f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1218 microversion: 2.1 time: 0.269066 Mar 29 02:17:58.298013 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1039/2056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:58 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1218 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:58.314105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:58.314733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:58.323175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.327983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.327983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.327983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.714203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:58.722858 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78501892-b865-456f-a6b3-8b50a6e1e12e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.751077 Mar 29 02:17:58.735696 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1018/2057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:57 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:58.735696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:58.735696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:58.740630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.741121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.741892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.742562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.862988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:58.871748 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9090a921-ff13-4681-a242-8197b9561d1f tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.572647 Mar 29 02:17:58.872327 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1040/2058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:58 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:58.878864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:58.879087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:58.887177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.887627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:58.888401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:58.888831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.014019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:59.024761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-135f9afa-ddba-47da-b76f-3a083a5890fb tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1507 microversion: 2.1 time: 0.296086 Mar 29 02:17:59.035694 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1019/2059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:58 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:59.040797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:59.041689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:59.051008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.051796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.052780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.053425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.296899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:59.307428 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1bd7849-ceeb-4718-a056-b1d5d298211f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.270910 Mar 29 02:17:59.308085 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1020/2060] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:59 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:59.327530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c264dcf5-908c-4bd8-92cb-2a29626cc65a req-bbba455b-4961-4c31-87a3-90177f1cd07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084dabcd-3490-4e74-bfc7-27812cc8cd06", "tag": "ad1ab860-6a67-42c0-b15e-ae9602d4da71"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:17:59.327530 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:17:59.327530 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:17:59.348168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c264dcf5-908c-4bd8-92cb-2a29626cc65a req-bbba455b-4961-4c31-87a3-90177f1cd07b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.357791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c264dcf5-908c-4bd8-92cb-2a29626cc65a req-bbba455b-4961-4c31-87a3-90177f1cd07b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.402075 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c264dcf5-908c-4bd8-92cb-2a29626cc65a req-bbba455b-4961-4c31-87a3-90177f1cd07b service nova] Creating event network-changed:ad1ab860-6a67-42c0-b15e-ae9602d4da71 for instance 084dabcd-3490-4e74-bfc7-27812cc8cd06 on n-h1-828148-1 Mar 29 02:17:59.406998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c264dcf5-908c-4bd8-92cb-2a29626cc65a req-bbba455b-4961-4c31-87a3-90177f1cd07b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096669 Mar 29 02:17:59.408001 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1021/2061] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:17:59.414579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:59.424953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:59.426040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.426662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.427625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.428219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.558098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:59.567004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c941fadd-66a6-4ed5-9df4-6e2d390cf6ae tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.693663 Mar 29 02:17:59.572863 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1041/2062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:58 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:59.717110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:17:59.731761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3f1cc24f-2606-4e8e-a372-a31d2299e428 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1214 microversion: 2.1 time: 0.319357 Mar 29 02:17:59.733160 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1022/2063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:59 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1214 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:17:59.740422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:59.741317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:59.754911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.755474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.756315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.756810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.891384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:17:59.892096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:17:59.905575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.906338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:17:59.907461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:17:59.909055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.047783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:00.066156 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7dc079ae-cef2-4920-9015-ec0a79b74c33 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.330451 Mar 29 02:18:00.067854 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1042/2064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:59 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:00.074070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-38a12a37-ddb9-41e7-99fc-18182ef65082 req-ec22179a-0e62-465f-8a03-73e0087dba9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f587694-428a-4d10-859d-5d981bb0753c", "name": "network-vif-plugged", "status": "completed", "tag": "037948f4-c2c8-40f9-9fac-2aca2c7fb5f5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:00.075745 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:00.075745 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:00.085253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-38a12a37-ddb9-41e7-99fc-18182ef65082 req-ec22179a-0e62-465f-8a03-73e0087dba9c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.085849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-38a12a37-ddb9-41e7-99fc-18182ef65082 req-ec22179a-0e62-465f-8a03-73e0087dba9c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.104440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-38a12a37-ddb9-41e7-99fc-18182ef65082 req-ec22179a-0e62-465f-8a03-73e0087dba9c service nova] Creating event network-vif-plugged:037948f4-c2c8-40f9-9fac-2aca2c7fb5f5 for instance 7f587694-428a-4d10-859d-5d981bb0753c on n-h2-828148-1 Mar 29 02:18:00.109705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-38a12a37-ddb9-41e7-99fc-18182ef65082 req-ec22179a-0e62-465f-8a03-73e0087dba9c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040574 Mar 29 02:18:00.110680 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1043/2065] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:00.117386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:00.118307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:00.126723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.127177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.128732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.129344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.411773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:00.420804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-641eeb4a-e34f-47f3-be5b-1fc2958c75bf tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1512 microversion: 2.1 time: 0.307616 Mar 29 02:18:00.421491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1044/2066] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:00 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:00.435822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:00.436512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:00.445847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.446108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.447026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.447460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.651076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:00.664368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43d2cf6b-7a4b-4ee4-bae0-97d11346917b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.777551 Mar 29 02:18:00.673505 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1023/2067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:17:59 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:00.681260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:00.681883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:00.714966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:00.722988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.722988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.722988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.722988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.725192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df17a78f-6653-4762-a4c6-dc86490eb1e9 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.282651 Mar 29 02:18:00.725192 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1045/2068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:00 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:00.749671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:00.750299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:00.759943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.759943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.761306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:00.761306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:00.904210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:00.922203 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ccf9b3a6-da74-44e8-a133-348230855641 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1288 microversion: 2.1 time: 0.170927 Mar 29 02:18:00.922203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1046/2069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:00 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1288 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:01.088782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:01.088782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:01.097585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.097585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.097585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.097585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.319799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:01.325634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96791f20-95d5-463e-8d51-d0905cb27aff tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.245258 Mar 29 02:18:01.334914 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1047/2070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:01 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:01.351392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:01.360451 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e70ba45c-1f08-4067-8189-da6457e70f22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.686040 Mar 29 02:18:01.361042 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1024/2071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:00 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:01.439085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:01.440394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:01.448028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.448208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.449028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.449452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.685681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:01.686102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:01.703780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.703780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.703780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.703780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.747500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:01.757216 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-435dfe5c-94c3-4ec6-b226-24426152a524 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1505 microversion: 2.1 time: 0.321738 Mar 29 02:18:01.763286 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1048/2072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:01 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:01.771717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:01.777262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:01.780512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.781072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:01.781924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:01.782721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.010958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:02.020536 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e04b2cd1-f561-4457-9914-78fc89a64c50 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1473 microversion: 2.1 time: 0.252180 Mar 29 02:18:02.020536 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1049/2073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:01 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:02.031119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '.version_select at 0x7f8724c6d430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.031674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.041641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.042083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.042859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.043286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.110638 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4296acbf-dda8-4fc2-a406-32cf5a09eadd tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.083111 Mar 29 02:18:02.111275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1050/2074] 10.222.0.36 () {58 vars in 1295 bytes} [Tue Mar 29 02:18:02 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9/os-instance-actions => generated 611 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:02.115999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.116987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.124282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.124757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.125538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.125957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.248271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:02.261408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1d56dbe-c448-46f4-a500-c1210832681c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1276 microversion: 2.1 time: 0.144572 Mar 29 02:18:02.261408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1051/2075] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:02 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:02.261408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.263202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.269459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.269886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.270648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.271073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.334889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:02.497636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:02.506251 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c6d42db6-6d1b-47c0-862f-feb93ba27d2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1322 microversion: 2.1 time: 0.829719 Mar 29 02:18:02.506916 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1025/2076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:01 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1322 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:02.511561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.512240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.520314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.520761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.521559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.521993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.685625 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f43016ad-3370-4326-87d2-fa2a7f498aa5 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 204 len: 0 microversion: 2.1 time: 0.416300 Mar 29 02:18:02.685625 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1052/2077] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:02 2022] DELETE /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:02.706216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.706216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.729908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.731187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.731399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.731834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.949282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:02.962849 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19a8a817-e46e-41ca-a1b1-e6120f8f4394 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.280893 Mar 29 02:18:02.962849 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1053/2078] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:02 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:02.967095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:02.967095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:02.973406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.973853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:02.974799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:02.975232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.110045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:03.121784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03ed3257-991e-4b5a-9e55-c7cfc520ca99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.602721 Mar 29 02:18:03.121784 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1026/2079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:02 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:03.128597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:03.128597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:03.149542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.149542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.149542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.149542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.297309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:03.297309 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-449544f2-b773-4c15-be08-1292ff2b4631 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1511 microversion: 2.1 time: 0.329966 Mar 29 02:18:03.297309 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1054/2080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:02 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:03.303986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:03.303986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:03.322656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.322656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.322656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.322656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.447790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:03.457717 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21ad65c5-2600-4ae1-b3f4-4e78b9c21c45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1276 microversion: 2.1 time: 0.163745 Mar 29 02:18:03.458644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1055/2081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:03 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:03.526393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:03.527158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:03.534821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.535437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.537188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.537188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.813729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:03.823685 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ad8793e-072b-4bfd-a2a1-eb48501bc719 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1471 microversion: 2.1 time: 0.301360 Mar 29 02:18:03.836549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1056/2082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:03 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:03.872683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:03.877647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd773a96-e862-4c69-965f-dc6fea4481c3 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.763317 Mar 29 02:18:03.882799 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1027/2083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:03 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:03.982688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:03.982688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:03.994638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.994638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:03.994638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:03.994638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:04.176165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87f023c8-7366-4bcf-9bd3-ac1657d8b685 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:04.176165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87f023c8-7366-4bcf-9bd3-ac1657d8b685 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] [instance: ecdcff2a-4d27-408a-99cc-8f8916b4c804] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:04.182686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-87f023c8-7366-4bcf-9bd3-ac1657d8b685 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] HTTP exception thrown: Instance ecdcff2a-4d27-408a-99cc-8f8916b4c804 could not be found. Mar 29 02:18:04.183265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87f023c8-7366-4bcf-9bd3-ac1657d8b685 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Returning 404 to user: Instance ecdcff2a-4d27-408a-99cc-8f8916b4c804 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:04.184064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87f023c8-7366-4bcf-9bd3-ac1657d8b685 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/ecdcff2a-4d27-408a-99cc-8f8916b4c804/action" status: 404 len: 111 microversion: 2.1 time: 0.346268 Mar 29 02:18:04.185081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1057/2084] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:03 2022] POST /compute/v2.1/servers/ecdcff2a-4d27-408a-99cc-8f8916b4c804/action => generated 111 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:18:04.189084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:04.189687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:04.209692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:04.209692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:04.209692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:04.209692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:04.667668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:04.694041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-45fd4a04-1735-4103-a120-81f5a02ab1c9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.497135 Mar 29 02:18:04.694041 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1058/2085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:04 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:04.697994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:04.707055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:04.719068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:04.719719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:04.723638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:04.723638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:04.734546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:04.745282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-703391b8-066e-415d-a425-35d032ef01f6 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.770080 Mar 29 02:18:04.754570 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1028/2086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:03 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:04.759098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1269654985", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:04.830702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:18:05.236308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:05.248882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a3aac6d-7ae4-4435-9e91-12e51fda583d tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1511 microversion: 2.1 time: 0.556799 Mar 29 02:18:05.249437 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1059/2087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:04 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:05.264827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:05.269757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:05.290646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.295196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:05.295999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.303065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:05.866912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:18:05.867465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:18:05.868069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:18:05.870113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:18:05.870648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:18:05.882857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.883473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:05.884416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.885309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:05.918187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Getting quotas for project 0e43e0064c06475789bff466e2d4e943. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:05.930991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Getting quotas for user 03e0dac11d8b4f7cbb34140781eed3b9 and project 0e43e0064c06475789bff466e2d4e943. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:05.951380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:18:05.953274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:05.956914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:18:05.961363 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c4ad898-5dee-4a6e-9afc-1fc73dcd918f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.710892 Mar 29 02:18:05.961921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1060/2088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:05 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:05.976872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:05.977741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:05.985996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.987231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:05.988826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:05.993189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.107568 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1db39724-6782-4f8a-a910-15a3f8433c55 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351739 Mar 29 02:18:06.114141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1029/2089] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:18:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:18:06.114761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:06.115771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:06.124801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.125428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.126616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.127612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.497678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:06.506733 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f239464d-57f9-42f5-9581-53445ed50701 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.533419 Mar 29 02:18:06.508674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1061/2090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:05 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:06.514846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:06.515542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:06.527568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.528152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.529073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.529646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.821911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:06.830904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07881233-a31f-48d7-b70b-ef3e2d7273a6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.320071 Mar 29 02:18:06.831713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1062/2091] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:06 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:06.836639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:06.837334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:06.845137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.845592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:06.846401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:06.847055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.078514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:07.087558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cddb7598-5c25-44b4-b5de-f65517978d0c tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.254540 Mar 29 02:18:07.088119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1063/2092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:06 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:07.092717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3d848796-73d5-47f5-bd76-28352971132f req-4a524c27-e0f1-4aa6-84b2-efd494649ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-unplugged", "status": "completed", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:07.094388 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:07.094388 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:07.107013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d848796-73d5-47f5-bd76-28352971132f req-4a524c27-e0f1-4aa6-84b2-efd494649ada service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.107455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d848796-73d5-47f5-bd76-28352971132f req-4a524c27-e0f1-4aa6-84b2-efd494649ada service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.124131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3d848796-73d5-47f5-bd76-28352971132f req-4a524c27-e0f1-4aa6-84b2-efd494649ada service nova] Creating event network-vif-unplugged:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:18:07.129210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3d848796-73d5-47f5-bd76-28352971132f req-4a524c27-e0f1-4aa6-84b2-efd494649ada service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039792 Mar 29 02:18:07.129921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1064/2093] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:07.139214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b95c5a4-a350-416a-b889-e5939cdbf31d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:07.139214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b95c5a4-a350-416a-b889-e5939cdbf31d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:07.173860 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-15b1464c-4d0f-49c5-b333-63f327b4d1c0 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1690 microversion: 2.1 time: 1.063782 Mar 29 02:18:07.174839 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1030/2094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:06 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1690 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:07.179663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:07.180568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:07.188727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.189217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.189990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.190420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.209648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b95c5a4-a350-416a-b889-e5939cdbf31d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:07.225995 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b95c5a4-a350-416a-b889-e5939cdbf31d tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1222 microversion: 2.1 time: 0.087749 Mar 29 02:18:07.225995 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1065/2095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:07 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:07.225995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6578cfff-0c9b-4319-98cc-3d5f95bc6015 req-6f43e33d-94b9-4f4c-a22f-8e7ee4477e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76dcbdbd-fa81-4297-a389-6795b4c9d1e9", "name": "network-vif-deleted", "tag": "431acba1-567e-4716-b6b7-9f46cc0b932e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:07.226465 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:07.226465 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:07.239829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6578cfff-0c9b-4319-98cc-3d5f95bc6015 req-6f43e33d-94b9-4f4c-a22f-8e7ee4477e3e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.240505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6578cfff-0c9b-4319-98cc-3d5f95bc6015 req-6f43e33d-94b9-4f4c-a22f-8e7ee4477e3e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.273175 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6578cfff-0c9b-4319-98cc-3d5f95bc6015 req-6f43e33d-94b9-4f4c-a22f-8e7ee4477e3e service nova] Creating event network-vif-deleted:431acba1-567e-4716-b6b7-9f46cc0b932e for instance 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 on n-h2-828148-1 Mar 29 02:18:07.279741 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6578cfff-0c9b-4319-98cc-3d5f95bc6015 req-6f43e33d-94b9-4f4c-a22f-8e7ee4477e3e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058559 Mar 29 02:18:07.280257 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1066/2096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:07.288277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-aa5f6707-85c4-407a-bab8-e66ce099aac7 req-29657f66-59f9-4b61-9b33-efb28749b5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:07.289857 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:07.289857 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:07.308932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa5f6707-85c4-407a-bab8-e66ce099aac7 req-29657f66-59f9-4b61-9b33-efb28749b5cd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.316055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa5f6707-85c4-407a-bab8-e66ce099aac7 req-29657f66-59f9-4b61-9b33-efb28749b5cd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.321410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.322056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.322735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lazy-loading 'fault' on Instance uuid 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:07.326872 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-aa5f6707-85c4-407a-bab8-e66ce099aac7 req-29657f66-59f9-4b61-9b33-efb28749b5cd service nova] Creating event network-changed:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:18:07.332700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-aa5f6707-85c4-407a-bab8-e66ce099aac7 req-29657f66-59f9-4b61-9b33-efb28749b5cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048870 Mar 29 02:18:07.333641 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1067/2097] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:07.339262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:07.339963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:07.347951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.348402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.349214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.349682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.464151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec4aa0cd2914f1c9b92c7abf0fc8bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90474fce71f04040b0774dffcdcc49f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:07.473665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f3b9ba98-c1e2-4094-afa4-1638047f9fe4 tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 200 len: 1306 microversion: 2.1 time: 0.297639 Mar 29 02:18:07.483352 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1031/2098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:07 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 1306 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:07.488351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-828148-1", "block_migration": true, "disk_over_commit": false}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:07.489912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:07.506134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.506948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.507942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.508582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.634392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:07.645489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93cf1e83-aadc-4e92-805f-778283e40965 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.310340 Mar 29 02:18:07.651937 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1068/2099] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:07 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:07.663283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:07.667156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:07.677288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lazy-loading 'flavor' on Instance uuid 8b7781b7-c582-43ee-9cb7-d94dbca08133 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:07.683535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.686965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.687980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:07.688627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:07.776710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Going to try to live migrate instance to n-h1-828148-1 {{(pid=103514) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:18:08.005969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:08.034506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-019ad964-b78b-4655-9da8-923d764a11ad tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.370462 Mar 29 02:18:08.034506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1069/2100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:07 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:08.046682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:08.046682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:08.057142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.057142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.057142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.057142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.317261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:08.322526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-346ca3ac-dce2-4f0e-9767-c3e4c5f6fc87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.294296 Mar 29 02:18:08.323104 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1070/2101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:08 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:08.334258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:08.334897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:08.347796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.348320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.351136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.351136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.567716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:08.577330 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d51cdce-a9e2-452e-909d-da530ac98926 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.247365 Mar 29 02:18:08.577752 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1071/2102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:08 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:08.591239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:08.591769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:08.599548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.600006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.600794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.601260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.731659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:08.741089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88f7ebf3-bdb9-43e4-8c3b-08e24a8f75ec tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1274 microversion: 2.1 time: 0.153183 Mar 29 02:18:08.745199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1072/2103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:08 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:08.746745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:08.747675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] [instance: 76dcbdbd-fa81-4297-a389-6795b4c9d1e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:08.757430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.757430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.758261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.758688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.815609 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] HTTP exception thrown: Instance 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 could not be found. Mar 29 02:18:08.816287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] Returning 404 to user: Instance 76dcbdbd-fa81-4297-a389-6795b4c9d1e9 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:08.817146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd28639e-0b0f-4934-81b7-a5ee9ef1ffab tempest-InstanceActionsTestJSON-2124882623 tempest-InstanceActionsTestJSON-2124882623-project] 10.222.0.36 "GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9" status: 404 len: 111 microversion: 2.1 time: 0.073946 Mar 29 02:18:08.821164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1073/2104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:08 2022] GET /compute/v2.1/servers/76dcbdbd-fa81-4297-a389-6795b4c9d1e9 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:08.823289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:08.824696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:08.836337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.836337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:08.836337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:08.836337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:09.223963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:09.255489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-103b8c31-d630-45c6-8dc3-a2e4b92ee3fd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.425219 Mar 29 02:18:09.255489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1074/2105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:08 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:09.258660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:09.260058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:09.279016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:09.279811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:09.280798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:09.281534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.046112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:10.059285 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb763cc3-d871-4342-8d1e-bd5bb4936b4a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.810634 Mar 29 02:18:10.060663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1075/2106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:09 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:10.072484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:10.075375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:10.083553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.084446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.084766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.085298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.363706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:10.372224 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61928555-3ca6-4d16-9b49-0b6f2d1fd690 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.309667 Mar 29 02:18:10.372783 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1076/2107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:10 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:10.378116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-228e68e1-8a23-4ef3-9d07-c3a8b9a61d09 req-3bc3c386-6efc-4aec-a196-3f4efd6ca762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46", "tag": "faa71cb0-0282-4786-98a7-fcfe8beb8b52"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:10.379765 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:10.379765 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:10.387992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-228e68e1-8a23-4ef3-9d07-c3a8b9a61d09 req-3bc3c386-6efc-4aec-a196-3f4efd6ca762 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.388681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-228e68e1-8a23-4ef3-9d07-c3a8b9a61d09 req-3bc3c386-6efc-4aec-a196-3f4efd6ca762 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.405847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-228e68e1-8a23-4ef3-9d07-c3a8b9a61d09 req-3bc3c386-6efc-4aec-a196-3f4efd6ca762 service nova] Creating event network-changed:faa71cb0-0282-4786-98a7-fcfe8beb8b52 for instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 on n-h1-828148-1 Mar 29 02:18:10.410762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-228e68e1-8a23-4ef3-9d07-c3a8b9a61d09 req-3bc3c386-6efc-4aec-a196-3f4efd6ca762 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Mar 29 02:18:10.411729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1077/2108] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:10.416953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7f05529d-6f0e-419f-b87f-a456da6c0c72 req-e2f9f945-0fde-4b9b-aaef-9c0cdb74a078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084dabcd-3490-4e74-bfc7-27812cc8cd06", "name": "network-vif-plugged", "status": "completed", "tag": "ad1ab860-6a67-42c0-b15e-ae9602d4da71"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:10.418530 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:10.418530 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:10.427029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7f05529d-6f0e-419f-b87f-a456da6c0c72 req-e2f9f945-0fde-4b9b-aaef-9c0cdb74a078 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.427475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7f05529d-6f0e-419f-b87f-a456da6c0c72 req-e2f9f945-0fde-4b9b-aaef-9c0cdb74a078 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.444447 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7f05529d-6f0e-419f-b87f-a456da6c0c72 req-e2f9f945-0fde-4b9b-aaef-9c0cdb74a078 service nova] Creating event network-vif-plugged:ad1ab860-6a67-42c0-b15e-ae9602d4da71 for instance 084dabcd-3490-4e74-bfc7-27812cc8cd06 on n-h1-828148-1 Mar 29 02:18:10.449912 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7f05529d-6f0e-419f-b87f-a456da6c0c72 req-e2f9f945-0fde-4b9b-aaef-9c0cdb74a078 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036762 Mar 29 02:18:10.450402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1078/2109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:10.455959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:10.456598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:10.464376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.464740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.465771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.466197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.841669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:10.852677 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22ff979e-410c-4305-bd27-328e94fa3019 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.401043 Mar 29 02:18:10.854074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1079/2110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:10 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:10.859162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:10.860727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:10.870819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.873652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:10.873652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:10.873652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:11.779146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:11.779146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9d39707-aa6b-4ea6-afb0-7c1107e204cb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.441191 Mar 29 02:18:11.779146 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1080/2111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:10 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:11.779146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:11.790436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:11.790436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:11.790436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:11.790436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:11.796467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:11.796467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:11.796467 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ecc1401e-288e-48ed-b1fd-b747815d9b6d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.345485 Mar 29 02:18:11.796467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1081/2112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:11 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:11.802291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:11.802291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:11.802291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:11.802291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:11.806587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:11.806587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:11.995123 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46db18ec-5fe0-4a4f-be75-7c6883c5c983 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/action" status: 202 len: 0 microversion: 2.1 time: 4.510315 Mar 29 02:18:12.040990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1032/2113] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:07 2022] POST /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/action => generated 0 bytes in 4516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:12.045980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:12.046589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:12.059193 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:18:12.059396 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 (ip 10.222.0.36) !!! Mar 29 02:18:12.072750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.073342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.074646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.075961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.135822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:12.146203 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cb65344-19fe-4107-bbed-0a6517fbed77 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.494280 Mar 29 02:18:12.160580 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1082/2114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:11 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:12.160580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:12.160580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:12.170768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.170768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.170768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.170768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.630014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:12.641610 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1684efc-8778-4661-97af-e1457fa0d16e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.489390 Mar 29 02:18:12.656116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1083/2115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:12 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:12.679282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:12.680476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:12.706279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.708676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.711201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.713478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.873636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:12.901707 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a897f1d7-72d8-40d4-a6b4-48297af17aa2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1313 microversion: 2.1 time: 0.858965 Mar 29 02:18:12.902591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1033/2116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:12 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1313 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:12.911349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:12.913411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:12.930522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.930522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:12.930522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:12.930522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:13.267365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:13.281319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4d6d6c9-d677-4476-8268-76db71b16ee5 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.623832 Mar 29 02:18:13.292386 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1084/2117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:12 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:13.292386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5d8e2903-818e-4183-8238-2e4a41b1d695 req-0e4c1ef9-7dea-4345-9e73-615bc9b4dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-plugged", "status": "completed", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:13.292386 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:13.292386 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:13.325652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5d8e2903-818e-4183-8238-2e4a41b1d695 req-0e4c1ef9-7dea-4345-9e73-615bc9b4dc47 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:13.325652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5d8e2903-818e-4183-8238-2e4a41b1d695 req-0e4c1ef9-7dea-4345-9e73-615bc9b4dc47 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:13.358862 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5d8e2903-818e-4183-8238-2e4a41b1d695 req-0e4c1ef9-7dea-4345-9e73-615bc9b4dc47 service nova] Creating event network-vif-plugged:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:18:13.372410 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5d8e2903-818e-4183-8238-2e4a41b1d695 req-0e4c1ef9-7dea-4345-9e73-615bc9b4dc47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079438 Mar 29 02:18:13.372410 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1085/2118] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:13.394306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:13.394306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:13.399920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:13.399920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:13.399920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:13.399920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:13.717541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:13.727817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e63df2c9-27eb-42e4-9eb6-c84e0931014e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.823833 Mar 29 02:18:13.729378 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1034/2119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:12 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:13.734464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:13.735301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:13.754299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:13.754299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:13.754299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:13.754299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.153014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:14.165669 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-288ecac7-c2c6-41b9-8058-3c1714e7cd93 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.435106 Mar 29 02:18:14.166180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1035/2120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:13 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:14.171092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:14.171986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:14.182039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.182660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.184957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.185525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.373875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:14.390267 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23ff4cc8-8285-4d18-87ef-1663975ff8e7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 1.022718 Mar 29 02:18:14.400324 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1086/2121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:13 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:14.406108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-da3f8ba7-a23d-459e-9575-8953be6a7714 req-2eb7536c-eca9-4539-a07f-6efd30a682b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3bce73-3e23-4cc5-be28-66ac60b2de6c", "tag": "288173dd-7df6-490b-a6b0-b4565cfe7258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:14.408785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:14.409137 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:14.409137 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:14.417703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fd4bc4c-6f1e-46d0-9269-bc4c8c158bd4 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.250258 Mar 29 02:18:14.427641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1036/2122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:14 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:14.427641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:14.427641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:14.432069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-da3f8ba7-a23d-459e-9575-8953be6a7714 req-2eb7536c-eca9-4539-a07f-6efd30a682b6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.432734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-da3f8ba7-a23d-459e-9575-8953be6a7714 req-2eb7536c-eca9-4539-a07f-6efd30a682b6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.435217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.435930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.436465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.436922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.463154 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-da3f8ba7-a23d-459e-9575-8953be6a7714 req-2eb7536c-eca9-4539-a07f-6efd30a682b6 service nova] Creating event network-changed:288173dd-7df6-490b-a6b0-b4565cfe7258 for instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c on n-h2-828148-1 Mar 29 02:18:14.468247 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-da3f8ba7-a23d-459e-9575-8953be6a7714 req-2eb7536c-eca9-4539-a07f-6efd30a682b6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065476 Mar 29 02:18:14.469680 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1087/2123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:14.480032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:14.480830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:14.489861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.490588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.491715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.492397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.663179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:14.673371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dcc7b832-496d-4308-b02e-4363118ab95f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1500 microversion: 2.1 time: 0.253523 Mar 29 02:18:14.690547 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1037/2124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:14 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:14.694352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:14.695333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:14.702848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.703293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.704060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.704484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.778594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a7b8b32-ce99-4bdf-9567-a9a2bf820b1c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.087616 Mar 29 02:18:14.779932 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1038/2125] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:14 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:14.785772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:14.786688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:14.795049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.795491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:14.796321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:14.796923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.014195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:15.024232 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-419e73bf-6023-4dd8-b492-eb36afe2ca2a tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.242651 Mar 29 02:18:15.037001 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1039/2126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:14 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:15.105775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:15.131243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-64990e5e-5070-4675-8519-034bde951fee tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.655593 Mar 29 02:18:15.134787 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1088/2127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:14 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:15.183123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:15.183738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:15.204192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.205342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.205933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.206362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.411050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:15.412336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:15.431948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.432686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.434515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.438224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.572277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:15.595692 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-633a3c60-b955-43d4-9588-14d2c8fe727f tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1479 microversion: 2.1 time: 0.416463 Mar 29 02:18:15.596313 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1040/2128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:15 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1479 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:15.601112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:15.601873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:15.611574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.612724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.613708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.615119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.890800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:15.899674 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46f1ecdd-62cd-438c-ba8f-8e2e25c9a620 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.301912 Mar 29 02:18:15.900238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1041/2129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:15 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:15.905681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3f0e221b-7140-4cd3-810a-7a62cee5ec5c req-aeaca3e0-b5bf-460c-a594-2ca114067c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-plugged", "status": "completed", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:15.908456 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:15.908456 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:15.919224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3f0e221b-7140-4cd3-810a-7a62cee5ec5c req-aeaca3e0-b5bf-460c-a594-2ca114067c05 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.919668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3f0e221b-7140-4cd3-810a-7a62cee5ec5c req-aeaca3e0-b5bf-460c-a594-2ca114067c05 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.941592 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3f0e221b-7140-4cd3-810a-7a62cee5ec5c req-aeaca3e0-b5bf-460c-a594-2ca114067c05 service nova] Creating event network-vif-plugged:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:18:15.946439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3f0e221b-7140-4cd3-810a-7a62cee5ec5c req-aeaca3e0-b5bf-460c-a594-2ca114067c05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044822 Mar 29 02:18:15.947188 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1042/2130] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:15.954353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:15.965714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:15.973974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.974459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:15.975179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:15.975611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.049601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32d75cab-4f65-42d9-b51e-69c910ed7e15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.098231 Mar 29 02:18:16.053003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1043/2131] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:15 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:16.058932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:16.059802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:16.071754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.071754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.072559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.073026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.143365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:16.153786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d75ab239-f088-41c5-80d1-77fd8f77d4bf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.750603 Mar 29 02:18:16.154606 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1089/2132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:15 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:16.160415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:16.161537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:16.169332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.169854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.170705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.171186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.289699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:16.300695 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47917b6d-8fb4-4460-b585-32718e8bcf2c tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.246240 Mar 29 02:18:16.304027 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1044/2133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:16 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:16.565155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:16.573812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1809eafd-081d-4f48-827c-a2a391ec8f53 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.417935 Mar 29 02:18:16.574387 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1090/2134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:16 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:16.613626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:16.614305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:16.621531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.622103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.622914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.623348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.852690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:16.863770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-25674acd-7ac4-4b6b-9924-e4f2baae212a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1464 microversion: 2.1 time: 0.254713 Mar 29 02:18:16.864438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1045/2135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:16 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1464 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:16.894582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:16.895631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:16.903050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.903500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.904324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.904751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.917755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:16.918377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:16.930134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.930588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:16.931360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:16.931794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.175890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:17.191703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d777d738-9159-4361-8062-cb5670a1062e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.273965 Mar 29 02:18:17.203479 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1046/2136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:16 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:17.212385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:17.215221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:17.223350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.224362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.225314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.225747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.308789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f63ba2f0-0a97-49a8-a40d-0636d9c8bb5f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.097439 Mar 29 02:18:17.308789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1047/2137] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:17 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:17.329414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fb42554-d2fb-4303-b8ac-ecf7eddb11a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 0 microversion: 2.1 time: 0.436266 Mar 29 02:18:17.329414 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1091/2138] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:16 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:17.331409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:17.332022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:17.339394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.339845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.340624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.341080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.381088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-494962879", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:17.451097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] validate_networks() for [('a722a75c-2ddf-4bff-8ad8-e09644f11137', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:18:17.564666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:17.571340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c1ec140-513a-4df4-afe7-a8d2b360691e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.244370 Mar 29 02:18:17.571901 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1092/2139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:17 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:17.576539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:17.577342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:17.585852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.586477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:17.587252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:17.587683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.056411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:18.065737 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad66077b-5f34-4a8f-8787-6a700712d2af tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.492622 Mar 29 02:18:18.066749 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1093/2140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:17 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:18.074040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:18.074741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.082665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.083192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.084038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.084666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.145614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:18:18.146069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:18:18.146494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:18:18.146899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:18:18.147310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:18:18.156400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.156869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.158401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.158647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.158872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.159227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.159749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lazy-loading 'fault' on Instance uuid 51d86884-c17f-4a9e-99a8-f036046606d2 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:18.176233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Getting quotas for project 9259b000e39e4a079e12cdec39b1c31c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:18.181806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Getting quotas for user 39e5bfd6ac15433cb4a2c5a7a7baf151 and project 9259b000e39e4a079e12cdec39b1c31c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:18.193763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:18:18.196192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:18:18.298486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58cacaf6-de0b-4674-987b-967a721d7067 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1598 microversion: 2.1 time: 0.229686 Mar 29 02:18:18.299042 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1094/2141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:18 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1598 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:18.303483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:18.304086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.312804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.313287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.314141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.314572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.318806 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4a4c4b89-edcd-4746-ac80-5883ea57564c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012754 Mar 29 02:18:18.324439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1048/2142] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:18:18.329203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-403ed9a3-5578-496e-ac63-5d3f73a1ef8e req-1c3aeb9b-a21f-4845-9ac6-e87f18743f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46", "name": "network-vif-plugged", "status": "completed", "tag": "faa71cb0-0282-4786-98a7-fcfe8beb8b52"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:18.329203 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:18.329203 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:18.336605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-403ed9a3-5578-496e-ac63-5d3f73a1ef8e req-1c3aeb9b-a21f-4845-9ac6-e87f18743f5f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.337112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-403ed9a3-5578-496e-ac63-5d3f73a1ef8e req-1c3aeb9b-a21f-4845-9ac6-e87f18743f5f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.360229 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-403ed9a3-5578-496e-ac63-5d3f73a1ef8e req-1c3aeb9b-a21f-4845-9ac6-e87f18743f5f service nova] Creating event network-vif-plugged:faa71cb0-0282-4786-98a7-fcfe8beb8b52 for instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 on n-h1-828148-1 Mar 29 02:18:18.365776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-403ed9a3-5578-496e-ac63-5d3f73a1ef8e req-1c3aeb9b-a21f-4845-9ac6-e87f18743f5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044730 Mar 29 02:18:18.366851 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1049/2143] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:18.386885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:18.388832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.400119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.400579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.401452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.402192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.575043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:18.587506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b367e24-3843-40a6-9395-35699047e374 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.287421 Mar 29 02:18:18.588246 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1095/2144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:18 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:18.593984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:18.595053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.604335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.604927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.605770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.606396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.684811 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1b4d2d9-6f94-43e9-b6d0-51d10044701d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.094446 Mar 29 02:18:18.687841 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1096/2145] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:18 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:18.692313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:18.693503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.701257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.701830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.702685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.703119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.709404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:18.719753 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7520b79-bc50-47a6-afff-8e2be06bba2b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1485 microversion: 2.1 time: 0.351444 Mar 29 02:18:18.720725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1050/2146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:18 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1485 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:18.725522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd3aeef5-ec45-4d88-9dff-ca5423dc5d02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:18.726435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd3aeef5-ec45-4d88-9dff-ca5423dc5d02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.798498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd3aeef5-ec45-4d88-9dff-ca5423dc5d02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:18.811503 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd3aeef5-ec45-4d88-9dff-ca5423dc5d02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1216 microversion: 2.1 time: 0.084304 Mar 29 02:18:18.811503 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1051/2147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:18 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:18.811503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:18.812024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:18.820562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.821050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:18.821822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:18.822256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.127217 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b341e4ac-e1c5-476c-b2d4-8cca88f9d0a5 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action" status: 202 len: 0 microversion: 2.1 time: 0.439826 Mar 29 02:18:19.127867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1097/2148] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:18 2022] POST /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:19.132409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:19.132967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.140458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.140968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.147188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.147188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.215818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:19.225048 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-012ad1a6-1ea1-4b27-a64e-b1483b2f07a1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.417112 Mar 29 02:18:19.234528 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1052/2149] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:18 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:19.234528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:19.234528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.239542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.241045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.241045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.241615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.447519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:19.455605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4f7b829-dc8d-490a-a840-073dc3657ca0 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.228670 Mar 29 02:18:19.456171 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1053/2150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:19 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:19.460346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:19.460994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.469359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-630b5356-cf1c-4ac1-9218-a90b6a806e14 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "POST /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e/action" status: 202 len: 0 microversion: 2.1 time: 0.338371 Mar 29 02:18:19.469471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.469471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.469471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.469882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.470668 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1098/2151] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:19 2022] POST /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:19.477370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:19.478121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.485820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.486787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.487546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.487970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.726684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:19.734825 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-59800098-1097-4aed-9c7f-a918958014f5 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1493 microversion: 2.1 time: 0.261640 Mar 29 02:18:19.735396 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1099/2152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:19 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1493 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:19.739659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:19.740292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.747836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.748291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.749134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.749590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.761714 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb2c077e-e72d-4fcc-8c1f-bdf5bbfb9b90 tempest-ServersAdminTestJSON-2120271109 tempest-ServersAdminTestJSON-2120271109-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1615 microversion: 2.1 time: 0.304515 Mar 29 02:18:19.762351 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1054/2153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:19 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1615 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:19.768784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:19.769955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.779987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.780434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.781226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.781668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.862963 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-571bf83b-b594-4a96-a84f-f02d5348f4d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.098526 Mar 29 02:18:19.864234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1055/2154] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:19 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:19.870613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:19.871502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:19.882512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.883307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.884308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:19.884939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:19.966028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:19.985483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:19.994714 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da18c8b5-424b-4a01-bf98-64cb3574697a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.258273 Mar 29 02:18:19.995559 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1100/2155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:19 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:20.000216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:20.001091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.012317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.012991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.013956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.014533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.147079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:20.152634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa6df752-8256-4102-823f-91c17a77fdbd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1220 microversion: 2.1 time: 0.155726 Mar 29 02:18:20.162774 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1101/2156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:19 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1220 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:20.244053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:20.245587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.261465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.261946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.263007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.263722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.475635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6df59b21-36a7-4149-bd19-2ed57b7a4db4 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 204 len: 0 microversion: 2.1 time: 0.609213 Mar 29 02:18:20.479036 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1056/2157] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:19 2022] DELETE /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:20.484581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4144f08a-257f-4e5f-b487-fca3bd169a84 req-9c4c71a3-ded7-4164-9808-ddcadde5b5f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3bce73-3e23-4cc5-be28-66ac60b2de6c", "name": "network-vif-plugged", "status": "completed", "tag": "288173dd-7df6-490b-a6b0-b4565cfe7258"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:20.488380 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:20.488380 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:20.503239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:20.507347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4144f08a-257f-4e5f-b487-fca3bd169a84 req-9c4c71a3-ded7-4164-9808-ddcadde5b5f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.507347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4144f08a-257f-4e5f-b487-fca3bd169a84 req-9c4c71a3-ded7-4164-9808-ddcadde5b5f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.518524 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5f4edde-66a2-47ef-8791-af5327c6b24f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1318 microversion: 2.1 time: 0.279709 Mar 29 02:18:20.519737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1102/2158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:20 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:20.525082 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4144f08a-257f-4e5f-b487-fca3bd169a84 req-9c4c71a3-ded7-4164-9808-ddcadde5b5f3 service nova] Creating event network-vif-plugged:288173dd-7df6-490b-a6b0-b4565cfe7258 for instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c on n-h2-828148-1 Mar 29 02:18:20.528200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:20.536641 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4144f08a-257f-4e5f-b487-fca3bd169a84 req-9c4c71a3-ded7-4164-9808-ddcadde5b5f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053206 Mar 29 02:18:20.536641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1057/2159] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:20.538656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.542474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:20.546173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.551229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.552605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.553445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.554556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.555056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.559795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.563311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.565708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.930873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:20.942230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57579c6d-7e23-4407-96bd-24ce1dccc805 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.420932 Mar 29 02:18:20.942847 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1103/2160] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:20 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:20.947218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:20.947832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.955441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.955909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.956684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.957149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.962852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:20.971850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58452fe3-027b-4279-8ca1-c9e10aea1d98 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1470 microversion: 2.1 time: 0.437050 Mar 29 02:18:20.972394 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1058/2161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:20 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1470 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:20.978075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:20.978075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:20.984398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.984881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:20.985643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:20.987038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.058299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bb594dda-50eb-45b2-a70f-6707ef05b485 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.084660 Mar 29 02:18:21.059056 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1059/2162] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:20 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:21.064057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:21.064748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:21.073136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.073438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.074118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.074759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.245486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:21.254108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb6727d5-47d4-4a4c-958d-c458e9ed3b22 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1493 microversion: 2.1 time: 0.310284 Mar 29 02:18:21.254672 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1104/2163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:20 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1493 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:21.264128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:21.264128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:21.268244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.268741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.270162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.270692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.280489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:21.290291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a55c0181-5061-4c8e-bae7-cecad3e3c581 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.230114 Mar 29 02:18:21.290853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1060/2164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:21 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:21.391294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:21.400519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-83e240b3-8adb-46c8-b653-5c7454306cf2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1268 microversion: 2.1 time: 0.144790 Mar 29 02:18:21.401110 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1105/2165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:21 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:21.543767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:21.544648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:21.552805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.553000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.554512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.554512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.757084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:21.766077 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0bb74bc8-38b0-43a5-b032-6a61a4b52d33 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1468 microversion: 2.1 time: 0.226291 Mar 29 02:18:21.766629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1061/2166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:21 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:21.783873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:21.784551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:21.792700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.793298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.794141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.794648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.958870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:21.959479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:21.967021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.967465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:21.968223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:21.968649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.045962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:22.055175 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2bb7c560-46bd-48fc-877a-634f15e77699 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1468 microversion: 2.1 time: 0.275699 Mar 29 02:18:22.056483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1106/2167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:21 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:22.060459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:22.061257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:22.069594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.070038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.070819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.071254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.182751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:22.191573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6cc3c67b-eaad-485f-af4b-ce4df68a6e63 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1322 microversion: 2.1 time: 0.236299 Mar 29 02:18:22.202820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1062/2168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:21 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:22.202820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:22.202820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:22.208398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.208873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.209850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.210357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.289077 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cc6272da-2204-4afe-8515-f7d59307d567 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.095703 Mar 29 02:18:22.289684 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1063/2169] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:22 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:22.294901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1770024746"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:22.295989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:22.306233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.306837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.307654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.308114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.582824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:22.591184 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c49bb58d-d40b-493b-bb5f-cad1067a360a tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1470 microversion: 2.1 time: 0.534075 Mar 29 02:18:22.591747 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1107/2170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:22 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1470 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:22.596753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:22.597393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:22.604668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.605151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.605927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.606360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.979598 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fed23e9-63ea-414a-b7a4-6c65ce17f780 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "POST /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694/action" status: 202 len: 0 microversion: 2.1 time: 0.688572 Mar 29 02:18:22.980236 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1064/2171] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:22 2022] POST /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:18:22.986070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:22.986772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:22.994705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.994854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:22.995638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:22.996055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.086251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:23.094757 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22108d63-e422-441a-9d23-57fe90a68c11 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1493 microversion: 2.1 time: 0.501954 Mar 29 02:18:23.095615 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1108/2172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:22 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1493 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:23.100597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:23.104537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:23.114018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.114933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.116228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.116923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.229417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:23.238427 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dcb52b4c-8f5e-487e-8b41-d9de66a860e7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.257071 Mar 29 02:18:23.239031 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1065/2173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:22 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:23.243334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e04f35fa-920c-436a-a2ed-92dbe5b13bcf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717e77b80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:23.295165 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e04f35fa-920c-436a-a2ed-92dbe5b13bcf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.055004 Mar 29 02:18:23.300818 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1066/2174] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:23 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:23.302042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:23.303409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:23.312656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.313134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.315073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.315761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.535506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:23.543788 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03c0082e-eec5-4cc0-af06-56de58c29d7b tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1471 microversion: 2.1 time: 0.246222 Mar 29 02:18:23.544346 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1067/2175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:23 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1471 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:23.549479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:23.550451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:23.558156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.561029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.561029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.561029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.642510 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a23b1c92-0bda-4b53-bf25-726ec40bdffc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.096357 Mar 29 02:18:23.644207 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1068/2176] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:23 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:23.654494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:23.655606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:23.667401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.668130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.669184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:23.669783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:23.748716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lazy-loading 'flavor' on Instance uuid ad3bce73-3e23-4cc5-be28-66ac60b2de6c {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:24.190203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:24.198918 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed671216-ecb9-4634-8084-1a9b6a02102c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 1.101935 Mar 29 02:18:24.211654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1109/2177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:23 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:24.215028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:24.215809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:24.228724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.229344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.230174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.230655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.357227 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cc4132b7-405f-4f48-80ca-9224a651abde tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c/action" status: 202 len: 0 microversion: 2.1 time: 0.706946 Mar 29 02:18:24.357227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1069/2178] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:23 2022] POST /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:24.361397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:24.362316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:24.370628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.371093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.371914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.372497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.731204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:24.740364 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af72c3f4-4dfd-4bb6-b7ce-26a7d3f0b2d0 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 200 len: 1428 microversion: 2.1 time: 0.529287 Mar 29 02:18:24.741209 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1110/2179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:24 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 1428 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:24.747393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:24.747393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:24.753184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.753697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.754463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.754889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.880575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:24.887248 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fbaaccf-acff-46dc-b919-fee0b5353074 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1499 microversion: 2.1 time: 0.532006 Mar 29 02:18:24.887670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1070/2180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:24 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1499 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:24.892594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44dcdfdc-fa0f-4549-a91a-85aab95fba62 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87244644c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:24.950865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44dcdfdc-fa0f-4549-a91a-85aab95fba62 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.057456 Mar 29 02:18:24.950865 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1071/2181] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:24 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:24.953264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cf399fd0-22eb-4795-a072-60161ab21d44 req-75702670-b4b2-406e-81b3-0028f40a80f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7781b7-c582-43ee-9cb7-d94dbca08133", "name": "network-vif-unplugged", "status": "completed", "tag": "0d3962b5-57c5-452a-8526-28529acaea6c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:24.955626 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:24.955626 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:24.966650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf399fd0-22eb-4795-a072-60161ab21d44 req-75702670-b4b2-406e-81b3-0028f40a80f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:24.967146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf399fd0-22eb-4795-a072-60161ab21d44 req-75702670-b4b2-406e-81b3-0028f40a80f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:24.984995 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cf399fd0-22eb-4795-a072-60161ab21d44 req-75702670-b4b2-406e-81b3-0028f40a80f5 service nova] Creating event network-vif-unplugged:0d3962b5-57c5-452a-8526-28529acaea6c for instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 on n-h2-828148-1 Mar 29 02:18:24.991044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cf399fd0-22eb-4795-a072-60161ab21d44 req-75702670-b4b2-406e-81b3-0028f40a80f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042826 Mar 29 02:18:24.991928 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1072/2182] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:24.997115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:24.997829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:25.008983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.008983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.008983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.008983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.272865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:25.285153 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99fbd541-d65a-49a5-8eb8-936b3a56d30a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.542840 Mar 29 02:18:25.285733 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1111/2183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:24 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:25.303947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c01c1c70-34c3-486d-a5a4-afb4366fa072 req-86cbdacd-64d2-4fab-8bd7-78898bfa7d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9994c2ab-a820-4d6d-8278-4ebc48290e2a", "name": "network-vif-deleted", "tag": "57fa01ee-903d-41b2-b7a4-b213bb595ba8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:25.303947 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:25.303947 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:25.310888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c01c1c70-34c3-486d-a5a4-afb4366fa072 req-86cbdacd-64d2-4fab-8bd7-78898bfa7d3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.311471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c01c1c70-34c3-486d-a5a4-afb4366fa072 req-86cbdacd-64d2-4fab-8bd7-78898bfa7d3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.330296 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c01c1c70-34c3-486d-a5a4-afb4366fa072 req-86cbdacd-64d2-4fab-8bd7-78898bfa7d3b service nova] Creating event network-vif-deleted:57fa01ee-903d-41b2-b7a4-b213bb595ba8 for instance 9994c2ab-a820-4d6d-8278-4ebc48290e2a on n-h2-828148-1 Mar 29 02:18:25.335569 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c01c1c70-34c3-486d-a5a4-afb4366fa072 req-86cbdacd-64d2-4fab-8bd7-78898bfa7d3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045338 Mar 29 02:18:25.336201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1112/2184] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:25.342090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:25.343411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:25.351421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.352969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.354477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.355069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.462463 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb625c89-e276-4c19-8065-67317a9cb591 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.124538 Mar 29 02:18:25.463096 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1113/2185] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:25 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:25.469056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:25.471801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:25.481673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.482294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.483147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.483582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.552869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:25.695595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c3e56293-cebb-4bb7-825b-53d8a84a38f0 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1630 microversion: 2.1 time: 0.693732 Mar 29 02:18:25.696387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1073/2186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:24 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1630 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:25.715114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:25.716163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:25.745474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.746159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.747532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.748076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.975296 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54cfb373-3a21-4fc2-877b-2f4c8b53598d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 204 len: 0 microversion: 2.1 time: 0.510149 Mar 29 02:18:25.978922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1114/2187] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:25 2022] DELETE /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:25.982506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:25.985735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 9994c2ab-a820-4d6d-8278-4ebc48290e2a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:25.990358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.990784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.991611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:25.992041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:25.994801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:26.007606 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb0b5de4-0573-46ce-96b4-e9d5eb061f17 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.307293 Mar 29 02:18:26.008710 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1074/2188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:25 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:26.014047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dbd2c7c9-1c0e-4375-9b5c-0f87ee89448d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241ca310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.051614 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] HTTP exception thrown: Instance 9994c2ab-a820-4d6d-8278-4ebc48290e2a could not be found. Mar 29 02:18:26.052217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Returning 404 to user: Instance 9994c2ab-a820-4d6d-8278-4ebc48290e2a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:26.053558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1a79758a-fc51-4aa2-9810-d2957d16b558 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a" status: 404 len: 111 microversion: 2.1 time: 0.075655 Mar 29 02:18:26.054393 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1115/2189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:25 2022] GET /compute/v2.1/servers/9994c2ab-a820-4d6d-8278-4ebc48290e2a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:26.058798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.059401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.067671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.068202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.068993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.069093 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dbd2c7c9-1c0e-4375-9b5c-0f87ee89448d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.059027 Mar 29 02:18:26.069423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.069951 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1075/2190] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:26 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:26.074531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.075028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.083321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.083878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.084657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.085180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.149139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:26.431081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:26.441662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0fbbe68d-1e56-4740-a195-2004de287b0a tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.386289 Mar 29 02:18:26.442323 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1116/2191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:26 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:26.447231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.447865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.463352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.463806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.464592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.465055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.541092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b5dce0c-4e47-4bba-b14b-0823b5e43e96 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 204 len: 0 microversion: 2.1 time: 0.460538 Mar 29 02:18:26.541092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1076/2192] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:26 2022] DELETE /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:26.541092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:26.541092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.546571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.547150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.548490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.549030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.641342 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-529eb820-166d-42e0-8e87-4468a8c3e9bc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.105812 Mar 29 02:18:26.641342 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1077/2193] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:26 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:26.646525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.647315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.655748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.660086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.660086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.660086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.668376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:26.678358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf728efc-c874-425b-b356-3e33325d7cc8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.234486 Mar 29 02:18:26.679262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1117/2194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:26 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:26.713599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:26.714214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:26.722496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.722943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.723707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:26.724134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:26.860262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:26.870618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d972a44-45e2-44e4-bfcd-0da37d906d6e tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1469 microversion: 2.1 time: 0.227985 Mar 29 02:18:26.871298 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1078/2195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:26 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1469 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:27.019904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c18dc87-28c4-45c5-9006-dbe2a3a2ad29 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1613 microversion: 2.1 time: 0.310088 Mar 29 02:18:27.021053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1118/2196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:26 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1613 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:27.025851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.026546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.034333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.034864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.035643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.036076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.039085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.039661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.047056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.047551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.048942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.049507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.119623 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] HTTP exception thrown: Cannot 'migrate' instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c while it is in vm_state suspended Mar 29 02:18:27.120342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Returning 409 to user: Cannot 'migrate' instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c while it is in vm_state suspended {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:27.121078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-252d7e5a-40ef-454e-a7c9-68106883b7b3 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c/action" status: 409 len: 148 microversion: 2.1 time: 0.085746 Mar 29 02:18:27.121625 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1119/2197] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c/action => generated 148 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:18:27.126048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9e7dd2cd-5477-43a4-9490-165bbaa0ed13 req-2e4da659-a4fc-4dca-95f6-557819123d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7781b7-c582-43ee-9cb7-d94dbca08133", "tag": "0d3962b5-57c5-452a-8526-28529acaea6c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.127585 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:27.127585 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:27.135882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e7dd2cd-5477-43a4-9490-165bbaa0ed13 req-2e4da659-a4fc-4dca-95f6-557819123d05 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.136321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e7dd2cd-5477-43a4-9490-165bbaa0ed13 req-2e4da659-a4fc-4dca-95f6-557819123d05 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.152434 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9e7dd2cd-5477-43a4-9490-165bbaa0ed13 req-2e4da659-a4fc-4dca-95f6-557819123d05 service nova] Creating event network-changed:0d3962b5-57c5-452a-8526-28529acaea6c for instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 on n-h2-828148-1 Mar 29 02:18:27.158116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9e7dd2cd-5477-43a4-9490-165bbaa0ed13 req-2e4da659-a4fc-4dca-95f6-557819123d05 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Mar 29 02:18:27.159070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1120/2198] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:27.166968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a85d9075-cad3-4d1c-ba6f-997c89b24279 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724b090d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.223554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a85d9075-cad3-4d1c-ba6f-997c89b24279 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.063297 Mar 29 02:18:27.224294 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1121/2199] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:27.229539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-070a7979-87d9-47e1-afe1-ddaf866582b1 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.230695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-070a7979-87d9-47e1-afe1-ddaf866582b1 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:27.230973 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-070a7979-87d9-47e1-afe1-ddaf866582b1 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c/action" status: 400 len: 144 microversion: 2.1 time: 0.005783 Mar 29 02:18:27.231887 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1122/2200] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c/action => generated 144 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:18:27.242381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a92038c5-9c1a-4b59-8c29-eed45fa562c8 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.244296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a92038c5-9c1a-4b59-8c29-eed45fa562c8 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:27.245197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a92038c5-9c1a-4b59-8c29-eed45fa562c8 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c/action" status: 400 len: 120 microversion: 2.1 time: 0.007828 Mar 29 02:18:27.246453 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1123/2201] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c/action => generated 120 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:18:27.256919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39d8e48c-95c4-4995-b9b5-133bc9e24018 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.257836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39d8e48c-95c4-4995-b9b5-133bc9e24018 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Failed to fetch instance by id 999 {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:18:27.258338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-39d8e48c-95c4-4995-b9b5-133bc9e24018 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] HTTP exception thrown: Instance 999 could not be found. Mar 29 02:18:27.258891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39d8e48c-95c4-4995-b9b5-133bc9e24018 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:27.259667 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39d8e48c-95c4-4995-b9b5-133bc9e24018 tempest-ServersAdminNegativeTestJSON-247211270 tempest-ServersAdminNegativeTestJSON-247211270-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.006455 Mar 29 02:18:27.260458 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1124/2202] 10.222.0.36 () {60 vars in 1178 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:18:27.270574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.270873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:27.272447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.280207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74ab7037-4865-41dc-9f6b-361b74b261ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.258193 Mar 29 02:18:27.290436 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1079/2203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:27.291078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.291078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.291078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.291078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.356991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:27.397891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7b20afbf-09d7-4f31-aa1e-27ba34098c80 req-c9e31211-96d0-42fd-abd1-c51d5a20c3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.399629 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:27.399629 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:27.409869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7b20afbf-09d7-4f31-aa1e-27ba34098c80 req-c9e31211-96d0-42fd-abd1-c51d5a20c3b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.419623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7b20afbf-09d7-4f31-aa1e-27ba34098c80 req-c9e31211-96d0-42fd-abd1-c51d5a20c3b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.427151 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7b20afbf-09d7-4f31-aa1e-27ba34098c80 req-c9e31211-96d0-42fd-abd1-c51d5a20c3b9 service nova] Creating event network-changed:5faa6732-f151-4e2d-ae92-94ace19df2b9 for instance 18fccd9e-363a-446e-8b19-eb469eee1129 on n-h2-828148-1 Mar 29 02:18:27.433032 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7b20afbf-09d7-4f31-aa1e-27ba34098c80 req-c9e31211-96d0-42fd-abd1-c51d5a20c3b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038373 Mar 29 02:18:27.433930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1080/2204] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:18:27.460708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.461860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.469752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.470702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.471481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.471977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.711694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:27.714789 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f75edf3-8c19-4609-8515-28e5c13dd5fa tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 204 len: 0 microversion: 2.1 time: 0.448654 Mar 29 02:18:27.715395 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1125/2205] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:27 2022] DELETE /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:18:27.723685 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b77e2b1-5edf-482a-9b4c-cc69deb7787d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.266560 Mar 29 02:18:27.732412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1081/2206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:27.741313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.741313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.747328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.747936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.748703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.749166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.841647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:27.843503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.850797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.851253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.852019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.852447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.960953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-caf0037b-7e70-4b34-b639-7e180412b939 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.243445 Mar 29 02:18:27.961780 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1126/2207] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:27 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:27.967961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.968372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:27.969489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.979802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc91be25-65a2-4f10-8641-8995dbc324ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.246115 Mar 29 02:18:27.980395 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1082/2208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:27.981564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.983008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.983969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.984504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.986105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:27.986738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:27.995180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.995817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:27.996765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:27.997505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:28.446651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:28.456141 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72392421-62f7-4c06-8ed2-135c59de1073 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1469 microversion: 2.1 time: 0.474362 Mar 29 02:18:28.456721 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1083/2209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:28.466596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f4bb68d-cd49-4f96-8089-fbfe60b138a9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d1b040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:28.525873 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f4bb68d-cd49-4f96-8089-fbfe60b138a9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.067936 Mar 29 02:18:28.526923 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1084/2210] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:28 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:28.531387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:28.532160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:28.539729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:28.540470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:28.547223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:28.548430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:28.549181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:28.553244 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1c9022b-c92b-453a-b4ea-a24d83a0894e tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1468 microversion: 2.1 time: 0.590022 Mar 29 02:18:28.563233 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1127/2211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:27 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1468 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:28.740718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:28.742184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:28.749651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:28.750168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:28.751939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:28.752436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.029706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:29.038682 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72158f5b-7929-408c-a2f7-d30ef2de072d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.510747 Mar 29 02:18:29.039258 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1085/2212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:28 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:29.043840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:29.045036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:29.054544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.054544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.055247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.055688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.080279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:29.090046 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-08c90c91-3157-4395-b5a1-a0c22ea46c3f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.353808 Mar 29 02:18:29.090625 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1128/2213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:28 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:29.097292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:29.100829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:29.106406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.106910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.107690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.108291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.154305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a828e509-5867-4700-a4ce-dab8763dd3f9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.113553 Mar 29 02:18:29.160677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1086/2214] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:29 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:29.338133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:29.347912 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3bf3ca9c-ab5a-461c-a3a2-7449a35e7800 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.255961 Mar 29 02:18:29.348647 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1129/2215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:29 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:29.406376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d13774d8-ca56-43f7-b30d-bbfe89d6fa59 req-05a4d80a-b25e-40b0-840b-e6a3454543cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c571141c-30c2-4b24-b0f4-a92a7dddac8d", "name": "network-vif-deleted", "tag": "e0e922c7-2182-4fdc-97f7-f7920cb32d2e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:29.408654 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:29.408654 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:29.417688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d13774d8-ca56-43f7-b30d-bbfe89d6fa59 req-05a4d80a-b25e-40b0-840b-e6a3454543cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.418129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d13774d8-ca56-43f7-b30d-bbfe89d6fa59 req-05a4d80a-b25e-40b0-840b-e6a3454543cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.435415 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d13774d8-ca56-43f7-b30d-bbfe89d6fa59 req-05a4d80a-b25e-40b0-840b-e6a3454543cb service nova] Creating event network-vif-deleted:e0e922c7-2182-4fdc-97f7-f7920cb32d2e for instance c571141c-30c2-4b24-b0f4-a92a7dddac8d on n-h2-828148-1 Mar 29 02:18:29.440098 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d13774d8-ca56-43f7-b30d-bbfe89d6fa59 req-05a4d80a-b25e-40b0-840b-e6a3454543cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040941 Mar 29 02:18:29.440684 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1087/2216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:29.474563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:29.475528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:29.483720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.484665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.486572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.486572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.549505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-230b946a-d7dd-404b-b904-0fab4d83190b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87242e9280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:29.621812 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-230b946a-d7dd-404b-b904-0fab4d83190b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.085510 Mar 29 02:18:29.622376 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1088/2217] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:29 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:29.627951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:29.629107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:29.639575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.645269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.647243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.647859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.706480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:29.723546 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de1ac449-dc8e-4dea-a213-88b764eb228b tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 200 len: 1427 microversion: 2.1 time: 0.247404 Mar 29 02:18:29.724771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1130/2218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:29 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 1427 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:29.733831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e8c07bf5-a0aa-4dac-874a-cdcd377a59b1 req-563e7fb2-9a0f-4581-a3b4-ebbf128c3686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-plugged", "status": "completed", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:29.745708 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:29.745708 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:29.765816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e8c07bf5-a0aa-4dac-874a-cdcd377a59b1 req-563e7fb2-9a0f-4581-a3b4-ebbf128c3686 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:29.766265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e8c07bf5-a0aa-4dac-874a-cdcd377a59b1 req-563e7fb2-9a0f-4581-a3b4-ebbf128c3686 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:29.786324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e8c07bf5-a0aa-4dac-874a-cdcd377a59b1 req-563e7fb2-9a0f-4581-a3b4-ebbf128c3686 service nova] Creating event network-vif-plugged:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:18:29.791966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e8c07bf5-a0aa-4dac-874a-cdcd377a59b1 req-563e7fb2-9a0f-4581-a3b4-ebbf128c3686 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061511 Mar 29 02:18:29.793312 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1131/2219] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:30.057602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.058524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.066293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.066652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.067451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.067878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.283771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:30.295039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd6aa650-03da-4444-8bee-4dd203b347ee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.242557 Mar 29 02:18:30.299013 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1132/2220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:30.301793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.302632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.313446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.314334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.315479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.316147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.356029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:30.365852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b4f0513-fa54-4258-af69-78c01f0e5120 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1468 microversion: 2.1 time: 0.741723 Mar 29 02:18:30.367133 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1089/2221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:29 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1468 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:30.379485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:30.381733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.415919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.419737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.423458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.423937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.528030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da955569-afb7-448a-81e1-b18c25c55c68 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 14 microversion: 2.1 time: 0.159325 Mar 29 02:18:30.528972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1090/2222] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:30 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:30.534575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.535934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.550412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.551082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.552088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.553047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.701908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:30.714562 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e581831b-bf04-4684-b4af-9815fa258c1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1505 microversion: 2.1 time: 0.417736 Mar 29 02:18:30.719549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1133/2223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:30 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:30.720678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d2d55c0-d9d1-4d70-8e88-605c443fc834 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724b09af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.776644 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d2d55c0-d9d1-4d70-8e88-605c443fc834 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.059916 Mar 29 02:18:30.785090 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1134/2224] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:30 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:30.786827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.787447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: c571141c-30c2-4b24-b0f4-a92a7dddac8d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.794770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.795224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.796002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.796434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.854810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] HTTP exception thrown: Instance c571141c-30c2-4b24-b0f4-a92a7dddac8d could not be found. Mar 29 02:18:30.860962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Returning 404 to user: Instance c571141c-30c2-4b24-b0f4-a92a7dddac8d could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:30.860962 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27a045da-5967-444a-9637-761377f56171 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d" status: 404 len: 111 microversion: 2.1 time: 0.073466 Mar 29 02:18:30.861721 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1135/2225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:30 2022] GET /compute/v2.1/servers/c571141c-30c2-4b24-b0f4-a92a7dddac8d => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:30.867904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:30.868666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:30.883072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.883072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.883072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:30.883072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:30.968595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:31.130344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:31.139876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4995310d-fc2c-40c9-a694-c9c602c81c67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.609504 Mar 29 02:18:31.140461 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1091/2226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:30 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:31.312486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:31.313403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:31.326766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.329872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.330664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.332304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.408082 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0bc45cc5-aef0-4b33-9d99-9fd4561bc04d tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "DELETE /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 204 len: 0 microversion: 2.1 time: 0.543700 Mar 29 02:18:31.409350 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1136/2227] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:30 2022] DELETE /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:31.420350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:31.421463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:31.430303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.434550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.435804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.436244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.529068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.529557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.530061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lazy-loading 'fault' on Instance uuid ad3bce73-3e23-4cc5-be28-66ac60b2de6c {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:31.645422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:31.655714 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36d2fe63-84ce-4b56-bac1-3a303174b281 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 200 len: 1312 microversion: 2.1 time: 0.244801 Mar 29 02:18:31.668337 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1137/2228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:31 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:31.673224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:31.675774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:31.682437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.683092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.684033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:31.684667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:31.937703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:31.961563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:31.972535 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-28a9c157-b42f-43d3-af69-e370ecfc72a0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.652658 Mar 29 02:18:31.972535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1092/2229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:31 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:31.974810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:31.975816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:31.989146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-206844e2-9188-4701-998d-0a44810836f6 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1470 microversion: 2.1 time: 0.319373 Mar 29 02:18:31.989838 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1138/2230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:31 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:32.021240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.021696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.022624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.023369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.097186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-592a3772-39bc-4b2a-8b1f-4ebdff7327be req-6b047f58-4e0c-42b8-ad76-069473d104dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3bce73-3e23-4cc5-be28-66ac60b2de6c", "name": "network-vif-deleted", "tag": "288173dd-7df6-490b-a6b0-b4565cfe7258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:32.099492 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:32.099492 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:32.109807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-592a3772-39bc-4b2a-8b1f-4ebdff7327be req-6b047f58-4e0c-42b8-ad76-069473d104dd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.110845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-592a3772-39bc-4b2a-8b1f-4ebdff7327be req-6b047f58-4e0c-42b8-ad76-069473d104dd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.136879 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-592a3772-39bc-4b2a-8b1f-4ebdff7327be req-6b047f58-4e0c-42b8-ad76-069473d104dd service nova] Creating event network-vif-deleted:288173dd-7df6-490b-a6b0-b4565cfe7258 for instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c on n-h2-828148-1 Mar 29 02:18:32.137412 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-592a3772-39bc-4b2a-8b1f-4ebdff7327be req-6b047f58-4e0c-42b8-ad76-069473d104dd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134276 Mar 29 02:18:32.137990 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1139/2231] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:32.143861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:32.144553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:32.152304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.153025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.159099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.159099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.340425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:32.354681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a154ebb7-2861-4130-b3f4-3932ec7c8f88 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.215234 Mar 29 02:18:32.357023 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1140/2232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:32 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:32.368037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a3252ff4-5fc5-4df7-ad5c-908502ff8ff9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cf700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:32.448130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a3252ff4-5fc5-4df7-ad5c-908502ff8ff9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.089644 Mar 29 02:18:32.448711 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1141/2233] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:32 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:32.458060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b11c3cbb-7456-4b95-a522-bd320898dd22 req-f0901622-fbf3-4c48-be68-18963a07fe9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "name": "network-vif-plugged", "status": "completed", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:32.462090 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:32.462090 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:32.670912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b11c3cbb-7456-4b95-a522-bd320898dd22 req-f0901622-fbf3-4c48-be68-18963a07fe9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.671350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b11c3cbb-7456-4b95-a522-bd320898dd22 req-f0901622-fbf3-4c48-be68-18963a07fe9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.690282 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b11c3cbb-7456-4b95-a522-bd320898dd22 req-f0901622-fbf3-4c48-be68-18963a07fe9e service nova] Creating event network-vif-plugged:5faa6732-f151-4e2d-ae92-94ace19df2b9 for instance 18fccd9e-363a-446e-8b19-eb469eee1129 on n-h2-828148-1 Mar 29 02:18:32.695315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b11c3cbb-7456-4b95-a522-bd320898dd22 req-f0901622-fbf3-4c48-be68-18963a07fe9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244719 Mar 29 02:18:32.696549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1142/2234] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:32.701940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:32.703015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:32.720910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.721375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:32.722168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:32.722604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.017079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:33.029507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c030931-2357-4bda-b5fb-35eb69cf1180 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.331535 Mar 29 02:18:33.030073 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1143/2235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:32 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:33.048709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:33.049620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: ad3bce73-3e23-4cc5-be28-66ac60b2de6c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:33.058240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.059022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.060017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.060668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.112776 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] HTTP exception thrown: Instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c could not be found. Mar 29 02:18:33.113257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Returning 404 to user: Instance ad3bce73-3e23-4cc5-be28-66ac60b2de6c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:33.114057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a01e656c-73b5-43ea-a003-863a2a910949 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c" status: 404 len: 111 microversion: 2.1 time: 0.083087 Mar 29 02:18:33.114593 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1144/2236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:33 2022] GET /compute/v2.1/servers/ad3bce73-3e23-4cc5-be28-66ac60b2de6c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:33.119336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:33.119953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:33.128313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.128757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.129552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.129982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.591984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:33.602075 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c07fa78-dd91-4b89-8c54-3e83ed6e41b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1316 microversion: 2.1 time: 0.486291 Mar 29 02:18:33.603108 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1145/2237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:33 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:33.608000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:33.608541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:33.634099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.635596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:33.636766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:33.637426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.174587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c3da46792940ce9c4ed371e1c2748e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0c4a74ba1d46dc99e030cdf41349b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:34.190160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24c09014-431e-4a4e-a4bb-1b17baf36207 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 200 len: 1470 microversion: 2.1 time: 0.585703 Mar 29 02:18:34.193841 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1146/2238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:33 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 1470 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:34.195934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:34.196411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:34.205001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.205637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.206592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.207173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.300607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:34.665993 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-945a8874-0df8-40f2-ba14-d0060bd874bb tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 204 len: 0 microversion: 2.1 time: 0.473330 Mar 29 02:18:34.666911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1147/2239] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:34 2022] DELETE /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:34.673058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:34.674006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:34.682295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.682745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.683513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.683941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.808346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:34.817287 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f2e1ed6-9f92-4ab6-b31a-1c6e2a8c209f tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.148880 Mar 29 02:18:34.817873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1148/2240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:34 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:34.822656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0a2c95b-700b-4ca5-87e8-d17118133046 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:34.884448 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0a2c95b-700b-4ca5-87e8-d17118133046 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.065435 Mar 29 02:18:34.885246 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1149/2241] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:34 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:34.895764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:34.896393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:34.905464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.905917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:34.906774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:34.907848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.126981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:35.137303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b11fe14a-8ead-4316-96a6-d19007109c5d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.246011 Mar 29 02:18:35.138056 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1150/2242] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:34 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:35.145101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1f473455-3787-4eaf-bf43-36a0ed7676f4 req-c72c3f98-51b5-41c7-a27b-e8abac0e39f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a265c13-888e-4d8e-8b07-02db7d873c2e", "name": "network-vif-deleted", "tag": "95dabd24-d72b-4610-a210-f5242c98ab21"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:35.146946 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:35.146946 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:35.159435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f473455-3787-4eaf-bf43-36a0ed7676f4 req-c72c3f98-51b5-41c7-a27b-e8abac0e39f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.159897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f473455-3787-4eaf-bf43-36a0ed7676f4 req-c72c3f98-51b5-41c7-a27b-e8abac0e39f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.184237 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1f473455-3787-4eaf-bf43-36a0ed7676f4 req-c72c3f98-51b5-41c7-a27b-e8abac0e39f6 service nova] Creating event network-vif-deleted:95dabd24-d72b-4610-a210-f5242c98ab21 for instance 3a265c13-888e-4d8e-8b07-02db7d873c2e on n-h1-828148-1 Mar 29 02:18:35.190484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1f473455-3787-4eaf-bf43-36a0ed7676f4 req-c72c3f98-51b5-41c7-a27b-e8abac0e39f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051111 Mar 29 02:18:35.191068 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1151/2243] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:35.248384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d3cc3bc5-bedc-4f78-a701-48ab539e4141 req-5ce5e262-8d3e-4d1e-acd8-ad6b50ea574f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d86884-c17f-4a9e-99a8-f036046606d2", "name": "network-vif-deleted", "tag": "72c6ea66-1502-4c5e-8a4e-38ceb9cefedf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:35.250146 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:35.250146 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:35.259437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d3cc3bc5-bedc-4f78-a701-48ab539e4141 req-5ce5e262-8d3e-4d1e-acd8-ad6b50ea574f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.259899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d3cc3bc5-bedc-4f78-a701-48ab539e4141 req-5ce5e262-8d3e-4d1e-acd8-ad6b50ea574f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.277111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d3cc3bc5-bedc-4f78-a701-48ab539e4141 req-5ce5e262-8d3e-4d1e-acd8-ad6b50ea574f service nova] Creating event network-vif-deleted:72c6ea66-1502-4c5e-8a4e-38ceb9cefedf for instance 51d86884-c17f-4a9e-99a8-f036046606d2 on n-h2-828148-1 Mar 29 02:18:35.281986 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d3cc3bc5-bedc-4f78-a701-48ab539e4141 req-5ce5e262-8d3e-4d1e-acd8-ad6b50ea574f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089608 Mar 29 02:18:35.283599 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1152/2244] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:35.288418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:35.289250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:35.296935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.297402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.298185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.298618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.529034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:35.539163 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f330e862-df54-4c4a-900b-6e01d5144d30 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.254509 Mar 29 02:18:35.541893 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1153/2245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:35 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:35.545172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:35.561008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:35.561008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.561008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.561008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.561344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.914650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:35.942258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-423a4f39-8005-46bb-a550-05df310c69f9 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1477 microversion: 2.1 time: 0.400798 Mar 29 02:18:35.942852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1154/2246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:35 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1477 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:35.957156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:35.957802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] [instance: 51d86884-c17f-4a9e-99a8-f036046606d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:35.980864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.980864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:35.980864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:35.980864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:36.038739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] HTTP exception thrown: Instance 51d86884-c17f-4a9e-99a8-f036046606d2 could not be found. Mar 29 02:18:36.039520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] Returning 404 to user: Instance 51d86884-c17f-4a9e-99a8-f036046606d2 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:36.040172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93a59c45-08c5-44d1-81fc-494deb6b0ce8 tempest-ServersAdminTestJSON-2143408000 tempest-ServersAdminTestJSON-2143408000-project] 10.222.0.36 "GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2" status: 404 len: 111 microversion: 2.1 time: 0.087300 Mar 29 02:18:36.040718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1155/2247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:35 2022] GET /compute/v2.1/servers/51d86884-c17f-4a9e-99a8-f036046606d2 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:36.045168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1364628546", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:36.115270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] validate_networks() for [('a722a75c-2ddf-4bff-8ad8-e09644f11137', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:18:37.244968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:18:37.245609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:18:37.250166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:18:37.250166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:18:37.250166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:18:37.265197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:37.274171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:37.274171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:37.274171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:37.289401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Getting quotas for project 9259b000e39e4a079e12cdec39b1c31c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:37.295008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Getting quotas for user 39e5bfd6ac15433cb4a2c5a7a7baf151 and project 9259b000e39e4a079e12cdec39b1c31c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:37.308702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:18:37.311264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:18:37.486171 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a7521c9-6cc8-47e6-9958-d5d215fea5d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444266 Mar 29 02:18:37.515133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1156/2248] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:18:37.526718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:37.527773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:37.548924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:37.551135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:37.558730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:37.567783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:37.872047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:37.886271 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6026d624-dff5-437c-983e-8650a7ed747b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.369196 Mar 29 02:18:37.897025 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1157/2249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:37 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:37.903050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-508f19de-8efd-4fab-962b-771ca818d803 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:37.985611 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-508f19de-8efd-4fab-962b-771ca818d803 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.087200 Mar 29 02:18:37.989074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1158/2250] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:37 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:37.998443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:38.002411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:38.024689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:38.025471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:38.027023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:38.027023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:38.414223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:38.428880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32fb7640-f6cc-46c7-905f-0c964ace7648 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.438245 Mar 29 02:18:38.447678 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1159/2251] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:37 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:38.449284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:38.449912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:38.460703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:38.461413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:38.462524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:38.463037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.128218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03e0dac11d8b4f7cbb34140781eed3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e43e0064c06475789bff466e2d4e943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:39.136980 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d53072f2-112c-47c8-8eb7-fa31f0524aa1 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 200 len: 1307 microversion: 2.1 time: 0.692566 Mar 29 02:18:39.137544 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1160/2252] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:38 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:39.141765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a72dba59-699b-43b5-85a2-b53bdda56e38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:39.142374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a72dba59-699b-43b5-85a2-b53bdda56e38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:39.232936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a72dba59-699b-43b5-85a2-b53bdda56e38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:39.241307 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a72dba59-699b-43b5-85a2-b53bdda56e38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1217 microversion: 2.1 time: 0.102703 Mar 29 02:18:39.242003 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1161/2253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:39 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1217 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:39.256004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c62bb2f0-0c92-4315-b7eb-6b3a85376203 req-0e2dca0b-e2e0-4025-8a80-e74f0ab73305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f587694-428a-4d10-859d-5d981bb0753c", "name": "network-vif-deleted", "tag": "037948f4-c2c8-40f9-9fac-2aca2c7fb5f5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:39.260262 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:39.260262 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:39.269315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c62bb2f0-0c92-4315-b7eb-6b3a85376203 req-0e2dca0b-e2e0-4025-8a80-e74f0ab73305 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:39.269925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c62bb2f0-0c92-4315-b7eb-6b3a85376203 req-0e2dca0b-e2e0-4025-8a80-e74f0ab73305 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.288521 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c62bb2f0-0c92-4315-b7eb-6b3a85376203 req-0e2dca0b-e2e0-4025-8a80-e74f0ab73305 service nova] Creating event network-vif-deleted:037948f4-c2c8-40f9-9fac-2aca2c7fb5f5 for instance 7f587694-428a-4d10-859d-5d981bb0753c on n-h2-828148-1 Mar 29 02:18:39.298549 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c62bb2f0-0c92-4315-b7eb-6b3a85376203 req-0e2dca0b-e2e0-4025-8a80-e74f0ab73305 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055123 Mar 29 02:18:39.299613 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1162/2254] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:39.305991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:39.306709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:39.322203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:39.323021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.323969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:39.324554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.453957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:39.463392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b88ab4c-8086-4c61-a4f6-389621647c92 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.162190 Mar 29 02:18:39.466847 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1163/2255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:39 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:39.481065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a9003e2-520c-4231-a3d6-5528343ab38f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cf040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:39.540588 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a9003e2-520c-4231-a3d6-5528343ab38f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.072163 Mar 29 02:18:39.546617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1164/2256] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:39 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:39.546617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:39.546780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:39.554753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:39.555311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.556161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:39.556673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:39.827677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:39.839339 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10727601-28b0-4a6b-a206-17b523fee393 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.296631 Mar 29 02:18:39.840411 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1165/2257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:39 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:40.153758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:40.154338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] [instance: 7f587694-428a-4d10-859d-5d981bb0753c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:40.163860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.164377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.165398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.166176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.227717 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] HTTP exception thrown: Instance 7f587694-428a-4d10-859d-5d981bb0753c could not be found. Mar 29 02:18:40.228829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] Returning 404 to user: Instance 7f587694-428a-4d10-859d-5d981bb0753c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:40.229907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b24cadc5-5ff5-4284-8bd5-026bfe295d00 tempest-ServersAdminNegativeTestJSON-115137451 tempest-ServersAdminNegativeTestJSON-115137451-project] 10.222.0.36 "GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c" status: 404 len: 111 microversion: 2.1 time: 0.079914 Mar 29 02:18:40.230661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1166/2258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:40 2022] GET /compute/v2.1/servers/7f587694-428a-4d10-859d-5d981bb0753c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:18:40.264766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:40.265410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:40.288207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.288798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.292829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.293304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.427332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:40.444297 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-365126aa-ccee-4264-9291-545754dc9e31 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1269 microversion: 2.1 time: 0.177214 Mar 29 02:18:40.444297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1167/2259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:40 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1269 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:40.486259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:40.486835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:40.495013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.495393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.496201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.496588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.628318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:40.637683 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd4942db-5736-4e94-b18e-4642bcdf019e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.155808 Mar 29 02:18:40.638569 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1168/2260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:40 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:40.653683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f01f3d64-bb29-4e55-b79a-71184b3f98f7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cf8b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:40.759750 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f01f3d64-bb29-4e55-b79a-71184b3f98f7 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.119408 Mar 29 02:18:40.761004 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1169/2261] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:40 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:40.858775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:40.865250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:40.870715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.871425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:40.872880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:40.874218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.439814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:41.461160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf96f7e9-fa6f-4fa3-a15a-80e36b9664ae tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.607055 Mar 29 02:18:41.466083 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1170/2262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:40 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:41.481779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:41.482591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:41.506204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.507292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.508653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.509261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.671447 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-802a082d-a1e9-45c8-8aab-dfe509ddf64d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action" status: 200 len: 24558 microversion: 2.1 time: 9.703581 Mar 29 02:18:41.673200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:41.679705 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1093/2263] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:31 2022] POST /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06/action => generated 24558 bytes in 9712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:18:41.685800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:41.686887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:41.692022 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6dc42a3b-8800-43e5-a093-feedca78a247 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1275 microversion: 2.1 time: 0.222945 Mar 29 02:18:41.696109 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1171/2264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:41 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:41.699946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.704450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.704450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.704450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.722859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:41.725412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:41.742289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.742741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:41.743536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:41.747376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:42.119217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:42.125871 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-848086fc-7492-4157-8352-9b6b204a6b9d tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 200 len: 1463 microversion: 2.1 time: 0.444571 Mar 29 02:18:42.126455 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1094/2265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:41 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 1463 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:42.130763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ed585df-8c75-4cd5-8c8e-c8197348d248 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d41820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:42.232015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ed585df-8c75-4cd5-8c8e-c8197348d248 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.104482 Mar 29 02:18:42.233467 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1095/2266] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:42 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:42.485482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:42.486129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:42.495990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:42.496446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:42.505210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:42.505210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:42.512332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:42.522970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b6a336e-aee2-4d5f-869c-2c557c314544 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.824727 Mar 29 02:18:42.523718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1172/2267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:41 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:42.549449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:42.559724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:42.562413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:42.563527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:42.564529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:42.565204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.209914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:43.221554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a88da704-8736-4200-a7c5-1ccbbadf7c41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.676388 Mar 29 02:18:43.223420 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1173/2268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:42 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:43.239208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:43.240038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:43.256052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.257733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.259995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.261058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.664651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:43.684189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca69e1a3-274c-42e7-85be-e05568b4cc06 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 1.201723 Mar 29 02:18:43.685947 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1096/2269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:42 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:43.698927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:43.699546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: 3a265c13-888e-4d8e-8b07-02db7d873c2e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:43.728023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.734324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.735434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.736062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.840749 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] HTTP exception thrown: Instance 3a265c13-888e-4d8e-8b07-02db7d873c2e could not be found. Mar 29 02:18:43.852150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Returning 404 to user: Instance 3a265c13-888e-4d8e-8b07-02db7d873c2e could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:43.855005 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9529573e-e248-4ce4-b8c2-dde64874191b tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e" status: 404 len: 111 microversion: 2.1 time: 0.167636 Mar 29 02:18:43.859108 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1097/2270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:43 2022] GET /compute/v2.1/servers/3a265c13-888e-4d8e-8b07-02db7d873c2e => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:43.870727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:43.879990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:43.896101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.899985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:43.900991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:43.902149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:44.531940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:44.542568 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1a99b2b-f01e-4fe4-829e-df0df61570cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 1.316815 Mar 29 02:18:44.545728 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1174/2271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:43 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:44.557587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57482e3c-7cfb-481c-9c02-773645664697 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:44.650609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:44.661655 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae02dee2-9b8e-46f0-a84e-bdf9ad7e1cad tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.801148 Mar 29 02:18:44.663018 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1098/2272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:43 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:44.667985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:44.669198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:44.682534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57482e3c-7cfb-481c-9c02-773645664697 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1455 microversion: 2.1 time: 0.135418 Mar 29 02:18:44.683725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1175/2273] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:44 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:44.698910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:44.699860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:44.702393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:44.705820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:44.708408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:44.711230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:44.719707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:44.725270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:44.726504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:44.727158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:44.846384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:45.245746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:45.251442 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-411b8b70-b2bc-4bd4-8a93-d1d331283b94 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.565083 Mar 29 02:18:45.263190 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1176/2274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:44 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:45.269906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:45.270746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:45.280628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.281462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.282530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.283227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.462373 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d05246db-8e01-4c55-8941-712b1737d9ef tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 204 len: 0 microversion: 2.1 time: 0.797832 Mar 29 02:18:45.463289 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1099/2275] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:44 2022] DELETE /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:45.471415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:45.473634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:45.492198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.492660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.494536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.508414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.609742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:45.621096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75ba4f52-2bc8-44e2-851d-4a5e7aef148f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1549 microversion: 2.1 time: 0.356159 Mar 29 02:18:45.623142 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1177/2276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:45 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1549 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:45.637947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:45.638795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:45.649955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.651280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.652309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:45.652956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:45.947778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Locking {{(pid=103514) lock /opt/stack/nova/nova/compute/api.py:4558}} Mar 29 02:18:46.115041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:46.127238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-894fcca9-cbfe-4ef1-ba57-82f105025481 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1491 microversion: 2.1 time: 0.501897 Mar 29 02:18:46.130817 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1178/2277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:45 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1491 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:46.136229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:46.136919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:46.146058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.151073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.151073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.151073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.234573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-899c32e8-61d2-46aa-9916-c6b33263048a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.768518 Mar 29 02:18:46.234801 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1100/2278] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:45 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:46.241115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da634a2d-5eaf-4cb7-836a-79a99e6fff7a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f872405d1f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:46.303768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da634a2d-5eaf-4cb7-836a-79a99e6fff7a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1464 microversion: 2.1 time: 0.067659 Mar 29 02:18:46.304329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1101/2279] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:46 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1464 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:46.315402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a0f0f328-5b02-45b6-86fa-2f4d672a72ca req-4819e6d4-714e-43ce-940d-e2bedfa00865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc334912-d1f4-4de6-b1e3-df37062ffc27", "tag": "fdb4f48b-dc1a-4be3-81b0-7462c8c55247"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:46.316978 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:46.316978 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:46.329315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a0f0f328-5b02-45b6-86fa-2f4d672a72ca req-4819e6d4-714e-43ce-940d-e2bedfa00865 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.330494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a0f0f328-5b02-45b6-86fa-2f4d672a72ca req-4819e6d4-714e-43ce-940d-e2bedfa00865 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.357612 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a0f0f328-5b02-45b6-86fa-2f4d672a72ca req-4819e6d4-714e-43ce-940d-e2bedfa00865 service nova] Creating event network-changed:fdb4f48b-dc1a-4be3-81b0-7462c8c55247 for instance bc334912-d1f4-4de6-b1e3-df37062ffc27 on n-h2-828148-1 Mar 29 02:18:46.363277 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a0f0f328-5b02-45b6-86fa-2f4d672a72ca req-4819e6d4-714e-43ce-940d-e2bedfa00865 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057769 Mar 29 02:18:46.364244 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1102/2280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:46.370746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:46.371625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:46.382318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.382934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.384402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.385013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.757114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:46.769472 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8bd7b995-ae05-40b8-b475-0b06128fe3fe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.403947 Mar 29 02:18:46.770057 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1103/2281] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:46 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:46.779442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a462b7c-7345-4208-9ce4-f6909415c551 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241ca670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:46.859822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a462b7c-7345-4208-9ce4-f6909415c551 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 200 len: 1464 microversion: 2.1 time: 0.088716 Mar 29 02:18:46.866973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1104/2282] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:46 2022] GET /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 1464 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:46.872359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:46.873233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:46.881875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.882400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.883256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.883681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:46.958884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:46.968490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15362c8b-a6c7-4d15-a698-5190e6e12fc0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 0.836308 Mar 29 02:18:46.970097 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1179/2283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:46 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:46.975811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:46.986364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:46.987332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.064256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c is locked Mar 29 02:18:47.064750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 409 to user: Instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c is locked {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:47.065847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8c5d1a7-0dde-474a-b265-8b59d2b885d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 409 len: 107 microversion: 2.1 time: 0.094507 Mar 29 02:18:47.070351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1180/2284] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:46 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 107 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:18:47.075668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:47.076288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:47.086639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.087267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.088219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.088786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.176228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:47.194208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a890813a-0909-433a-ae10-e3d58d417f9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1539 microversion: 2.1 time: 0.326227 Mar 29 02:18:47.194790 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1105/2285] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:46 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1539 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:47.200763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:47.201615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:47.210936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.213806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.216668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.216668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.450024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Unlocking {{(pid=103514) unlock /opt/stack/nova/nova/compute/api.py:4587}} Mar 29 02:18:47.695846 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3cec2a6b-a0b8-43ce-a923-aab4ee5688a9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.499113 Mar 29 02:18:47.699430 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1106/2286] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:47 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:47.701951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:47.702820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:47.711683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.716131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.716131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.716131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.938581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:47.944025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:47.950245 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebd95d74-d4d3-42e7-883c-76012e2a1ff1 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1468 microversion: 2.1 time: 0.878575 Mar 29 02:18:47.950842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1181/2287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:47 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1468 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:47.952705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39b28761-9dcd-4398-8844-21f59d9d5228 tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1491 microversion: 2.1 time: 0.254656 Mar 29 02:18:47.955574 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1107/2288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:47 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1491 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:47.959634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bab83179-620f-417b-859f-e93dcd0a7f6c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '.version_select at 0x7f8724b99820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:47.961107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66668973-7fc3-41bd-8960-b76a0692d44f tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f87241caf70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:47.961224 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:47.961224 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:47.967248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bab83179-620f-417b-859f-e93dcd0a7f6c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:47.968964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bab83179-620f-417b-859f-e93dcd0a7f6c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:47.981550 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bab83179-620f-417b-859f-e93dcd0a7f6c tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.027273 Mar 29 02:18:47.987614 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1182/2289] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:18:47 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:48.017211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-97d53f1a-2c8c-45a8-85fe-92ea35e15583 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:48.032380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d53f1a-2c8c-45a8-85fe-92ea35e15583 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.032821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d53f1a-2c8c-45a8-85fe-92ea35e15583 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.065826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66668973-7fc3-41bd-8960-b76a0692d44f tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835" status: 200 len: 637 microversion: 2.1 time: 0.108710 Mar 29 02:18:48.066389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1108/2290] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:47 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835 => generated 637 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:48.070762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-141711129"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:48.073765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:48.083541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.084632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.085492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.086051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.123194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-97d53f1a-2c8c-45a8-85fe-92ea35e15583 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:18:48.385654 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-97d53f1a-2c8c-45a8-85fe-92ea35e15583 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.398743 Mar 29 02:18:48.386518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1183/2291] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:47 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:48.394565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:48.395838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:48.407709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.408461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.409494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.410268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.790132 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c37cf71b-274c-4d11-85e1-ef8825fc78cd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "POST /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46/action" status: 202 len: 0 microversion: 2.1 time: 0.721598 Mar 29 02:18:48.797094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1109/2292] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:18:48 2022] POST /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:18:48.804769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:48.806177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:48.825223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.825948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.826961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:48.827390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:48.929616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:48.945153 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d23d7380-35cd-4e71-a522-9b9a33ddce02 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 0.557135 Mar 29 02:18:48.946107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1184/2293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:48 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:48.958775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-888c2e48-ebda-4782-842f-ccc49af0343d tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f8724c43160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:49.044303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-888c2e48-ebda-4782-842f-ccc49af0343d tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:49.052424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-888c2e48-ebda-4782-842f-ccc49af0343d tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:49.437926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5884786c-59d1-46ed-8721-72bdc6ef07b1 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1690 microversion: 2.1 time: 0.637876 Mar 29 02:18:49.441254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1110/2294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:48 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1690 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:49.457104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:49.458008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:49.467555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:49.468686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:49.469636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:49.470260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:49.551093 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-888c2e48-ebda-4782-842f-ccc49af0343d tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.603872 Mar 29 02:18:49.557290 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1185/2295] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:48 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:49.563072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b30c081-9476-4f3c-ab30-ad806057ce8b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724b99af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:49.650059 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b30c081-9476-4f3c-ab30-ad806057ce8b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.090851 Mar 29 02:18:49.655965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1186/2296] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:49 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:49.661114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:49.661911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:49.669671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:49.670360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:49.671294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:49.672463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:49.985901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:49.994464 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b161370f-969c-4f88-b54f-6d9dabe24fe6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.542680 Mar 29 02:18:49.995909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1111/2297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:49 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:50.002012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:50.002832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:50.012996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.013652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.015153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.016142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.299165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:50.308575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-708845cb-5853-401e-b604-94ca6f5abe1e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1491 microversion: 2.1 time: 0.651398 Mar 29 02:18:50.319435 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1187/2298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:49 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1491 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:50.332922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80603236-58e6-4d05-a6b0-d97c8a99673d tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1690 microversion: 2.1 time: 0.334467 Mar 29 02:18:50.341266 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1112/2299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:49 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1690 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:50.362110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb37ce82-1bca-4160-823e-b6c057a89e6c tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f87243a04c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:50.506505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e6c45de8-fa02-4a4a-bfbb-75372dccb1b2 req-9163f66f-fa50-4256-9fae-874f97cffb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-unplugged", "status": "completed", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:50.508110 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:50.508110 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:50.518552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e6c45de8-fa02-4a4a-bfbb-75372dccb1b2 req-9163f66f-fa50-4256-9fae-874f97cffb61 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.519181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e6c45de8-fa02-4a4a-bfbb-75372dccb1b2 req-9163f66f-fa50-4256-9fae-874f97cffb61 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.537700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e6c45de8-fa02-4a4a-bfbb-75372dccb1b2 req-9163f66f-fa50-4256-9fae-874f97cffb61 service nova] Creating event network-vif-unplugged:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:18:50.543484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e6c45de8-fa02-4a4a-bfbb-75372dccb1b2 req-9163f66f-fa50-4256-9fae-874f97cffb61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.222435 Mar 29 02:18:50.544364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1188/2300] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:50.551570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:50.552124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:50.560346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.561390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.562667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.563251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.938594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb37ce82-1bca-4160-823e-b6c057a89e6c tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "DELETE /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.596085 Mar 29 02:18:50.939356 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1113/2301] 10.222.0.36 () {58 vars in 1295 bytes} [Tue Mar 29 02:18:50 2022] DELETE /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_version => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:50.943953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b01d0e39-c9f6-4574-839f-20eedc4c36fb req-2c776883-8938-4d89-94ec-1ed91bfd4064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed9ec9a7-1c01-4876-aee0-22d5ba868502", "name": "network-vif-deleted", "tag": "58124146-6c37-4dae-911f-9195c10ad2c3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:50.945637 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:50.945637 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:50.951493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:50.957737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b01d0e39-c9f6-4574-839f-20eedc4c36fb req-2c776883-8938-4d89-94ec-1ed91bfd4064 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.958177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b01d0e39-c9f6-4574-839f-20eedc4c36fb req-2c776883-8938-4d89-94ec-1ed91bfd4064 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.961257 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2ffcdea-d513-48bd-9596-b2b03b336372 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 0.414598 Mar 29 02:18:50.961893 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1189/2302] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:50 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:50.967464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:50.967464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:50.974135 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b01d0e39-c9f6-4574-839f-20eedc4c36fb req-2c776883-8938-4d89-94ec-1ed91bfd4064 service nova] Creating event network-vif-deleted:58124146-6c37-4dae-911f-9195c10ad2c3 for instance ed9ec9a7-1c01-4876-aee0-22d5ba868502 on n-h1-828148-1 Mar 29 02:18:50.974268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.974701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.975469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:50.976220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:50.979244 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b01d0e39-c9f6-4574-839f-20eedc4c36fb req-2c776883-8938-4d89-94ec-1ed91bfd4064 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038543 Mar 29 02:18:50.979826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1114/2303] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:50.984823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf80d2cb-838d-4c1c-a825-13d28130e0e9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dc550>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:51.041532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf80d2cb-838d-4c1c-a825-13d28130e0e9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.060347 Mar 29 02:18:51.042426 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1115/2304] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:50 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:51.047545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7aafd810-c842-408d-87f8-c7c6c678dd81 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f87241dc1f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:51.099030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7aafd810-c842-408d-87f8-c7c6c678dd81 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 37 microversion: 2.1 time: 0.055238 Mar 29 02:18:51.099588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1116/2305] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:18:51 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 37 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:51.105305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:51.106022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:51.119161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.119161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.119161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.119161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.156761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lazy-loading 'services' on Instance uuid 8b7781b7-c582-43ee-9cb7-d94dbca08133 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:51.366851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:51.375914 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7c9fa352-6141-4fa2-811e-a2bbe6856dbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.275274 Mar 29 02:18:51.376577 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1117/2306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:51 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:51.381457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0179e64-de71-4e7f-b092-5a9624a46097 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f87243a0f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:51.469767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d0179e64-de71-4e7f-b092-5a9624a46097 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:51.483606 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d2abd15-7bfb-4fe3-a068-ef6b631ea57b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments/225ef829-d35d-483a-9bca-0af30e220da7" status: 202 len: 0 microversion: 2.1 time: 0.519906 Mar 29 02:18:51.485142 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1190/2307] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:18:50 2022] DELETE /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments/225ef829-d35d-483a-9bca-0af30e220da7 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:18:51.490491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d0179e64-de71-4e7f-b092-5a9624a46097 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:51.491893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:51.492785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:51.516551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.517429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.518441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.519961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.705520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.706297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.706870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lazy-loading 'fault' on Instance uuid ed9ec9a7-1c01-4876-aee0-22d5ba868502 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:18:51.925565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f378decc1b1a40c89114be1900f54da2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10747b4b0194fb39b32e077d5ca8e49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:51.941057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48864552-cefb-4bc3-9a3f-3596e0abdade tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 200 len: 1303 microversion: 2.1 time: 0.454493 Mar 29 02:18:51.941961 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1191/2308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:51 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 1303 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:51.953870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:51.955107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:51.967496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.967988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:51.969502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:51.969997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.057933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05ad731a-a365-4964-976d-971b9a5ee937 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110572 Mar 29 02:18:52.059151 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1192/2309] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:18:51 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:52.069799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:52.070296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:52.098243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:52.100148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.104536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:52.105556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.137188 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0179e64-de71-4e7f-b092-5a9624a46097 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.759233 Mar 29 02:18:52.137760 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1118/2310] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:51 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:52.149297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-472e9ee7-cf26-46af-abe7-0561f354a3ce tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dc4c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:52.221242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-472e9ee7-cf26-46af-abe7-0561f354a3ce tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.075751 Mar 29 02:18:52.228521 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1119/2311] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:52 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:52.238285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a5fb57f-7aeb-4653-b70a-9a9a246948eb tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f872436dc10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:52.289779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a5fb57f-7aeb-4653-b70a-9a9a246948eb tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.059963 Mar 29 02:18:52.290789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1120/2312] 10.222.0.36 () {58 vars in 1289 bytes} [Tue Mar 29 02:18:52 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_distro => generated 33 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:52.309846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ebe2f13f-ea70-4734-9598-df83c434613e tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f87243a0c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:52.431876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ebe2f13f-ea70-4734-9598-df83c434613e tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:52.431876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ebe2f13f-ea70-4734-9598-df83c434613e tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:52.544420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:52.564508 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-181bea2b-fc22-4255-8797-f438d1240a55 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 0.503625 Mar 29 02:18:52.568161 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1193/2313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:52 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:52.579919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:52.579919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:52.588953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:52.588953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.588953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:52.592466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.803434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ebe2f13f-ea70-4734-9598-df83c434613e tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.496941 Mar 29 02:18:52.804591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1121/2314] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:52 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:52.813313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-746c556c-05d3-43f7-accd-1ee1225f0f52 req-39f53e6a-ff28-4f50-8676-46fe05de76e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc334912-d1f4-4de6-b1e3-df37062ffc27", "name": "network-vif-plugged", "status": "completed", "tag": "fdb4f48b-dc1a-4be3-81b0-7462c8c55247"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:52.817991 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:52.817991 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:18:52.840641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-746c556c-05d3-43f7-accd-1ee1225f0f52 req-39f53e6a-ff28-4f50-8676-46fe05de76e9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:52.840641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-746c556c-05d3-43f7-accd-1ee1225f0f52 req-39f53e6a-ff28-4f50-8676-46fe05de76e9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:52.860345 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-746c556c-05d3-43f7-accd-1ee1225f0f52 req-39f53e6a-ff28-4f50-8676-46fe05de76e9 service nova] Creating event network-vif-plugged:fdb4f48b-dc1a-4be3-81b0-7462c8c55247 for instance bc334912-d1f4-4de6-b1e3-df37062ffc27 on n-h2-828148-1 Mar 29 02:18:52.868305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-746c556c-05d3-43f7-accd-1ee1225f0f52 req-39f53e6a-ff28-4f50-8676-46fe05de76e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061823 Mar 29 02:18:52.869300 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1122/2315] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:52.877207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-306dca78-becc-492c-81a5-deb35bce06f9 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f8724d41940>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:52.935395 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-306dca78-becc-492c-81a5-deb35bce06f9 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.064680 Mar 29 02:18:52.936225 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1123/2316] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:18:52 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:52.962349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59371f0b-9f26-4f2e-afe8-f5c2819a258a tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f87241dcf70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:53.028032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-59371f0b-9f26-4f2e-afe8-f5c2819a258a tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:53.035875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-59371f0b-9f26-4f2e-afe8-f5c2819a258a tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:53.110297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:53.121816 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a13116a8-06e1-4c0a-9516-a0c045c54dd6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.555427 Mar 29 02:18:53.122394 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1194/2317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:52 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:53.129116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:53.136334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] [instance: ed9ec9a7-1c01-4876-aee0-22d5ba868502] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:53.150909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.151937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:53.153088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.153727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:53.231861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] HTTP exception thrown: Instance ed9ec9a7-1c01-4876-aee0-22d5ba868502 could not be found. Mar 29 02:18:53.232566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] Returning 404 to user: Instance ed9ec9a7-1c01-4876-aee0-22d5ba868502 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:18:53.233601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1bc3587d-d635-4978-8a67-526d1c23033e tempest-ServerRescueTestJSON-462801332 tempest-ServerRescueTestJSON-462801332-project] 10.222.0.36 "GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502" status: 404 len: 111 microversion: 2.1 time: 0.110297 Mar 29 02:18:53.234272 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1195/2318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:53 2022] GET /compute/v2.1/servers/ed9ec9a7-1c01-4876-aee0-22d5ba868502 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:18:53.241288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:53.242360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:53.256658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.257479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:53.258480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.259853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:53.412888 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-575b17c6-a18c-4ea9-bb64-4cbf1bf9f1ca tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177263 Mar 29 02:18:53.413800 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1196/2319] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:18:53 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:53.418941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-117d32b5-ac8d-41c4-8cde-386b92163752 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cf4c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:53.430606 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59371f0b-9f26-4f2e-afe8-f5c2819a258a tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.482323 Mar 29 02:18:53.441566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1124/2320] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:52 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:53.451287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38278e6f-67b7-48ea-a75e-0620642af839 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f87241caca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:53.516275 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-117d32b5-ac8d-41c4-8cde-386b92163752 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.101010 Mar 29 02:18:53.521885 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1197/2321] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:53 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:53.535671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-38278e6f-67b7-48ea-a75e-0620642af839 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:53.541150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-38278e6f-67b7-48ea-a75e-0620642af839 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:53.587491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:53.587915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:53.619327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.619666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:53.620466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:53.620934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:54.233593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38278e6f-67b7-48ea-a75e-0620642af839 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 64 microversion: 2.1 time: 0.787070 Mar 29 02:18:54.234460 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1125/2322] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:53 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 64 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:18:54.256932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:54.257730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:54.274622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:54.275075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:54.275861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:54.276336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:54.568498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:54.587197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1914f4d6-d8df-4dd1-bd95-75f3653ac1d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1317 microversion: 2.1 time: 1.009814 Mar 29 02:18:54.590258 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1198/2323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:53 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1317 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:54.613346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-017a2dba-c7a1-433b-9d69-b07dba0b2f5f tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f8724b99af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:54.710057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-017a2dba-c7a1-433b-9d69-b07dba0b2f5f tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 64 microversion: 2.1 time: 0.118292 Mar 29 02:18:54.710626 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1199/2324] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:18:54 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 64 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:54.722749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:54.723773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:54.750430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:54.751099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:54.752020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:54.752622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:54.831058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c7b1c63-a162-4d14-975c-e2b65c6e09bf tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113316 Mar 29 02:18:54.831766 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1200/2325] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:18:54 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:54.849391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ddd7b9c-664c-4d28-b091-27239fadc4ed tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87242e8670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:54.933763 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ddd7b9c-664c-4d28-b091-27239fadc4ed tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.100768 Mar 29 02:18:54.935170 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1201/2326] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:54 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:54.952825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f866a271-a046-4c86-808c-8a3c8c86af48 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f8724b994c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:55.042974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f866a271-a046-4c86-808c-8a3c8c86af48 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:55.055220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f866a271-a046-4c86-808c-8a3c8c86af48 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:55.064254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:55.073691 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb8a9e7b-7c98-43e0-b390-8abaf28c3955 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.827533 Mar 29 02:18:55.074278 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1126/2327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:54 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:55.610244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:55.610873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:55.630149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:55.631520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:55.632954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:55.635014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:55.816735 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f866a271-a046-4c86-808c-8a3c8c86af48 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.880290 Mar 29 02:18:55.817487 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1202/2328] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:54 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:55.826191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d06d8d7-5ea6-4e4d-9b64-8935cd9cdb62 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update', calling method: .version_select at 0x7f87240cfaf0>, body: {"meta": {"os_version": "alt"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:55.938684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1d06d8d7-5ea6-4e4d-9b64-8935cd9cdb62 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:55.953563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1d06d8d7-5ea6-4e4d-9b64-8935cd9cdb62 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:56.713093 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d06d8d7-5ea6-4e4d-9b64-8935cd9cdb62 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.890456 Mar 29 02:18:56.719383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1203/2329] 10.222.0.36 () {60 vars in 1312 bytes} [Tue Mar 29 02:18:55 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata/os_version => generated 31 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:18:56.723414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6002a8d4-c7b3-4dd9-a03a-b445dbc3820d req-f4b55f31-19d1-4abb-9bb2-557a12b57167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46", "name": "network-vif-plugged", "status": "completed", "tag": "faa71cb0-0282-4786-98a7-fcfe8beb8b52"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:56.725054 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:18:56.725054 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:18:56.743333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6002a8d4-c7b3-4dd9-a03a-b445dbc3820d req-f4b55f31-19d1-4abb-9bb2-557a12b57167 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:56.743771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6002a8d4-c7b3-4dd9-a03a-b445dbc3820d req-f4b55f31-19d1-4abb-9bb2-557a12b57167 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:56.777155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6002a8d4-c7b3-4dd9-a03a-b445dbc3820d req-f4b55f31-19d1-4abb-9bb2-557a12b57167 service nova] Creating event network-vif-plugged:faa71cb0-0282-4786-98a7-fcfe8beb8b52 for instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 on n-h1-828148-1 Mar 29 02:18:56.782974 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6002a8d4-c7b3-4dd9-a03a-b445dbc3820d req-f4b55f31-19d1-4abb-9bb2-557a12b57167 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066972 Mar 29 02:18:56.784188 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1204/2330] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:18:56.790000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e075e74-b7ad-4895-80f3-d081d0f49dd9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c6d940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:56.861614 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e075e74-b7ad-4895-80f3-d081d0f49dd9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.075518 Mar 29 02:18:56.862998 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1205/2331] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:56 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:56.868477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:56.869870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:56.884563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:56.885675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:56.886772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:56.887658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:56.956236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:56.970292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2a4d7a0-ed46-45b7-ab99-8308791c9930 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1506 microversion: 2.1 time: 1.367706 Mar 29 02:18:56.970876 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1127/2332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:55 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1506 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:18:57.065944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-508901976", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "998b072a-86bc-4a55-9066-577586ad4414"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:57.184969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] validate_networks() for [('998b072a-86bc-4a55-9066-577586ad4414', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:18:57.258844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:57.270648 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42d2f63a-774d-4198-bd96-a0bb1742b9a1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.406166 Mar 29 02:18:57.271239 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1206/2333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:56 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:57.278267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e09e5c5-6896-4e32-9ac7-5dbc1b825cb0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f8724d0edc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:57.361358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e09e5c5-6896-4e32-9ac7-5dbc1b825cb0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 58 microversion: 2.1 time: 0.088713 Mar 29 02:18:57.361928 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1207/2334] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:18:57 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:57.368985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:57.369597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:57.385976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:57.386669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:57.387600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:57.388207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:57.464793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:18:57.805422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea389684-c89a-4909-8892-9e4e0da53f34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 204 len: 0 microversion: 2.1 time: 0.442090 Mar 29 02:18:57.806696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1208/2335] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:18:57 2022] DELETE /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:18:57.816248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20790328-313c-4f16-8a6f-693666350b35 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'update_all', calling method: .version_select at 0x7f8724d0ef70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:18:57.894104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-20790328-313c-4f16-8a6f-693666350b35 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:18:57.906039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-20790328-313c-4f16-8a6f-693666350b35 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:18:58.497286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20790328-313c-4f16-8a6f-693666350b35 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 61 microversion: 2.1 time: 0.685283 Mar 29 02:18:58.503338 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1209/2336] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:18:57 2022] PUT /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 61 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:18:58.509999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:58.511100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:58.522572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:58.523219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:58.524093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:58.524538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:58.852362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:58.868493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07c9ca55-04a2-49c3-9609-ef428f352a26 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1512 microversion: 2.1 time: 0.363850 Mar 29 02:18:58.882826 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1210/2337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:58 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:58.888155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9920ccde-73a5-4ac7-9493-d7d25eb1f458 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43c10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:59.147974 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9920ccde-73a5-4ac7-9493-d7d25eb1f458 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1454 microversion: 2.1 time: 0.262780 Mar 29 02:18:59.152395 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1211/2338] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:18:58 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:18:59.173596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:18:59.174887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:18:59.216216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:59.219963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:59.224787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:18:59.224787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:18:59.988654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:18:59.999633 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7cc5481a-a074-45a2-a1e4-0b85fa2ead3c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1657 microversion: 2.1 time: 0.843333 Mar 29 02:19:00.013436 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1212/2339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:18:59 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1657 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:00.019394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26f72944-cc53-4171-b4aa-10d5bf0186a0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Action: 'create', calling method: .version_select at 0x7f87240cf4c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:00.426915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:19:00.427361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:19:00.428865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:19:00.429290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:19:00.429989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:19:00.449026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:00.449481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:00.450292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:00.453967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:00.502245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Getting quotas for project 8d23a4584f474fdb85d8e58153e29978. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:00.513614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Getting quotas for user c85deb5dc90342e88d02accfb83272e7 and project 8d23a4584f474fdb85d8e58153e29978. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:00.542754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:19:00.550904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:19:00.788604 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-00063e97-5d8c-4c37-befa-919b95d5ca49 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.815849 Mar 29 02:19:00.792604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1128/2340] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:18:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:19:00.803761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:00.820029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:00.850589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:00.851047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:00.851832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:00.870294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:02.025667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:02.051845 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-85309e65-f3f6-4945-8d80-133da5d4348c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 200 len: 1470 microversion: 2.1 time: 1.255818 Mar 29 02:19:02.068150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1129/2341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:00 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 1470 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:02.091702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fcbdab1f-a8e5-4894-b93a-8c685eca4f7e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:02.134702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcbdab1f-a8e5-4894-b93a-8c685eca4f7e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:02.135937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcbdab1f-a8e5-4894-b93a-8c685eca4f7e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:02.269034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fcbdab1f-a8e5-4894-b93a-8c685eca4f7e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Going to try to start instance {{(pid=103514) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 02:19:02.696038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fcbdab1f-a8e5-4894-b93a-8c685eca4f7e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.623950 Mar 29 02:19:02.696930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1130/2342] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:02 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:19:02.720385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-faecb145-164b-4c23-9e26-39b044b986ba tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d6dd30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.233811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-26f72944-cc53-4171-b4aa-10d5bf0186a0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:15.239618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-faecb145-164b-4c23-9e26-39b044b986ba tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1463 microversion: 2.1 time: 12.541082 Mar 29 02:19:15.240044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-26f72944-cc53-4171-b4aa-10d5bf0186a0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Getting quotas for user 3122a49d7a7045899698dba2bc4ac85e and project 53267893f3ec4aad9b853b71bdb6244d. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:15.240235 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1131/2343] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:02 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1463 bytes in 12543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:15.246110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.246543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:15.255167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.256981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.258880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.259368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.560874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:15.568968 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-456fe3d4-d142-46c5-802f-179ad24fc1b8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 200 len: 1323 microversion: 2.1 time: 0.327807 Mar 29 02:19:15.569523 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1132/2344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:15.574105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-12e2304d-e688-47e0-9365-c225a3ec8d2f req-25de7180-6707-45e1-89f7-94f11780a36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc334912-d1f4-4de6-b1e3-df37062ffc27", "name": "network-vif-deleted", "tag": "fdb4f48b-dc1a-4be3-81b0-7462c8c55247"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:15.575707 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:15.575707 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:15.583773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-12e2304d-e688-47e0-9365-c225a3ec8d2f req-25de7180-6707-45e1-89f7-94f11780a36d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.589422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-12e2304d-e688-47e0-9365-c225a3ec8d2f req-25de7180-6707-45e1-89f7-94f11780a36d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.600319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-12e2304d-e688-47e0-9365-c225a3ec8d2f req-25de7180-6707-45e1-89f7-94f11780a36d service nova] Creating event network-vif-deleted:fdb4f48b-dc1a-4be3-81b0-7462c8c55247 for instance bc334912-d1f4-4de6-b1e3-df37062ffc27 on n-h2-828148-1 Mar 29 02:19:15.605205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-12e2304d-e688-47e0-9365-c225a3ec8d2f req-25de7180-6707-45e1-89f7-94f11780a36d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034224 Mar 29 02:19:15.605782 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1133/2345] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:15.612467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.613191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:15.622252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.622754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.623492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.623921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.715992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26f72944-cc53-4171-b4aa-10d5bf0186a0 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "POST /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 85 microversion: 2.1 time: 15.699866 Mar 29 02:19:15.715992 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1213/2346] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Mar 29 02:19:00 2022] POST /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 85 bytes in 15701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:19:15.721807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.722428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:15.730617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.731463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.732365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.733501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.772742 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:19:15.790361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. Mar 29 02:19:15.791214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:15.793056 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 404 len: 111 microversion: 2.1 time: 0.076252 Mar 29 02:19:15.793773 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1214/2347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:19:15.794873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.796483 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4c8cbfb-bf5b-4123-9616-c61b9279b2fd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001787 Mar 29 02:19:15.797242 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1215/2348] 10.222.0.36 () {56 vars in 885 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 29 02:19:15.806796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f680e940-ae02-428f-96e7-ff2e35ee8d82 req-a2068d0a-ba1b-4f82-8715-143a22be0066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "name": "network-vif-plugged", "status": "completed", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:15.808804 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:15.808804 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:15.817892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f680e940-ae02-428f-96e7-ff2e35ee8d82 req-a2068d0a-ba1b-4f82-8715-143a22be0066 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.818586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f680e940-ae02-428f-96e7-ff2e35ee8d82 req-a2068d0a-ba1b-4f82-8715-143a22be0066 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.839768 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f680e940-ae02-428f-96e7-ff2e35ee8d82 req-a2068d0a-ba1b-4f82-8715-143a22be0066 service nova] Creating event network-vif-plugged:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:19:15.846506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f680e940-ae02-428f-96e7-ff2e35ee8d82 req-a2068d0a-ba1b-4f82-8715-143a22be0066 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046227 Mar 29 02:19:15.847442 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1216/2349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:15.864066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29a887b4-3d67-471b-b9b4-46e1c0d35adf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724b09790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.900496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:15.911373 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31ab9bc8-46d0-4db1-942c-9c339e5764de tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.303483 Mar 29 02:19:15.912027 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1134/2350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:15.931728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d37755d3-f9b8-4ac3-9111-e47cd61a2459 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '.version_select at 0x7f872436dc10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.933111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29a887b4-3d67-471b-b9b4-46e1c0d35adf tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 200 len: 1463 microversion: 2.1 time: 0.084170 Mar 29 02:19:15.934146 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1217/2351] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 1463 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:15.938657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:15.939361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:15.947249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.947897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:15.948821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:15.949432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.011594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d37755d3-f9b8-4ac3-9111-e47cd61a2459 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata" status: 200 len: 85 microversion: 2.1 time: 0.087471 Mar 29 02:19:16.012697 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1135/2352] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/images/07b1c6a0-5925-4870-8e93-aecd9329b835/metadata => generated 85 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:19:16.015088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d37755d3-f9b8-4ac3-9111-e47cd61a2459 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.018898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d37755d3-f9b8-4ac3-9111-e47cd61a2459 tempest-ImagesMetadataTestJSON-1423418870 tempest-ImagesMetadataTestJSON-1423418870-project] 10.222.0.36 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.005006 Mar 29 02:19:16.019628 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1136/2353] 10.222.0.36 () {54 vars in 1034 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Mar 29 02:19:16.032097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.032787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:16.052524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.052987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.053766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.054195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.288948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:16.298259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c8dace0-4ed3-44c0-94a5-f9bc7d5fece9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.277689 Mar 29 02:19:16.310460 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1137/2354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:16.319270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.320391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:16.329036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:16.329767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.330706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.331708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.332350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.340928 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.402453 Mar 29 02:19:16.342860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1218/2355] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:15 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:16.348905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.352133 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27109632-1147-40ff-8930-7caef18fd59f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004451 Mar 29 02:19:16.352661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1219/2356] 10.222.0.36 () {54 vars in 1040 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:16.372718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:16.375126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:16.390698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.390698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.391084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.391513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.555921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:16.564929 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1468 microversion: 2.1 time: 0.252620 Mar 29 02:19:16.565496 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1138/2357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:16.566464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.567409 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a6617d8c-50ba-469f-b913-3a6cc7ac6d45 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001136 Mar 29 02:19:16.567728 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1139/2358] 10.222.0.36 () {56 vars in 885 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 29 02:19:16.572135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-65c48dc4-fdeb-45a0-91aa-5dd3baec50d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:16.573390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-65c48dc4-fdeb-45a0-91aa-5dd3baec50d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:16.574159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-65c48dc4-fdeb-45a0-91aa-5dd3baec50d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.005589 Mar 29 02:19:16.574650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1140/2359] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:16 2022] POST /compute/v2.1/servers => generated 127 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:16.584654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1827437906"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:16.585723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:16.601387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.602093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.602905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.603649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.699928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Unlocking {{(pid=103513) unlock /opt/stack/nova/nova/compute/api.py:4587}} Mar 29 02:19:16.784515 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58942. Mar 29 02:19:16.963065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-279fe0c8-6f2e-4d42-a0ff-52cccc92d63e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.600403 Mar 29 02:19:16.970400 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1220/2360] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:16 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:19:16.970400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:16.970400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:16.986032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.986641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:16.987517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:16.988210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.297387 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0423a4f-a6c6-4e71-853b-ef9a2287dcd0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "POST /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694/action" status: 202 len: 0 microversion: 2.1 time: 0.717365 Mar 29 02:19:17.317769 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1141/2361] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:16 2022] POST /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Mar 29 02:19:17.328809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:17.329906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:17.371695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:17.382784 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dbeed09e-ff9e-491b-bb11-fe2f2e615d29 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.417252 Mar 29 02:19:17.383702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1221/2362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:16 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:17.390034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.390333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:17.392707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.392829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:17.392949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.392949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.406275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.411455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.411455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.411455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.672873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:17.684895 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8575002-f6e3-46e9-8286-6d2b942b1d9a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.299585 Mar 29 02:19:17.706280 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1222/2363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:17 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:17.714795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b9ae4e4-66a1-4e3a-ad1c-eee58369c1d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:17.785285 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b9ae4e4-66a1-4e3a-ad1c-eee58369c1d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.077649 Mar 29 02:19:17.785949 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1223/2364] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:17 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:17.790390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:17.790981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:17.798664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.799353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.800133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.800585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.902442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:17.910854 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c94d985c-a7ec-4095-aaff-70150cf8a10c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 200 len: 1519 microversion: 2.1 time: 0.596945 Mar 29 02:19:17.911511 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1142/2365] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:17 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 1519 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:17.923245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-443c3bd6-90d9-46a1-985a-e78312093730 req-6c100747-5347-4a61-89ab-d6ae68c79d01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-443c3bd6-90d9-46a1-985a-e78312093730 req-6c100747-5347-4a61-89ab-d6ae68c79d01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-443c3bd6-90d9-46a1-985a-e78312093730 req-6c100747-5347-4a61-89ab-d6ae68c79d01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-443c3bd6-90d9-46a1-985a-e78312093730 req-6c100747-5347-4a61-89ab-d6ae68c79d01 service nova] Creating event network-changed:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:19:17.958931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-443c3bd6-90d9-46a1-985a-e78312093730 req-6c100747-5347-4a61-89ab-d6ae68c79d01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035476 Mar 29 02:19:17.959676 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1143/2366] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:17.961079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:17.961578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:17.969432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.969970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:17.970653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:17.971086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:18.064003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:18.079517 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-133e4b4b-985c-4331-ab51-c3fc87fe4ede tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.290673 Mar 29 02:19:18.081610 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1224/2367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:17 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:18.096959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36eff483-c839-4093-976f-71f141a08799 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'create', calling method: .version_select at 0x7f87240cfe50>, body: {"pool": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:18.420602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:18.438011 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dfcaa56-d622-494e-9589-af27a502815f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.481146 Mar 29 02:19:18.438946 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1144/2368] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:17 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:18.454594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:18.455207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:18.466074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:18.466074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:18.466074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:18.466074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:18.722975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:18.733411 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-162241d3-1970-4dd7-894b-8c364728039b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.282190 Mar 29 02:19:18.749197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1145/2369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:18 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:18.762339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:18.763415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:18.782515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:18.784604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:18.786181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:18.786651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:19.227654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3fdf4234-d251-48b5-b1b5-7ff002cff69a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.475507 Mar 29 02:19:19.228783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1146/2370] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:18 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:19:19.251677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-832213bc-ca04-47a1-8950-6aae49d7fb8b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724350c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:19.362603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-832213bc-ca04-47a1-8950-6aae49d7fb8b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.131550 Mar 29 02:19:19.364542 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1147/2371] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:19 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:19.374399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:19.375700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:19.395145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:19.395797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:19.396858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:19.397418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:19.885817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:19.893556 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6390d2d1-e8f3-4967-bcf4-983e6fa6615c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1675 microversion: 2.1 time: 0.527785 Mar 29 02:19:19.894805 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1148/2372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:19 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1675 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:19.954826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2f44a6ab-b04c-41dc-9f02-2797c8fdbe90 req-90c457a3-4355-44e2-97ee-34748ac04db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46", "name": "network-vif-unplugged", "status": "completed", "tag": "faa71cb0-0282-4786-98a7-fcfe8beb8b52"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:19.954826 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:19.954826 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:19.966214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2f44a6ab-b04c-41dc-9f02-2797c8fdbe90 req-90c457a3-4355-44e2-97ee-34748ac04db7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:19.967619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2f44a6ab-b04c-41dc-9f02-2797c8fdbe90 req-90c457a3-4355-44e2-97ee-34748ac04db7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:19.994518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2f44a6ab-b04c-41dc-9f02-2797c8fdbe90 req-90c457a3-4355-44e2-97ee-34748ac04db7 service nova] Creating event network-vif-unplugged:faa71cb0-0282-4786-98a7-fcfe8beb8b52 for instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 on n-h1-828148-1 Mar 29 02:19:20.006889 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2f44a6ab-b04c-41dc-9f02-2797c8fdbe90 req-90c457a3-4355-44e2-97ee-34748ac04db7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060286 Mar 29 02:19:20.009908 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1149/2373] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:20.379001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c3943e6-d1c2-44f2-bba9-ff639c1e0406 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87243a0670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:20.449689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c3943e6-d1c2-44f2-bba9-ff639c1e0406 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.077723 Mar 29 02:19:20.452257 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1150/2374] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:20 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:19:20.922045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e8fba8f-dc31-4bc8-9228-56106bec8ba1 tempest-ListImageFiltersNegativeTestJSON-794682704 tempest-ListImageFiltersNegativeTestJSON-794682704-project] Calling method '.version_select at 0x7f8717f5c8b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:20.949634 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2e8fba8f-dc31-4bc8-9228-56106bec8ba1 tempest-ListImageFiltersNegativeTestJSON-794682704 tempest-ListImageFiltersNegativeTestJSON-794682704-project] HTTP exception thrown: Image not found. Mar 29 02:19:20.950546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e8fba8f-dc31-4bc8-9228-56106bec8ba1 tempest-ListImageFiltersNegativeTestJSON-794682704 tempest-ListImageFiltersNegativeTestJSON-794682704-project] Returning 404 to user: Image not found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:20.952235 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e8fba8f-dc31-4bc8-9228-56106bec8ba1 tempest-ListImageFiltersNegativeTestJSON-794682704 tempest-ListImageFiltersNegativeTestJSON-794682704-project] 10.222.0.36 "GET /compute/v2.1/images/0b0969b7-96b1-48d5-bd49-cb4ac3b7ee3f" status: 404 len: 62 microversion: 2.1 time: 0.196292 Mar 29 02:19:20.953558 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1151/2375] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:20 2022] GET /compute/v2.1/images/0b0969b7-96b1-48d5-bd49-cb4ac3b7ee3f => generated 62 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:19:20.967783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:20.968880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:20.978495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:20.979225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:20.980392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:20.981320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:21.266308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:21.275295 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3bb121ab-f195-4fd2-90be-7d1b8b50a87d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1655 microversion: 2.1 time: 0.320298 Mar 29 02:19:21.275826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1152/2376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:20 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1655 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:21.291606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:21.292143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:21.300125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:21.300573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:21.301377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:21.302079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:21.680987 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5af84de2-a91a-47e9-b4ff-90d0a165453d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.392519 Mar 29 02:19:21.686025 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1153/2377] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:21 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:19:21.702094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d9cd751c-ad7c-420e-9020-ca6c9abbae1b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f872436d4c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:21.793429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d9cd751c-ad7c-420e-9020-ca6c9abbae1b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.102972 Mar 29 02:19:21.793429 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1154/2378] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:21 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:21.804872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:21.815240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:21.854659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:21.855135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:21.855953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:21.856385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:22.181963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36eff483-c839-4093-976f-71f141a08799 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.096125 Mar 29 02:19:22.183515 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1225/2379] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:19:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:22.189020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df06e3bb-521e-473c-af34-5965d41e3c38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-384786897", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0591bbdf-e29b-4067-8cfa-6f8d50df4163", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:22.307134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-df06e3bb-521e-473c-af34-5965d41e3c38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Block Device 0591bbdf-e29b-4067-8cfa-6f8d50df4163 is not bootable. Mar 29 02:19:22.307976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df06e3bb-521e-473c-af34-5965d41e3c38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Block Device 0591bbdf-e29b-4067-8cfa-6f8d50df4163 is not bootable. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:22.309000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df06e3bb-521e-473c-af34-5965d41e3c38 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.124266 Mar 29 02:19:22.314702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1226/2380] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:22 2022] POST /compute/v2.1/servers => generated 110 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:22.320499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-484064771", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "998b072a-86bc-4a55-9066-577586ad4414"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:22.454262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:22.479812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] validate_networks() for [('998b072a-86bc-4a55-9066-577586ad4414', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:19:22.480216 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d9d6d95-19ed-49bd-be57-a8596086bd4f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1662 microversion: 2.1 time: 0.683404 Mar 29 02:19:22.485553 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1155/2381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:21 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1662 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:22.493187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:22.494573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:22.525517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:22.525974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:22.532489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:22.532489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:22.848996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:22.858109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfb48c5d-bbf8-4573-bee2-25627d2bc5c6 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.370843 Mar 29 02:19:22.861039 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1156/2382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:22 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:22.863120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d433e1f-9937-47ae-8853-0b560725df38 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f872436d310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:22.923134 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d433e1f-9937-47ae-8853-0b560725df38 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.063349 Mar 29 02:19:22.923703 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1157/2383] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:22 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:22.928362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:22.928994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:22.936780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:22.937268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:22.938240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:22.938449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:23.157966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:23.166363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38933011-1a03-41fb-a0ba-f737cc9f995b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.241618 Mar 29 02:19:23.167204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1158/2384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:22 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:23.471233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:19:23.471779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:19:23.472274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:19:23.472683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:19:23.473140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:19:23.482054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:23.482529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:23.483320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:23.483745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:23.499695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:23.500301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:23.510599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:23.511039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:23.511813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:23.512223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:23.515163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Getting quotas for project 8d23a4584f474fdb85d8e58153e29978. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:23.521364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Getting quotas for user c85deb5dc90342e88d02accfb83272e7 and project 8d23a4584f474fdb85d8e58153e29978. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:23.536233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:19:23.538872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:19:23.789182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc49b262-4fd0-4db3-a5d6-f634f110174f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476411 Mar 29 02:19:23.791843 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1227/2385] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:19:23.814097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cb661fe8-1e15-4978-be46-a528beea6f0a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:23.821046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cb661fe8-1e15-4978-be46-a528beea6f0a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:24.130076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb661fe8-1e15-4978-be46-a528beea6f0a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:24.140374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cb661fe8-1e15-4978-be46-a528beea6f0a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1223 microversion: 2.1 time: 0.341078 Mar 29 02:19:24.141145 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1228/2386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:23 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1223 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:19:24.147441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5daa4482-e358-460f-a08c-b857fe4f9a08 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717ea8820>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:24.224214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5daa4482-e358-460f-a08c-b857fe4f9a08 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.081475 Mar 29 02:19:24.225233 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1229/2387] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:24 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:24.235857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f27e683b-95b4-412d-97a7-86f9147e31be req-2f5cedb4-68f3-48a1-8eaa-538687211b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-plugged", "status": "completed", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:24.237986 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:24.237986 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:24.251423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f27e683b-95b4-412d-97a7-86f9147e31be req-2f5cedb4-68f3-48a1-8eaa-538687211b9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:24.252965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f27e683b-95b4-412d-97a7-86f9147e31be req-2f5cedb4-68f3-48a1-8eaa-538687211b9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:24.285570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f27e683b-95b4-412d-97a7-86f9147e31be req-2f5cedb4-68f3-48a1-8eaa-538687211b9e service nova] Creating event network-vif-plugged:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:19:24.293392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f27e683b-95b4-412d-97a7-86f9147e31be req-2f5cedb4-68f3-48a1-8eaa-538687211b9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066412 Mar 29 02:19:24.294951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1230/2388] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:24.311666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:24.329418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a85ed6e8-316d-49e1-8f6e-fb8e197b0f82 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.833227 Mar 29 02:19:24.343068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1159/2389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:23 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:24.349981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:24.350679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:24.361426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:24.362710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:24.364231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:24.365116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:24.748931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:24.754110 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-789e0d2f-7d6e-4f5e-bdd1-21f24b8761e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.409702 Mar 29 02:19:24.754822 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1231/2390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:24.773276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:24.774836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:24.785966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:24.797632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:24.797632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:24.797632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:25.161272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:25.162313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:25.180589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:25.181292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:25.182222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:25.182799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:25.363732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:25.375074 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82d9751a-c80c-476f-ba7d-2608a981223c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1227 microversion: 2.1 time: 0.219289 Mar 29 02:19:25.375975 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1232/2391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:25 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1227 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:19:25.381026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6731a63d-2794-41b9-81de-1162880eb1c0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717ed6160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:25.417895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:25.427477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-48bfbd11-5e62-4100-b0c1-6d11b84e97e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.658618 Mar 29 02:19:25.430073 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1160/2392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:25.453678 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6731a63d-2794-41b9-81de-1162880eb1c0 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.069454 Mar 29 02:19:25.453678 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1233/2393] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:25 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:25.463311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:25.464056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:25.471617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:25.472115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:25.472998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:25.473439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.069632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:26.087026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ecf14a87-195d-4c44-b168-39884ac90faa tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.623921 Mar 29 02:19:26.087026 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1161/2394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:25 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:26.100138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.101635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:26.115291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.115291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.115631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.116067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.359048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:26.369269 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2976d7e2-a114-49a0-94d4-49dcb8c6b911 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.272843 Mar 29 02:19:26.380557 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1234/2395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:26.388038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.388744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:26.402438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.402884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.403463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.406844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:26.406950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.406950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.419166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.423843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.429859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.429859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.591672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:26.603715 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be0997c3-3a57-41d7-813f-01ecb6d260f6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1275 microversion: 2.1 time: 0.209512 Mar 29 02:19:26.604476 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1235/2396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1275 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:26.609956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11170fe4-291d-4f4f-9c37-5528ae3c5489 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717fbd310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.696369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11170fe4-291d-4f4f-9c37-5528ae3c5489 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.090456 Mar 29 02:19:26.697265 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1236/2397] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:26.704879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2ab36f3-d0be-4d9d-9bb3-e808aceeb602 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-559318296", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "destination_type": "local"}, {"source_type": "volume", "uuid": "429add9a-5fd3-4789-aa8b-f9fb34cabedc", "destination_type": "invalid"}], "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:26.704879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2ab36f3-d0be-4d9d-9bb3-e808aceeb602 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:26.705223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2ab36f3-d0be-4d9d-9bb3-e808aceeb602 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.006365 Mar 29 02:19:26.707196 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1237/2398] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:26 2022] POST /compute/v2.1/servers => generated 155 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:26.721265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.722755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:26.731556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.732903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.733869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:26.734470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:26.969532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:26.981055 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6be4a798-e1d2-419d-ba68-0b1a75b9ba3e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.265801 Mar 29 02:19:26.981609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1238/2399] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:26.999029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:26.999724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:27.007426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.007873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.008655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.009128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.224028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:27.238548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ede70f88-07b9-4023-b1dc-e5ae2e4c08f8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.856400 Mar 29 02:19:27.239041 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1162/2400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:27.487921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:27.496944 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-468e2237-b833-4f66-96ad-8a92ba587900 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.502295 Mar 29 02:19:27.498070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1239/2401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:26 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:27.563748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81f5b670-7e6a-4782-ac9b-4fc013ca165e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1010568463", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:27.565220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81f5b670-7e6a-4782-ac9b-4fc013ca165e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:27.566063 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81f5b670-7e6a-4782-ac9b-4fc013ca165e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.006335 Mar 29 02:19:27.566583 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1163/2402] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:27 2022] POST /compute/v2.1/servers => generated 624 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:27.574398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:27.575008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:27.585064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.585064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.585064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.585064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.629065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:27.634745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:27.663430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.663430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.667196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:27.670195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:27.824979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:27.844554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2c34ba10-2a45-41a7-bbd7-7ba088c1709f tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1281 microversion: 2.1 time: 0.221144 Mar 29 02:19:27.846732 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1164/2403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:27 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1281 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:27.853885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84d8e4f2-bed2-44fb-a8b0-29c81b86a1c3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717f340d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:27.931870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84d8e4f2-bed2-44fb-a8b0-29c81b86a1c3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.084050 Mar 29 02:19:27.932514 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1165/2404] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:27 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:28.003017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:28.014134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa523ac9-0be3-43d1-bd73-7fdbbf501e85 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.442710 Mar 29 02:19:28.015306 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1240/2405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:27 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:28.035709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:28.037322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:28.047219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:28.048741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:28.049787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:28.050442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:28.398063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ade0e5fa-8919-4d10-9900-323fb752a9fe tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8717ed6160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-29937371", "description": "tempest-description-78362240"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:28.573004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:28.584147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e506d3e-1e13-42f3-aad0-bf35d219da94 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.553449 Mar 29 02:19:28.584494 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1166/2406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:28 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:28.709366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3abf6f3f-fe64-403b-a772-083b1f15e65a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:28.710897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3abf6f3f-fe64-403b-a772-083b1f15e65a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:28.711704 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3abf6f3f-fe64-403b-a772-083b1f15e65a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006137 Mar 29 02:19:28.712237 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1167/2407] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:28 2022] POST /compute/v2.1/servers => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:19:28.727701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:28.736566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:28.753967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:28.761497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:28.762766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:28.763743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:29.367576 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ade0e5fa-8919-4d10-9900-323fb752a9fe tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 240 microversion: 2.1 time: 1.181440 Mar 29 02:19:29.368955 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1241/2408] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:19:28 2022] POST /compute/v2.1/os-security-groups => generated 240 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:19:29.374192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:29.375169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:29.393930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:29.396952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:29.401743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:29.402609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:29.436449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:29.448505 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-79630b2d-08d6-4f83-923a-32674a00cc03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.724405 Mar 29 02:19:29.449114 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1168/2409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:28 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:29.478669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32d12f09-2054-4a2e-a709-d44e899428d4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717f34550>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:29.573373 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32d12f09-2054-4a2e-a709-d44e899428d4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.105722 Mar 29 02:19:29.579269 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1169/2410] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:29 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:29.589189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5dbc0315-412a-4ecb-83ae-e07ec6d750f4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8717f34c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1549326894", "description": "tempest-description-331712710"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:30.480447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:30.501365 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dae5515-43b7-4f20-9d18-2140768f3ef2 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 1.130957 Mar 29 02:19:30.502080 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1242/2411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:29 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:30.521912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:30.532917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:30.541044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:30.542582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:30.543716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:30.544374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:30.788207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5dbc0315-412a-4ecb-83ae-e07ec6d750f4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.204897 Mar 29 02:19:30.790350 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1170/2412] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:19:29 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:30.798272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc6fe781-3a83-447d-8a91-e4d999737afd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724211040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:30.908604 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc6fe781-3a83-447d-8a91-e4d999737afd tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.116815 Mar 29 02:19:30.909612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1171/2413] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:30 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:30.922063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-108631243", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "eeb1fafd-c7c7-4d1d-bc00-0de30e05c250"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:31.035761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] validate_networks() for [('eeb1fafd-c7c7-4d1d-bc00-0de30e05c250', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:19:31.199295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:31.215078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11f2229f-870f-49ec-a90e-7d8a31f72440 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.708409 Mar 29 02:19:31.229835 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1243/2414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:31.247045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b5be7954-26d1-449a-89b6-2f5db4c58367 req-385080e9-4857-408f-89c6-3b40d051b08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1020c507-540a-4100-9fb6-091dfeea06d5", "tag": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:31.253555 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:31.253555 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:31.290866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b5be7954-26d1-449a-89b6-2f5db4c58367 req-385080e9-4857-408f-89c6-3b40d051b08c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:31.290866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b5be7954-26d1-449a-89b6-2f5db4c58367 req-385080e9-4857-408f-89c6-3b40d051b08c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:31.349199 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b5be7954-26d1-449a-89b6-2f5db4c58367 req-385080e9-4857-408f-89c6-3b40d051b08c service nova] Creating event network-changed:8612595e-f8da-4bba-8d2b-bb05bd0f8abb for instance 1020c507-540a-4100-9fb6-091dfeea06d5 on n-h2-828148-1 Mar 29 02:19:31.368111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b5be7954-26d1-449a-89b6-2f5db4c58367 req-385080e9-4857-408f-89c6-3b40d051b08c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136241 Mar 29 02:19:31.369981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1244/2415] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:31.383607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-078e698e-f509-4541-93e7-d80427986940 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-625661219", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": -1, "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:31.433596 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-078e698e-f509-4541-93e7-d80427986940 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Flavor -1 could not be found. Mar 29 02:19:31.435111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-078e698e-f509-4541-93e7-d80427986940 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:31.436135 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-078e698e-f509-4541-93e7-d80427986940 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064862 Mar 29 02:19:31.441760 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1245/2416] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:31 2022] POST /compute/v2.1/servers => generated 73 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:19:31.455719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:31.459085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:31.478640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:31.479383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:31.480481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:31.481586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:32.195560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:32.205265 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-faef9b16-c1dc-4c86-8aaf-d17f92800877 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.757523 Mar 29 02:19:32.208755 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1246/2417] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:31 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:32.234086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:32.234086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:32.252120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:32.253148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:32.257413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:32.257413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:32.942025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:19:32.942450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:19:32.943667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:19:32.944105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:19:32.944699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:19:32.956854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:32.957447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:32.958430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:32.959035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:33.001073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Getting quotas for project e0a643d48830408fb8ab75ad5d8040a2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:33.019439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Getting quotas for user 47c8cbb3524b44628dcb9c78f8a06fe4 and project e0a643d48830408fb8ab75ad5d8040a2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:33.055031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:19:33.064071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:19:33.234442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:33.245266 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-612f9194-ceef-4442-81c5-2b52e4817a70 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 1.035260 Mar 29 02:19:33.246118 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1247/2418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:32 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:33.260606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-707b0f0b-7b07-4bbb-b5b2-a1fd3720bc32 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241721f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:33.291094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9497e271-9a01-41b1-b708-ff68c34eff5b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.380039 Mar 29 02:19:33.294337 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1172/2419] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:19:33.308152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:33.310791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:33.333398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:33.333398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:33.333398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:33.333398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:33.365440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-707b0f0b-7b07-4bbb-b5b2-a1fd3720bc32 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.108292 Mar 29 02:19:33.366304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1248/2420] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:33 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:33.373247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d4ad553-19ac-4692-9bc8-7fb3937c4cee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:33.374053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d4ad553-19ac-4692-9bc8-7fb3937c4cee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:33.597734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d4ad553-19ac-4692-9bc8-7fb3937c4cee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:33.600291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d4ad553-19ac-4692-9bc8-7fb3937c4cee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1215 microversion: 2.1 time: 0.232382 Mar 29 02:19:33.622081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1249/2421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:33 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:34.015069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:34.033612 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-385af1a3-d28a-4ef8-86bf-6579fde2a1b2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.737637 Mar 29 02:19:34.037648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1173/2422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:33 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:34.151250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91f3a71d-40c5-4bc5-80d2-f60947d87f56 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-192638543", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:34.153130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91f3a71d-40c5-4bc5-80d2-f60947d87f56 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:34.154608 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91f3a71d-40c5-4bc5-80d2-f60947d87f56 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.007180 Mar 29 02:19:34.155485 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1250/2423] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:34.177952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:34.178917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:34.203934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:34.209110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:34.212440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:34.219287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:34.264554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:34.265442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:34.280257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:34.283529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:34.291084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:34.291791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:34.862622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:34.915309 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87820979-7170-4c93-8d96-497b9807db81 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.737658 Mar 29 02:19:34.920431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1174/2424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:34 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:34.924485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:34.951526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6424268d-e880-4f13-9768-a84a9a710e06 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.692087 Mar 29 02:19:34.952508 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1251/2425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:34 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:34.982238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dde69ce-f2ed-42b3-8782-f2203aa9cda9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717f34820>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:34.984205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:35.006409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:35.043115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:35.043826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:35.052166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:35.053570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:35.092259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dde69ce-f2ed-42b3-8782-f2203aa9cda9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.168526 Mar 29 02:19:35.093887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1175/2426] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:34 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:35.113630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:35.113630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:35.120831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:35.122205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:35.123228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:35.123926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:35.566820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:35.664152 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-28550361-0dc5-47fd-910e-9f6d77174f3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1219 microversion: 2.1 time: 0.689509 Mar 29 02:19:35.666791 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1252/2427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:34 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1219 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:35.713887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:35.744555 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7fda3516-38c9-44ca-ab7c-20695212544a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.649398 Mar 29 02:19:35.748804 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1176/2428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:35 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:35.990170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:35.993164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:36.038777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:36.038975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:36.041619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: .version_select at 0x7f8724b99f70>, body: {"keypair": {"name": "tempest-keypair-2142932223"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:36.056167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:36.057195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:36.195728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:36.233283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:36.621637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:36.633728 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99e55468-cd8a-4e9f-8270-a019db9925e6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.648445 Mar 29 02:19:36.635362 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1177/2429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:35 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:19:36.665285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03ee91da-0fd1-414a-8f5d-10ad2b5019d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607822142", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:36.671352 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-03ee91da-0fd1-414a-8f5d-10ad2b5019d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Mar 29 02:19:36.672445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03ee91da-0fd1-414a-8f5d-10ad2b5019d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:36.674939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03ee91da-0fd1-414a-8f5d-10ad2b5019d4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.037729 Mar 29 02:19:36.677108 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1178/2430] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:36.687490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bdff5489-557e-4498-9360-4ce9579eec28 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724211310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:36.803935 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bdff5489-557e-4498-9360-4ce9579eec28 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.123316 Mar 29 02:19:36.805967 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1179/2431] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:36 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:36.815510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:36.880018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:36.880018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:36.880018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:36.880018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:36.882393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:37.081051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:37.093850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a30efbb4-e05a-49c8-a9cc-f0942b2a82d7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.286226 Mar 29 02:19:37.095111 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1180/2432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:36 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:37.099904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:37.100831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:37.113005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:37.113005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:37.113005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:37.113005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:37.266662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:37.273097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:37.291483 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5a54ccf-c6c3-4896-9edc-f7edf742189d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.607535 Mar 29 02:19:37.292677 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1253/2433] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:19:35 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:37.298543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-843994051", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c"}], "block_device_mapping_v2": [{"uuid": "1127f8ba-19c7-4099-8b59-e37e88de0641", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:37.411981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:37.440041 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d7b61d34-d2db-47e6-87f5-0d877bbcd191 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1275 microversion: 2.1 time: 0.340041 Mar 29 02:19:37.443612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1181/2434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:37 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1275 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:37.469278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:37.469278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:37.519592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:37.523513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:37.524445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:37.524943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:37.882147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] validate_networks() for [('da8dd0a3-3bfb-40a3-ae54-5882b0c70c4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:19:38.237902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:38.269559 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c28c200-e6a5-40b5-9514-d19033c6a456 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.823240 Mar 29 02:19:38.271569 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1182/2435] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:37 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:38.277291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:38.277914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:38.305249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:38.307191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:38.309072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:38.310398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:38.690166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:38.700007 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af762d79-4c97-4b8a-83c3-cd5496e59413 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.426544 Mar 29 02:19:38.700007 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1183/2436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:38 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:38.707484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2c199fe2-0251-4edf-a84b-1a771b1e8792 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dc9d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:38.838784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2c199fe2-0251-4edf-a84b-1a771b1e8792 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.137300 Mar 29 02:19:38.848264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1184/2437] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:38 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:38.867282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-424e2215-6c50-4b54-889f-153a20d047e7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213579379", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-key-1099151686", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:39.040735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-424e2215-6c50-4b54-889f-153a20d047e7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] validate_networks() for [('a722a75c-2ddf-4bff-8ad8-e09644f11137', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:19:39.412049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:19:39.412467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:19:39.412992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:19:39.413392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:19:39.413805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:19:39.430389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:39.431283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:39.432412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:39.433518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:39.462134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:39.472286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Getting quotas for user 808db28af62c4400b9f28220649f0985 and project 398f7f38ad214cc9a1b389b1cc6f4dd1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:39.586850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:19:39.589781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1127f8ba-19c7-4099-8b59-e37e88de0641',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:19:39.820983 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-424e2215-6c50-4b54-889f-153a20d047e7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Invalid key_name provided. Mar 29 02:19:39.822741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-424e2215-6c50-4b54-889f-153a20d047e7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid key_name provided. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:39.826022 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-424e2215-6c50-4b54-889f-153a20d047e7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.976646 Mar 29 02:19:39.836278 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1185/2438] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:38 2022] POST /compute/v2.1/servers => generated 70 bytes in 983 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:19:39.851550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:39.861313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:39.876111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:39.877588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:39.879542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:39.886706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:40.305716 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72b8f2f8-9a50-4499-98eb-73ae53d445a3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.011615 Mar 29 02:19:40.306613 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1254/2439] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:19:40.317700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:40.319648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:40.339703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:40.341582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:40.342560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:40.346135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:41.265444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:41.276474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0536ed2-996e-48ba-a7d9-a45189b0a31a tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.962446 Mar 29 02:19:41.277088 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1255/2440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:40 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:41.282358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:41.287327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:41.313261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:41.313662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:41.314465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:41.314904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:41.995821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:42.011690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a821e598-3744-4550-a3d5-1a2f2dbb8f50 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 2.173507 Mar 29 02:19:42.012556 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1186/2441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:39 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:42.017833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90c0ac5f-7347-4007-8c4b-dfe1dcdd316a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717f34a60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:42.088987 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-90c0ac5f-7347-4007-8c4b-dfe1dcdd316a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.068327 Mar 29 02:19:42.088987 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1187/2442] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:42 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:42.088987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:42.088987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:42.097091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.097737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.098873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.099460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.333721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:42.347278 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7e128cb-a828-47d0-9710-fcca3c9ca7db tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 1.068395 Mar 29 02:19:42.350087 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1256/2443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:41 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:42.370952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3cc46611-c56d-4304-b58a-052ac1833c52 req-0268bb88-40c8-4ca3-9e0e-ef48fd1f1c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1020c507-540a-4100-9fb6-091dfeea06d5", "name": "network-vif-plugged", "status": "completed", "tag": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:42.378760 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:42.378760 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:42.382044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:42.393944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56c3fbbf-09a4-4d80-955c-cdec69d4b6cc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1102 microversion: 2.1 time: 0.307526 Mar 29 02:19:42.398102 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1188/2444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:42 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1102 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:42.401862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3cc46611-c56d-4304-b58a-052ac1833c52 req-0268bb88-40c8-4ca3-9e0e-ef48fd1f1c31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.402786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:42.403437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:42.405653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3cc46611-c56d-4304-b58a-052ac1833c52 req-0268bb88-40c8-4ca3-9e0e-ef48fd1f1c31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.441823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.441823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.441823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.441823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.454166 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3cc46611-c56d-4304-b58a-052ac1833c52 req-0268bb88-40c8-4ca3-9e0e-ef48fd1f1c31 service nova] Creating event network-vif-plugged:8612595e-f8da-4bba-8d2b-bb05bd0f8abb for instance 1020c507-540a-4100-9fb6-091dfeea06d5 on n-h2-828148-1 Mar 29 02:19:42.468058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3cc46611-c56d-4304-b58a-052ac1833c52 req-0268bb88-40c8-4ca3-9e0e-ef48fd1f1c31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112072 Mar 29 02:19:42.470154 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1257/2445] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:42.486345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:42.491274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:42.511278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.515068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:42.516089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:42.519633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.101162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:43.124464 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-776b165f-e0c0-4563-8711-c5330806db25 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.725138 Mar 29 02:19:43.125135 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1189/2446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:42 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:43.143752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5d3a7324-c2d2-4ee3-84d7-0100bb7c2cfe req-0c81a04b-857f-45c7-a325-eee73ee738ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:43.145687 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:43.145687 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:43.166329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5d3a7324-c2d2-4ee3-84d7-0100bb7c2cfe req-0c81a04b-857f-45c7-a325-eee73ee738ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.167073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5d3a7324-c2d2-4ee3-84d7-0100bb7c2cfe req-0c81a04b-857f-45c7-a325-eee73ee738ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.169237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:43.181182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-098d6da4-1a32-4c93-a822-e3ca25800f13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.706284 Mar 29 02:19:43.182669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1258/2447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:42 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:43.191622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:43.193648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:43.210228 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5d3a7324-c2d2-4ee3-84d7-0100bb7c2cfe req-0c81a04b-857f-45c7-a325-eee73ee738ed service nova] Creating event network-changed:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:19:43.216361 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5d3a7324-c2d2-4ee3-84d7-0100bb7c2cfe req-0c81a04b-857f-45c7-a325-eee73ee738ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089168 Mar 29 02:19:43.217180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1190/2448] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:43.220029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.221638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.222510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.222854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c0910b9-75bd-4994-89e9-54fbf01ee23e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d41dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:43.222974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.297781 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c0910b9-75bd-4994-89e9-54fbf01ee23e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.079214 Mar 29 02:19:43.298916 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1191/2449] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:43 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:43.318642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1441272033", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff676c7f-9045-4fad-b565-a27f45650edb"}], "security_groups": [{"name": "tempest-securitygroup--1753181270"}], "key_name": "tempest-keypair-2142932223", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:43.509053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:43.521807 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-904702e7-1ed6-4186-b45d-39a9dbca2a48 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.337487 Mar 29 02:19:43.524236 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1259/2450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:43 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:43.536907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec5ce48d-8683-4793-a812-3a6f88e6b0bf tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-781220786", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:43.670311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-ec5ce48d-8683-4793-a812-3a6f88e6b0bf tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Neutron security group does_not_exist not found {{(pid=103513) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Mar 29 02:19:43.670901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ec5ce48d-8683-4793-a812-3a6f88e6b0bf tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Mar 29 02:19:43.671503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec5ce48d-8683-4793-a812-3a6f88e6b0bf tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:43.677031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ec5ce48d-8683-4793-a812-3a6f88e6b0bf tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.150469 Mar 29 02:19:43.678117 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1260/2451] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:43 2022] POST /compute/v2.1/servers => generated 106 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:43.683610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:43.685303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:43.702316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.703384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.751125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.751125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.827699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:43.835754 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42cc9468-c714-4dd8-8aa8-2fe6ec4a609c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1150 microversion: 2.1 time: 0.156450 Mar 29 02:19:43.836303 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1261/2452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:43 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1150 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:43.840771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:43.841578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:43.849043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.849483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.850250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:43.850675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:43.937023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] validate_networks() for [('ff676c7f-9045-4fad-b565-a27f45650edb', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:19:44.392692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:44.406340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43cab320-45f3-4a6d-8e49-97e9f895fbcd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.568594 Mar 29 02:19:44.407307 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1262/2453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:43 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:44.414433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:44.418993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:44.443519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:44.443966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:44.444748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:44.445819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:44.876860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:44.889479 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f81f5ce-c6bd-4ac9-a5b1-f7ba481037a6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1323 microversion: 2.1 time: 0.480700 Mar 29 02:19:44.906180 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1263/2454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:44 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:44.909148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a7f1eaa8-ad2b-4ae0-8a5f-50eb52fbeb4c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724cf60d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:44.996090 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a7f1eaa8-ad2b-4ae0-8a5f-50eb52fbeb4c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.092610 Mar 29 02:19:44.997568 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1264/2455] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:44 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:45.004491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:45.005473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:45.016324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:45.018468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:45.019532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:45.020193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:45.561923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:45.571490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd920413-acff-4656-b888-133913839af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.572603 Mar 29 02:19:45.572350 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1265/2456] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:44 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:45.577327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:45.578217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:45.602113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:45.602684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:45.604466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:45.610960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.062107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:46.082766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:19:46.082766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:19:46.082766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:19:46.082766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:19:46.082766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:19:46.093735 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61024724-af35-42c2-baa6-e1398d6b2f65 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.520083 Mar 29 02:19:46.096904 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1266/2457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:45 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:46.098279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.098738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.099530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.099956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.118086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:46.119428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:46.135869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:19:46.148534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:19:46.151293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.151293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.152483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.152565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.183679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:19:46.186396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:19:46.424641 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98ad4b88-d79f-44e7-9af1-7c4b1b5b1ffc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.124026 Mar 29 02:19:46.431409 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1192/2458] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 3132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:19:46.436341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-899c1d51-fbab-4cbb-8c66-30f1b7fcfd3a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:46.436866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-899c1d51-fbab-4cbb-8c66-30f1b7fcfd3a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: ae6c67db-5115-4748-a772-654572e1bf2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:46.445137 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-899c1d51-fbab-4cbb-8c66-30f1b7fcfd3a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance ae6c67db-5115-4748-a772-654572e1bf2d could not be found. Mar 29 02:19:46.445992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-899c1d51-fbab-4cbb-8c66-30f1b7fcfd3a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance ae6c67db-5115-4748-a772-654572e1bf2d could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:46.447079 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-899c1d51-fbab-4cbb-8c66-30f1b7fcfd3a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ae6c67db-5115-4748-a772-654572e1bf2d" status: 404 len: 111 microversion: 2.1 time: 0.014798 Mar 29 02:19:46.448159 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1193/2459] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:19:46 2022] DELETE /compute/v2.1/servers/ae6c67db-5115-4748-a772-654572e1bf2d => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:19:46.456904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:46.462069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:46.468287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.469115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.470142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:46.470792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:46.845304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:46.857434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39c9b7fa-0d0b-4db4-8af5-c1bf63d7dac7 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 200 len: 1520 microversion: 2.1 time: 0.406475 Mar 29 02:19:46.857434 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1194/2460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:46 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:46.878768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c1c3204-a820-48b4-a331-011ff4e9d017 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724211700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:46.953043 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c1c3204-a820-48b4-a331-011ff4e9d017 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.077849 Mar 29 02:19:46.953835 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1195/2461] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:46 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:46.958730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8449e602-fc23-4ac3-8047-68bce660e8bc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:46.959564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8449e602-fc23-4ac3-8047-68bce660e8bc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:47.042270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8449e602-fc23-4ac3-8047-68bce660e8bc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:47.054992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8449e602-fc23-4ac3-8047-68bce660e8bc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1242 microversion: 2.1 time: 0.099939 Mar 29 02:19:47.055629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1196/2462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:46 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:47.061147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:47.061978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:47.069669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.070500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:47.071466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.072181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:47.144873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:47.174302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f3ef671-cba7-41fc-9160-addc2b9f0563 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1210 microversion: 2.1 time: 1.075811 Mar 29 02:19:47.177134 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1267/2463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:46 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1210 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:47.191366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.152"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:47.193508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:47.219966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.221361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:47.227215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.227738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:47.349900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Acquired lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:19:47.432597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:47.439233 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb6cd365-1339-4f73-a66e-17fff3ff2036 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.382289 Mar 29 02:19:47.439877 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1197/2464] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:47 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:47.466116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:47.466739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:47.485597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.486051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:47.486833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:47.487268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.025856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:48.037235 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24117c4e-99e4-4501-b298-731abe77d789 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.595445 Mar 29 02:19:48.037922 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1198/2465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:47 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:48.044132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:48.045125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:48.056235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.061519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.061519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.061519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.415978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:48.426695 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-04f656a0-ff2f-4b26-a231-98447bfb0997 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.387045 Mar 29 02:19:48.437957 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1199/2466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:48 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:48.450399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3139cdfb-6378-42bc-9774-31f76c487b17 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87243a0040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:48.520558 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3139cdfb-6378-42bc-9774-31f76c487b17 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.080476 Mar 29 02:19:48.526575 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1200/2467] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:48 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:48.531519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:48.532457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:48.556735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.556735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.556735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.556735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.692870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:48.702102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ccbac15c-615a-478b-ab5b-273e51426bd4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1238 microversion: 2.1 time: 0.174201 Mar 29 02:19:48.712782 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1201/2468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:48 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:48.718973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:48.720212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:48.729807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.730409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.731878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:48.741158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:48.986985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:48.995665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6dcf6ae0-eaa3-4a80-abd9-cec2bd7ec59b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.281493 Mar 29 02:19:48.996276 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1202/2469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:48 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:49.001771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0483acc-0e96-4cd0-9275-935bbcb11324 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:49.002523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c0483acc-0e96-4cd0-9275-935bbcb11324 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Failed to fetch instance by id 9223372036854775808 {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:19:49.003190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c0483acc-0e96-4cd0-9275-935bbcb11324 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Mar 29 02:19:49.004113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0483acc-0e96-4cd0-9275-935bbcb11324 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:49.005316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c0483acc-0e96-4cd0-9275-935bbcb11324 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.007134 Mar 29 02:19:49.006411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1203/2470] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Mar 29 02:19:48 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:19:49.011499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9de6a5ee-d6cf-49ab-9599-744b6a33e3bd req-ada253d0-2405-4de9-98c9-aafc5d33e74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac83902-c5a9-4382-95d7-664c16270919", "tag": "53ab3e71-0b99-4c85-a59d-08a29cd2f220"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:49.014010 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:49.014010 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:49.024787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9de6a5ee-d6cf-49ab-9599-744b6a33e3bd req-ada253d0-2405-4de9-98c9-aafc5d33e74f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.025314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9de6a5ee-d6cf-49ab-9599-744b6a33e3bd req-ada253d0-2405-4de9-98c9-aafc5d33e74f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.042485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9de6a5ee-d6cf-49ab-9599-744b6a33e3bd req-ada253d0-2405-4de9-98c9-aafc5d33e74f service nova] Creating event network-changed:53ab3e71-0b99-4c85-a59d-08a29cd2f220 for instance 8ac83902-c5a9-4382-95d7-664c16270919 on n-h2-828148-1 Mar 29 02:19:49.051513 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9de6a5ee-d6cf-49ab-9599-744b6a33e3bd req-ada253d0-2405-4de9-98c9-aafc5d33e74f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043434 Mar 29 02:19:49.052325 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1204/2471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:49.058060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:49.058783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:49.071538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.072666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.076531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.077414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.304981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:49.315722 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c1b3341-20e3-4368-82c7-3971c6c8feac tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.261808 Mar 29 02:19:49.316666 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1205/2472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:49 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:49.322846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:49.323868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:49.332582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.333133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.333943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.334377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.566452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:49.582142 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b31c6103-27bc-4fd1-a94c-3dc6f87e1b8e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.263879 Mar 29 02:19:49.582952 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1206/2473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:49 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:49.587842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:49.592238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:49.612462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.612929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:49.614112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:49.614708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:50.336962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:50.353037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-15bdee66-fc0a-4f42-a370-22843afc86e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.767397 Mar 29 02:19:50.354460 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1207/2474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:49 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:50.367249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b8c66bc-7841-4461-8955-5dff364713fe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717f5c040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:50.472681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b8c66bc-7841-4461-8955-5dff364713fe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1455 microversion: 2.1 time: 0.115475 Mar 29 02:19:50.473277 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1208/2475] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:50 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:50.477676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:50.478305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:50.487798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:50.488565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:50.489211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:50.489647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:50.665634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:50.680666 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d17217a0-a55c-4cc3-aebf-0cfeecdc4645 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1300 microversion: 2.1 time: 0.206323 Mar 29 02:19:50.682988 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1209/2476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:50 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1300 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:50.690912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:50.691774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:50.707044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:50.707692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:50.708559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:50.709137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:51.129833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:51.140341 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66fa1f38-85ae-4895-922a-5da61f42703b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.453920 Mar 29 02:19:51.143466 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1210/2477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:50 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:51.150782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f7c2100-d5c7-495a-9f5d-e367870bbab9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:51.151775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f7c2100-d5c7-495a-9f5d-e367870bbab9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Failed to fetch instance by id -1 {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:19:51.152780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0f7c2100-d5c7-495a-9f5d-e367870bbab9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance -1 could not be found. Mar 29 02:19:51.153549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f7c2100-d5c7-495a-9f5d-e367870bbab9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance -1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:51.154607 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f7c2100-d5c7-495a-9f5d-e367870bbab9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009661 Mar 29 02:19:51.155168 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1211/2478] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:19:51 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:19:51.161366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:51.161978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:51.172158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:51.173065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:51.174651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:51.175594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:51.272936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:19:51.542526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:51.555736 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5abae5ef-4e3d-4ed6-ab7a-6491e1316a6f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.399245 Mar 29 02:19:51.556409 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1212/2479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:51 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:51.569071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:51.569993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:51.585550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:51.586750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:51.587746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:51.593541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:52.008969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:52.023915 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03c5a439-bd21-4617-83bd-2d83122a5971 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.458276 Mar 29 02:19:52.025234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1213/2480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:51 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:52.042307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-372436ea-ea3b-490e-867c-fd1a910e742e req-e5ac2ea3-600f-4722-8663-0777730e79a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:52.044709 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:52.044709 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:19:52.054147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-372436ea-ea3b-490e-867c-fd1a910e742e req-e5ac2ea3-600f-4722-8663-0777730e79a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:52.054815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-372436ea-ea3b-490e-867c-fd1a910e742e req-e5ac2ea3-600f-4722-8663-0777730e79a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:52.073041 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-372436ea-ea3b-490e-867c-fd1a910e742e req-e5ac2ea3-600f-4722-8663-0777730e79a3 service nova] Creating event network-changed:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:19:52.078247 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-372436ea-ea3b-490e-867c-fd1a910e742e req-e5ac2ea3-600f-4722-8663-0777730e79a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039514 Mar 29 02:19:52.079395 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1214/2481] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:52.084698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1e1ebdb-b943-4689-bb6e-6ddfe47aee94 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dcca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:52.146156 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1e1ebdb-b943-4689-bb6e-6ddfe47aee94 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1464 microversion: 2.1 time: 0.065216 Mar 29 02:19:52.146950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1215/2482] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:52 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:52.153824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:52.155075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:52.164013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:52.164961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:52.165926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:52.166960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:52.678758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:52.691575 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0ae321b-eaf6-4845-b9bd-52638110567a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.543319 Mar 29 02:19:52.701284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1216/2483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:52 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:52.701284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:52.701284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:52.720079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:52.720655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:52.721589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:52.722293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.205584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Updating instance_info_cache with network_info: [{"id": "fc1d6bda-e489-4d67-8ddd-9094740d1863", "address": "fa:16:3e:fe:09:09", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfc1d6bda-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:19:53.265156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:53.274540 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4168f8fc-78fd-4f38-8309-e729b21fb919 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.580357 Mar 29 02:19:53.286610 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1217/2484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:52 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:53.291641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:53.292262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:53.300508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.301002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.301785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.302395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.310668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Releasing lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:19:53.311885 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f29292d7-cdbd-43f4-963a-a99cb0a04a45 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action" status: 202 len: 0 microversion: 2.1 time: 6.133430 Mar 29 02:19:53.317015 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1268/2485] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:47 2022] POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action => generated 0 bytes in 6139 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:19:53.322012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ff9a283-e016-4317-9b43-eeb9756b032d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724b091f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:53.420355 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ff9a283-e016-4317-9b43-eeb9756b032d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 200 len: 1464 microversion: 2.1 time: 0.102065 Mar 29 02:19:53.421090 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1269/2486] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:19:53 2022] GET /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:53.434378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:53.435269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:53.445287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.451025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.451025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.451025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.662533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:53.673865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-541c518c-a43c-4577-a794-2f63531224d4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.386004 Mar 29 02:19:53.681008 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1218/2487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:53 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:53.686509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3f6abf4-55cf-4d2b-a9ab-93383aed2f5c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:53.690776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a3f6abf4-55cf-4d2b-a9ab-93383aed2f5c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 74178a99-23c0-451c-a5c6-e33e1d2eb7b2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:53.708976 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a3f6abf4-55cf-4d2b-a9ab-93383aed2f5c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 74178a99-23c0-451c-a5c6-e33e1d2eb7b2 could not be found. Mar 29 02:19:53.709626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3f6abf4-55cf-4d2b-a9ab-93383aed2f5c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 74178a99-23c0-451c-a5c6-e33e1d2eb7b2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:53.710501 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a3f6abf4-55cf-4d2b-a9ab-93383aed2f5c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/74178a99-23c0-451c-a5c6-e33e1d2eb7b2/action" status: 404 len: 111 microversion: 2.1 time: 0.028316 Mar 29 02:19:53.711128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1219/2488] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:53 2022] POST /compute/v2.1/servers/74178a99-23c0-451c-a5c6-e33e1d2eb7b2/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:19:53.724598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: .version_select at 0x7f872624e8b0>, body: {"addFloatingIp": {"address": "172.25.5.152"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:53.725763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:53.740115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.740812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.741730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:53.742280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:53.819362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Acquired lock "refresh_cache-1020c507-540a-4100-9fb6-091dfeea06d5" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:19:54.079827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:54.090836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e846f614-4686-467c-bae0-3ff0cd900f13 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.660687 Mar 29 02:19:54.091498 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1270/2489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:53 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:54.097451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:54.098381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:54.107989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.108558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.110691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.111348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.566608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:54.575046 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-911a8b7c-746d-4755-a294-cb4e73c52ffe tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1468 microversion: 2.1 time: 0.482318 Mar 29 02:19:54.575619 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1271/2490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:54 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:54.591377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-27973dfa-bb43-4ac7-a718-e0de640f18a1 req-25035b62-869b-4c4f-a93c-2e785ac4e92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4869d-3270-4784-ba92-e6dd6f6c5908", "tag": "03378b5b-21ef-45f5-9b97-31e714be8b0b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:54.592942 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:54.592942 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:54.601164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-27973dfa-bb43-4ac7-a718-e0de640f18a1 req-25035b62-869b-4c4f-a93c-2e785ac4e92d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.601602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-27973dfa-bb43-4ac7-a718-e0de640f18a1 req-25035b62-869b-4c4f-a93c-2e785ac4e92d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.617512 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-27973dfa-bb43-4ac7-a718-e0de640f18a1 req-25035b62-869b-4c4f-a93c-2e785ac4e92d service nova] Creating event network-changed:03378b5b-21ef-45f5-9b97-31e714be8b0b for instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 on n-h2-828148-1 Mar 29 02:19:54.622537 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-27973dfa-bb43-4ac7-a718-e0de640f18a1 req-25035b62-869b-4c4f-a93c-2e785ac4e92d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035231 Mar 29 02:19:54.623764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1272/2491] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:54.628734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:54.629722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:54.638182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.638621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.639376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.639804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.867434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:54.876158 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-022676ef-a95a-468c-8e90-784b66f9d74c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.251123 Mar 29 02:19:54.876802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1273/2492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:54 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:54.881407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:54.882075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:54.889772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.890292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:54.891128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:54.891628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.100969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:55.109945 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f465d2c-3746-4009-8230-ecfd71f0949f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.231843 Mar 29 02:19:55.110394 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1274/2493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:54 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:55.117972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-829ec94e-463c-4b73-a8e2-5df46159cd69 req-36b3696b-8808-4f94-90a1-969f88329391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "name": "network-vif-plugged", "status": "completed", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:55.117972 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:55.117972 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:55.129173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-829ec94e-463c-4b73-a8e2-5df46159cd69 req-36b3696b-8808-4f94-90a1-969f88329391 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.129635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-829ec94e-463c-4b73-a8e2-5df46159cd69 req-36b3696b-8808-4f94-90a1-969f88329391 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.147124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-829ec94e-463c-4b73-a8e2-5df46159cd69 req-36b3696b-8808-4f94-90a1-969f88329391 service nova] Creating event network-vif-plugged:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:19:55.152062 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-829ec94e-463c-4b73-a8e2-5df46159cd69 req-36b3696b-8808-4f94-90a1-969f88329391 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040417 Mar 29 02:19:55.153635 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1275/2494] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:55.158369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b617b32-4b46-4e97-a2df-06e08f5dc84d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d0eee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:55.264533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b617b32-4b46-4e97-a2df-06e08f5dc84d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?changes-since=2022-03-29T02%3A17%3A54Z" status: 200 len: 1901 microversion: 2.1 time: 0.109690 Mar 29 02:19:55.265137 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1276/2495] 10.222.0.36 () {58 vars in 1198 bytes} [Tue Mar 29 02:19:55 2022] GET /compute/v2.1/images?changes-since=2022-03-29T02%3A17%3A54Z => generated 1901 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:55.269722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:55.270620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:55.282796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.283245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.284031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.284467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.490759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:55.499744 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17ee7fbf-3b58-4b62-89c4-cebbd4bd7a33 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.233571 Mar 29 02:19:55.500297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1277/2496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:55 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:55.504459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:55.505084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:55.512698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.513170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.513930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.514360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.734719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:55.744744 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb6b4c7a-d43e-4c8f-9acc-04394f6c0c5e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.243409 Mar 29 02:19:55.755078 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1278/2497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:55 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:55.760013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:55.760626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:55.768099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.768533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.769519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:55.770101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:55.988969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:55.999586 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d7327b0-5874-474d-9780-7504ecdd0365 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.243028 Mar 29 02:19:56.004942 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1279/2498] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:55 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:56.005528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-499b3d9c-cd9a-4392-bf71-87052105210c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724bad310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.086472 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-499b3d9c-cd9a-4392-bf71-87052105210c tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1138905727" status: 200 len: 485 microversion: 2.1 time: 0.084497 Mar 29 02:19:56.087050 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1280/2499] 10.222.0.36 () {58 vars in 1230 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1138905727 => generated 485 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:56.092222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.093498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:56.099896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.100335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.101130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.101562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.302754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:56.310932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cea96bc2-b317-4adb-b7f1-c3427df3c710 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.222926 Mar 29 02:19:56.311491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1281/2500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:56.316766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d5018e2-27e8-40bc-b883-e71f690169d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:56.317815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d5018e2-27e8-40bc-b883-e71f690169d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: ac0083bd-5ed4-4cef-bf71-a49648281cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:56.326146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8d5018e2-27e8-40bc-b883-e71f690169d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance ac0083bd-5ed4-4cef-bf71-a49648281cc0 could not be found. Mar 29 02:19:56.326146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d5018e2-27e8-40bc-b883-e71f690169d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance ac0083bd-5ed4-4cef-bf71-a49648281cc0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:56.326818 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d5018e2-27e8-40bc-b883-e71f690169d2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/ac0083bd-5ed4-4cef-bf71-a49648281cc0/action" status: 404 len: 111 microversion: 2.1 time: 0.014402 Mar 29 02:19:56.327372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1282/2501] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:56 2022] POST /compute/v2.1/servers/ac0083bd-5ed4-4cef-bf71-a49648281cc0/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:19:56.332078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a9f1973-7ccb-418e-9924-451db21f5d83 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cf9d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.422841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a9f1973-7ccb-418e-9924-451db21f5d83 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?server=0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 958 microversion: 2.1 time: 0.094155 Mar 29 02:19:56.430167 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1283/2502] 10.222.0.36 () {58 vars in 1208 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/images?server=0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 958 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:56.430167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.430167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:56.436999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.437456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.438235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.438670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.639665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:56.648297 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a44eca31-01f6-40da-91f0-ca7b11cb9d21 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.223391 Mar 29 02:19:56.649175 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1284/2503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:56.654649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3172486-6b7c-4abe-954b-def069ec0087 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c6d160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.743944 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3172486-6b7c-4abe-954b-def069ec0087 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 484 microversion: 2.1 time: 0.093443 Mar 29 02:19:56.744911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1285/2504] 10.222.0.36 () {58 vars in 1316 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 484 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:56.749827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.750427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:56.757803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.758248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.759007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.759498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.960238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:56.968492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-859137fa-7caf-4710-8486-2584b18e50ac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.222478 Mar 29 02:19:56.969081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1286/2505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:56.973276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:56.973877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:56.981016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.981460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:56.982218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:56.982740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.191076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:57.197617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8ed902b-14bb-4814-b983-f4da1ff56183 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.227574 Mar 29 02:19:57.198353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1287/2506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:56 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:57.202707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-16b5af28-f9d8-4299-ba57-7f0e32943ade tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cfee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.292443 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-16b5af28-f9d8-4299-ba57-7f0e32943ade tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 484 microversion: 2.1 time: 0.092852 Mar 29 02:19:57.293173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1288/2507] 10.222.0.36 () {58 vars in 1302 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 484 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:57.300567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.301234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:57.309146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:57.309716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.310654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:57.311081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.541171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:57.548496 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61426883-de44-429c-bb49-f3cfef511f25 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.254167 Mar 29 02:19:57.549163 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1289/2508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:57.553963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-db3c9be1-d229-4a86-9c69-44fa7a518eba req-578f1244-65fb-4b4f-a2ed-8f41d6705310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-unplugged", "status": "completed", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:57.555522 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:57.555522 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:57.564257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db3c9be1-d229-4a86-9c69-44fa7a518eba req-578f1244-65fb-4b4f-a2ed-8f41d6705310 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:57.564955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db3c9be1-d229-4a86-9c69-44fa7a518eba req-578f1244-65fb-4b4f-a2ed-8f41d6705310 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.586679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-db3c9be1-d229-4a86-9c69-44fa7a518eba req-578f1244-65fb-4b4f-a2ed-8f41d6705310 service nova] Creating event network-vif-unplugged:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:19:57.592093 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-db3c9be1-d229-4a86-9c69-44fa7a518eba req-578f1244-65fb-4b4f-a2ed-8f41d6705310 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041340 Mar 29 02:19:57.592690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1290/2509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:57.597904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e50876a-1a1f-4089-b9e6-225d491d9ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.598916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e50876a-1a1f-4089-b9e6-225d491d9ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: a301c765-011d-4e93-b7cf-ef49d61e54b4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:57.606767 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1e50876a-1a1f-4089-b9e6-225d491d9ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance a301c765-011d-4e93-b7cf-ef49d61e54b4 could not be found. Mar 29 02:19:57.607510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e50876a-1a1f-4089-b9e6-225d491d9ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance a301c765-011d-4e93-b7cf-ef49d61e54b4 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:57.609642 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e50876a-1a1f-4089-b9e6-225d491d9ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/a301c765-011d-4e93-b7cf-ef49d61e54b4" status: 404 len: 111 microversion: 2.1 time: 0.015649 Mar 29 02:19:57.610344 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1291/2510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/servers/a301c765-011d-4e93-b7cf-ef49d61e54b4 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:19:57.619396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95e6d0e6-1025-46b7-a058-26f193bcc102 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724badf70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.737036 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95e6d0e6-1025-46b7-a058-26f193bcc102 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.122221 Mar 29 02:19:57.738597 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1292/2511] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:57.743725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.744701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:57.755216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:57.756515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.756515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:57.757031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:57.967886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:57.977739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1d143dc-3a59-4f2e-8bf1-c58a4ec6f2b3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.237880 Mar 29 02:19:57.989061 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1293/2512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:57.993519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:57.994139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:58.002112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.002566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.003343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.003777 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.network.neutron [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] re-assign floating IP 172.25.5.152 from instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb Mar 29 02:19:58.005329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.051018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Building network info cache for instance {{(pid=103514) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:19:58.217674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:58.226305 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2916e992-eb6c-46c1-9102-49cf07718696 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.236207 Mar 29 02:19:58.236872 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1294/2513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:57 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:58.236872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-057fbd5a-aa79-49d0-88da-4954c89e6e22 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724bad9d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:58.338932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-057fbd5a-aa79-49d0-88da-4954c89e6e22 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.110543 Mar 29 02:19:58.344485 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1295/2514] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:19:58 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:58.344884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2e313fe8-e494-41f1-9236-a5fc4193e423 req-2529a350-8b31-4478-9a3d-d3978a6a647c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:58.346446 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:19:58.346446 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:19:58.356168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2e313fe8-e494-41f1-9236-a5fc4193e423 req-2529a350-8b31-4478-9a3d-d3978a6a647c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.356602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2e313fe8-e494-41f1-9236-a5fc4193e423 req-2529a350-8b31-4478-9a3d-d3978a6a647c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.375422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2e313fe8-e494-41f1-9236-a5fc4193e423 req-2529a350-8b31-4478-9a3d-d3978a6a647c service nova] Creating event network-changed:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:19:58.380371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2e313fe8-e494-41f1-9236-a5fc4193e423 req-2529a350-8b31-4478-9a3d-d3978a6a647c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039050 Mar 29 02:19:58.381537 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1296/2515] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:58.387214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:58.388061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:58.399997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.402804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.402804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.402804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.667135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:58.679016 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-708d36dc-d401-448b-9ac3-0d5258250a3e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.295823 Mar 29 02:19:58.679620 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1297/2516] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:58 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:58.692649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:58.699794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:58.711373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.711826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.712613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:58.713273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:58.973960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:58.984095 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82ba9fac-7e4d-4f67-9f3f-3bd6e16b6ba4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.297997 Mar 29 02:19:59.002827 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1298/2517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:58 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:59.010246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4d82e5c-6b1e-4b59-a643-ae770829fbec tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c6daf0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:59.099991 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4d82e5c-6b1e-4b59-a643-ae770829fbec tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.094655 Mar 29 02:19:59.107347 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1299/2518] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:19:59 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:19:59.111493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:59.112173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:59.121356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.121819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:59.122594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.123023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:59.348503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Updating instance_info_cache with network_info: [{"id": "fc1d6bda-e489-4d67-8ddd-9094740d1863", "address": "fa:16:3e:fe:09:09", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfc1d6bda-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103514) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:19:59.362892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:59.371728 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54d8868b-d175-47ea-81dd-9222cad46fa0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.264664 Mar 29 02:19:59.372288 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1300/2519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:59 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:59.377063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:59.378026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:59.385342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.385780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:59.386761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.387192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:59.430600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Building network info cache for instance {{(pid=103514) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:19:59.608250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:19:59.619436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c071f7ec-6830-4098-a8aa-9b892ffb7f06 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.245826 Mar 29 02:19:59.620423 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1301/2520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:59 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:59.627408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19cd80b1-d3cb-4ba5-9c45-7f7f33756816 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1366367269", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:19:59.629479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19cd80b1-d3cb-4ba5-9c45-7f7f33756816 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:19:59.631603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19cd80b1-d3cb-4ba5-9c45-7f7f33756816 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007808 Mar 29 02:19:59.634922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1302/2521] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:19:59 2022] POST /compute/v2.1/servers => generated 139 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:19:59.668611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5339bc75-9f4e-40f6-84ec-bdd719915179 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c431f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:59.873527 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5339bc75-9f4e-40f6-84ec-bdd719915179 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?changes-since=2022-03-29T02%3A17%3A47Z" status: 200 len: 6333 microversion: 2.1 time: 0.231193 Mar 29 02:19:59.873527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1303/2522] 10.222.0.36 () {58 vars in 1219 bytes} [Tue Mar 29 02:19:59 2022] GET /compute/v2.1/images/detail?changes-since=2022-03-29T02%3A17%3A47Z => generated 6333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:19:59.877837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:19:59.877837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:19:59.891163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.891696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:19:59.892617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:19:59.897236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.139316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:00.147523 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80ea4563-8069-4594-bb12-62279372d209 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.276952 Mar 29 02:20:00.163627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1304/2523] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:19:59 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:00.168728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.169407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:00.177191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.177643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.180974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.180974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.411153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:00.417509 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8e45e16d-3750-4ed8-b6c4-9c7dffc12200 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.252613 Mar 29 02:20:00.418080 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1305/2524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:00.423307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7161b45e-3ab2-43ff-b161-057e4530fa2e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d0edc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.484379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Updating instance_info_cache with network_info: [{"id": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb", "address": "fa:16:3e:49:e1:c9", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8612595e-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103514) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:20:00.503660 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7161b45e-3ab2-43ff-b161-057e4530fa2e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1138905727" status: 200 len: 665 microversion: 2.1 time: 0.084429 Mar 29 02:20:00.504232 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1306/2525] 10.222.0.36 () {58 vars in 1251 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1138905727 => generated 665 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:00.508606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.509241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:00.517910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.518353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.519129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.519553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.567101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Releasing lock "refresh_cache-1020c507-540a-4100-9fb6-091dfeea06d5" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:20:00.567949 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bef884c-e5c1-40ab-bd0b-c58c2ab284ec tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5/action" status: 202 len: 0 microversion: 2.1 time: 6.855895 Mar 29 02:20:00.568677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1220/2526] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:19:53 2022] POST /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5/action => generated 0 bytes in 6857 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:20:00.576287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.576927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:00.587073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.587688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.588635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.593220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.865415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:00.868575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:00.876025 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05ce29b5-280f-4857-8c2b-ca325ba5b99b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.370751 Mar 29 02:20:00.876642 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1307/2527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:00.877412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a87156d-7b3d-4678-b068-06c56c148e3c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.307090 Mar 29 02:20:00.882151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c4573160-a8b0-4cd9-97c5-e8034e0e8cb9 req-dc2be047-203b-4343-8f9b-6b6c9d40af5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1020c507-540a-4100-9fb6-091dfeea06d5", "tag": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:00.883952 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:00.883952 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:00.887195 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1221/2528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:00.891820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0206e680-0170-4b6d-8f15-ef178b137bf3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f872405dc10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.904822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c4573160-a8b0-4cd9-97c5-e8034e0e8cb9 req-dc2be047-203b-4343-8f9b-6b6c9d40af5a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:00.904822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c4573160-a8b0-4cd9-97c5-e8034e0e8cb9 req-dc2be047-203b-4343-8f9b-6b6c9d40af5a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:00.925626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c4573160-a8b0-4cd9-97c5-e8034e0e8cb9 req-dc2be047-203b-4343-8f9b-6b6c9d40af5a service nova] Creating event network-changed:8612595e-f8da-4bba-8d2b-bb05bd0f8abb for instance 1020c507-540a-4100-9fb6-091dfeea06d5 on n-h2-828148-1 Mar 29 02:20:00.936060 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c4573160-a8b0-4cd9-97c5-e8034e0e8cb9 req-dc2be047-203b-4343-8f9b-6b6c9d40af5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057690 Mar 29 02:20:00.936766 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1308/2529] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:00.942562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.152"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:00.979371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0206e680-0170-4b6d-8f15-ef178b137bf3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1466 microversion: 2.1 time: 0.091016 Mar 29 02:20:00.980736 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1222/2530] 10.222.0.36 () {58 vars in 1337 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fv2.1%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1466 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:00.985493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:00.986098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:01.011554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.011554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.011554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.011554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.157108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:01.164920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.169401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.169401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.169401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.511194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] HTTP exception thrown: Floating IP 172.25.5.152 is not associated with instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb. Mar 29 02:20:01.512473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Returning 409 to user: Floating IP 172.25.5.152 is not associated with instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:01.513333 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee927a27-22ee-44e5-8f76-739df7048f7c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action" status: 409 len: 146 microversion: 2.1 time: 0.575346 Mar 29 02:20:01.513911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1309/2531] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:00 2022] POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action => generated 146 bytes in 576 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:20:01.523534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66cf9ce3-2ced-4b2b-9164-df3353b74ed9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-603601733", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:01.523534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66cf9ce3-2ced-4b2b-9164-df3353b74ed9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:01.523534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66cf9ce3-2ced-4b2b-9164-df3353b74ed9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.007055 Mar 29 02:20:01.526186 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1310/2532] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:20:01 2022] POST /compute/v2.1/servers => generated 133 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:01.531152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-907ef183-04a8-4c5b-a6c2-80bb80be75ab tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c438b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:01.616885 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-907ef183-04a8-4c5b-a6c2-80bb80be75ab tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1466 microversion: 2.1 time: 0.089347 Mar 29 02:20:01.620148 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1311/2533] 10.222.0.36 () {58 vars in 1323 bytes} [Tue Mar 29 02:20:01 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.36%2Fcompute%2Fservers%2Fdfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:01.625705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:01.637228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:01.637228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.637228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.637228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.637527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.693254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:01.705724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-944b9560-ca8e-41be-9087-c189965d3a97 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.723691 Mar 29 02:20:01.706852 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1223/2534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:00 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:01.711879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.152"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:01.862127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:01.866874 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-28311dad-424a-46a1-b086-6a8f9778a5df tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.248042 Mar 29 02:20:01.867434 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1312/2535] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:01 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:01.872505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:01.874191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:01.881709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.884350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:01.884350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:01.884350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.084344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:02.093385 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c2798ab-2e99-4722-a5dd-11982850e3c2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.224902 Mar 29 02:20:02.107344 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1313/2536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:01 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:02.107344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a223bb2b-9ea8-403c-9683-2227e218fb87 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d0eee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:02.119540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:02.129001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.129846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.131175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.131953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.216454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a223bb2b-9ea8-403c-9683-2227e218fb87 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7108 microversion: 2.1 time: 0.121422 Mar 29 02:20:02.228047 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1314/2537] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:20:02 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7108 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:02.228047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:02.228047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:02.233426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.235590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.235590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.235590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.442659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:02.451570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55403732-1110-4441-956f-389d4176c02c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1315 microversion: 2.1 time: 0.233118 Mar 29 02:20:02.452135 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1315/2538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:02 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:02.458075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:02.462916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:02.471516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.471962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.472742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.473197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.701935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:02.710747 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d4f0f9e-776d-41f2-83fd-148e80398c34 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.257502 Mar 29 02:20:02.711320 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1316/2539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:02 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:02.720676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d22d4ea7-7fce-4938-ac2b-79cd90689a4f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87240cfee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:02.792061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Acquired lock "refresh_cache-1020c507-540a-4100-9fb6-091dfeea06d5" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:20:02.835119 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d22d4ea7-7fce-4938-ac2b-79cd90689a4f tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.117078 Mar 29 02:20:02.835119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1317/2540] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:20:02 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:02.838569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ba24c9ca-f507-45d5-923c-bdcc3b66576c req-e08680a8-dfc4-4159-9627-3bdcd958a9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac83902-c5a9-4382-95d7-664c16270919", "name": "network-vif-plugged", "status": "completed", "tag": "53ab3e71-0b99-4c85-a59d-08a29cd2f220"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:02.841991 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:02.841991 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:02.853027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ba24c9ca-f507-45d5-923c-bdcc3b66576c req-e08680a8-dfc4-4159-9627-3bdcd958a9f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.853472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ba24c9ca-f507-45d5-923c-bdcc3b66576c req-e08680a8-dfc4-4159-9627-3bdcd958a9f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.872301 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ba24c9ca-f507-45d5-923c-bdcc3b66576c req-e08680a8-dfc4-4159-9627-3bdcd958a9f6 service nova] Creating event network-vif-plugged:53ab3e71-0b99-4c85-a59d-08a29cd2f220 for instance 8ac83902-c5a9-4382-95d7-664c16270919 on n-h2-828148-1 Mar 29 02:20:02.878396 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ba24c9ca-f507-45d5-923c-bdcc3b66576c req-e08680a8-dfc4-4159-9627-3bdcd958a9f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045533 Mar 29 02:20:02.878396 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1318/2541] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:02.883709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:02.884586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:02.895474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.896439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:02.897468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:02.898085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.131354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:03.136181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34c621c8-f77d-4f3e-a0f9-7bd98faf5f28 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.256465 Mar 29 02:20:03.136716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1319/2542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:02 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:03.141046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13623828-4708-4070-a855-9f4eac483d83 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:03.141792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13623828-4708-4070-a855-9f4eac483d83 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 10f76fd4-b9bb-442f-b727-20145b13e65b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:03.148583 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-13623828-4708-4070-a855-9f4eac483d83 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 10f76fd4-b9bb-442f-b727-20145b13e65b could not be found. Mar 29 02:20:03.153706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13623828-4708-4070-a855-9f4eac483d83 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 10f76fd4-b9bb-442f-b727-20145b13e65b could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:03.153706 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13623828-4708-4070-a855-9f4eac483d83 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/10f76fd4-b9bb-442f-b727-20145b13e65b/action" status: 404 len: 111 microversion: 2.1 time: 0.012309 Mar 29 02:20:03.153706 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1320/2543] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:03 2022] POST /compute/v2.1/servers/10f76fd4-b9bb-442f-b727-20145b13e65b/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:03.154439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-932a7a15-adf1-48a7-8daa-170641de1630 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.206494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-932a7a15-adf1-48a7-8daa-170641de1630 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f" status: 200 len: 784 microversion: 2.1 time: 0.055058 Mar 29 02:20:03.207055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1321/2544] 10.222.0.36 () {58 vars in 1232 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/images/de7524d7-d38d-4b70-85cc-a7e4732b733f => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:03.211938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.214743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:03.220990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.225312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.225312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.225312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.423737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:03.433939 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce0ae8e3-ec0a-4da8-abe0-b669d8e11661 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1198 microversion: 2.1 time: 0.224626 Mar 29 02:20:03.433939 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1322/2545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1198 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:03.438593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.447014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:03.447014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.447014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.447737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.448178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.644767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:03.657221 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e9345da-2030-440b-a87a-7ecfa110235a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.222242 Mar 29 02:20:03.669592 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1323/2546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:03.673862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf27c2a7-9d83-4b33-ada5-8a684dcd550d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c6df70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.752655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf27c2a7-9d83-4b33-ada5-8a684dcd550d tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.093471 Mar 29 02:20:03.753243 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1324/2547] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:03.765146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.765146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:03.771865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.772356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.773193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:03.773633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:03.980252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:03.988786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce313d17-ff33-4fc2-b78b-414a728ffa95 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1503 microversion: 2.1 time: 0.229581 Mar 29 02:20:03.994383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1325/2548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:03.994383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:03.994383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:04.001949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:04.002416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:04.003182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:04.003624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:04.211987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:04.220543 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d6484a4-d558-4276-8d37-982443399569 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.230047 Mar 29 02:20:04.221205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1326/2549] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:03 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:04.226349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acdaf917-4358-49fc-925f-5a954fc30e4e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d21af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:04.259036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Building network info cache for instance {{(pid=103514) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:20:05.169532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Updating instance_info_cache with network_info: [{"id": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb", "address": "fa:16:3e:49:e1:c9", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8612595e-f8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103514) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:20:05.234274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Releasing lock "refresh_cache-1020c507-540a-4100-9fb6-091dfeea06d5" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:20:05.237162 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a50dda2b-8ab7-415d-bfba-3c897e43166c tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5/action" status: 202 len: 0 microversion: 2.1 time: 3.527053 Mar 29 02:20:05.237162 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1224/2550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:01 2022] POST /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5/action => generated 0 bytes in 3528 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:20:05.240996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-29937371"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:05.241534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:05.248798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.249294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:05.250085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.250512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:05.455710 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.network.security_group_api [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Adding security group d1ffca13-597d-4b93-8f0b-ce5a91a6c636 to port 5ec929a7-370a-4ea9-999b-149a72d340f1 Mar 29 02:20:05.600541 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acdaf917-4358-49fc-925f-5a954fc30e4e tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65" status: 204 len: 0 microversion: 2.1 time: 1.378259 Mar 29 02:20:05.604803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1327/2551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:04 2022] DELETE /compute/v2.1/images/4b55e10a-d558-4ba9-9bf8-289a39ae4d65 => generated 0 bytes in 1379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:05.609120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:05.609741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:05.619625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.619625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:05.619625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.620517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:05.854393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:05.866963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ff81bb8c-f158-41f8-844a-4b6ab3f5df5b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1368 microversion: 2.1 time: 0.258876 Mar 29 02:20:05.866963 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1328/2552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:05 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:05.871296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:05.873457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:05.881158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.881605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:05.882376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:05.882811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.119810 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06f75961-5489-41ca-95b1-a9980503a15d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/action" status: 202 len: 0 microversion: 2.1 time: 0.882927 Mar 29 02:20:06.121177 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1225/2553] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:05 2022] POST /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:06.134225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fdddd86c-ebc5-4510-83ff-eb6970b0c6f0 req-dd947cd6-af94-4d56-bcef-e31224e498d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1020c507-540a-4100-9fb6-091dfeea06d5", "tag": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:06.134225 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:06.134225 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:06.138045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fdddd86c-ebc5-4510-83ff-eb6970b0c6f0 req-dd947cd6-af94-4d56-bcef-e31224e498d8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.138554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fdddd86c-ebc5-4510-83ff-eb6970b0c6f0 req-dd947cd6-af94-4d56-bcef-e31224e498d8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.157144 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fdddd86c-ebc5-4510-83ff-eb6970b0c6f0 req-dd947cd6-af94-4d56-bcef-e31224e498d8 service nova] Creating event network-changed:8612595e-f8da-4bba-8d2b-bb05bd0f8abb for instance 1020c507-540a-4100-9fb6-091dfeea06d5 on n-h2-828148-1 Mar 29 02:20:06.161731 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fdddd86c-ebc5-4510-83ff-eb6970b0c6f0 req-dd947cd6-af94-4d56-bcef-e31224e498d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039283 Mar 29 02:20:06.162500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1226/2554] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:06.171487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:06.172677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:06.181228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.181681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.182618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.183629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.227330 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f656dec4-2dc5-4b00-bb78-6d8b24b43a7c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.360294 Mar 29 02:20:06.228927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1329/2555] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:05 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:06.236631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c6beb43e-73e4-4b48-adcd-2f57128eaa63 req-68023f3d-06ac-4d61-ad15-0ee9ffe8c0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4869d-3270-4784-ba92-e6dd6f6c5908", "name": "network-vif-plugged", "status": "completed", "tag": "03378b5b-21ef-45f5-9b97-31e714be8b0b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:06.239549 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:06.239549 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:06.257327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c6beb43e-73e4-4b48-adcd-2f57128eaa63 req-68023f3d-06ac-4d61-ad15-0ee9ffe8c0d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.257871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c6beb43e-73e4-4b48-adcd-2f57128eaa63 req-68023f3d-06ac-4d61-ad15-0ee9ffe8c0d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.277359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c6beb43e-73e4-4b48-adcd-2f57128eaa63 req-68023f3d-06ac-4d61-ad15-0ee9ffe8c0d2 service nova] Creating event network-vif-plugged:03378b5b-21ef-45f5-9b97-31e714be8b0b for instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 on n-h2-828148-1 Mar 29 02:20:06.282152 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c6beb43e-73e4-4b48-adcd-2f57128eaa63 req-68023f3d-06ac-4d61-ad15-0ee9ffe8c0d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050607 Mar 29 02:20:06.282998 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1330/2556] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:06.287682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:06.288259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:06.298165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.298616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.299658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.306771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.388476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:06.583515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:06.592638 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5f738a0-1acd-4368-b089-32cfd2408205 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1381 microversion: 2.1 time: 0.427004 Mar 29 02:20:06.593238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1227/2557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:06 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1381 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:06.597720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bbeb361-91e5-4798-8dba-ec30e795582b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dc430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:06.687630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad59294a-3778-4ac6-8976-afecd2989a0b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 204 len: 0 microversion: 2.1 time: 0.403399 Mar 29 02:20:06.689883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1331/2558] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:06 2022] DELETE /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:06.697950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1549326894"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:06.698704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:06.706512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.707104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.707986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:06.708482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:06.931787 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Adding security group 974eb039-d8b5-414b-91b3-9899861570b4 to port 5ec929a7-370a-4ea9-999b-149a72d340f1 Mar 29 02:20:07.727837 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-401b73bd-c869-4b1e-8cb6-569189403e87 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/action" status: 202 len: 0 microversion: 2.1 time: 1.031586 Mar 29 02:20:07.727837 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1332/2559] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:06 2022] POST /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/action => generated 0 bytes in 1033 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:07.729483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:07.730731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:07.741416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:07.742426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:07.750216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:07.750216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:07.966354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:07.975418 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9a5933e-5057-4bb1-892a-c1e331a2cf9b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1491 microversion: 2.1 time: 0.252048 Mar 29 02:20:07.975994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1333/2560] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:07 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1491 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:07.991972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:07.992591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:08.000318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.000772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.001570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.002000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.023390 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0bbeb361-91e5-4798-8dba-ec30e795582b tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457" status: 204 len: 0 microversion: 2.1 time: 1.428856 Mar 29 02:20:08.023952 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1228/2561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:06 2022] DELETE /compute/v2.1/images/33d8ea98-876f-440f-82ff-041332263457 => generated 0 bytes in 1430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:08.028806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.152"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:08.029900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:08.037385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.038074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.039075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.039725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.103661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Acquired lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:20:08.226939 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cdbb98a-f99a-455b-8702-c78066433b5a tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1532 microversion: 2.1 time: 0.238483 Mar 29 02:20:08.227520 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1334/2562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:07 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1532 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:08.233913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:08.237930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:08.245114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.245859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.247145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.247583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.455471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:08.457430 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c88fdabe-89c4-4dce-b2af-8f95dad2eaf0 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1557 microversion: 2.1 time: 0.228716 Mar 29 02:20:08.457990 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1335/2563] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:08 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1557 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:08.462434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:08.462909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:08.470959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.471396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.472150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.472575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.710480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2c8a919-0395-4594-884f-1012b25187a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.250483 Mar 29 02:20:08.710480 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1336/2564] 10.222.0.36 () {58 vars in 1292 bytes} [Tue Mar 29 02:20:08 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d/os-security-groups => generated 1154 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:08.715695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2161cc93-141d-4e4c-b62e-45f0be7d6dde req-415a07aa-711a-4921-b118-276e3b14d29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:08.717589 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:08.717589 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:08.727212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2161cc93-141d-4e4c-b62e-45f0be7d6dde req-415a07aa-711a-4921-b118-276e3b14d29d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.727645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2161cc93-141d-4e4c-b62e-45f0be7d6dde req-415a07aa-711a-4921-b118-276e3b14d29d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.743999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2161cc93-141d-4e4c-b62e-45f0be7d6dde req-415a07aa-711a-4921-b118-276e3b14d29d service nova] Creating event network-changed:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:20:08.749397 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2161cc93-141d-4e4c-b62e-45f0be7d6dde req-415a07aa-711a-4921-b118-276e3b14d29d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037922 Mar 29 02:20:08.750250 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1337/2565] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:08.756018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:08.756758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:08.766431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.766874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.767640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:08.768109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:08.827227 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'pause' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state paused Mar 29 02:20:08.827865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'pause' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state paused {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:08.828690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-235e40fd-6004-4666-85b7-c3f41c503b71 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 143 microversion: 2.1 time: 0.077482 Mar 29 02:20:08.829234 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1338/2566] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:08 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 143 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:20:08.836193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c2bc785-167c-452f-9918-ca382e39bce4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724c43550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:10.206168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c2bc785-167c-452f-9918-ca382e39bce4 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3" status: 204 len: 0 microversion: 2.1 time: 1.375894 Mar 29 02:20:10.206751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1339/2567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:08 2022] DELETE /compute/v2.1/images/27ea65c6-e3ff-4dfe-bc2a-7fc213d183a3 => generated 0 bytes in 1377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:10.211793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cde60c46-652f-4975-b9e0-51b406927fa8 req-53ce98b7-577b-4006-b758-2ad82c48d0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:10.213343 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:10.213343 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:10.222314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cde60c46-652f-4975-b9e0-51b406927fa8 req-53ce98b7-577b-4006-b758-2ad82c48d0f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:10.222750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cde60c46-652f-4975-b9e0-51b406927fa8 req-53ce98b7-577b-4006-b758-2ad82c48d0f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:10.238891 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cde60c46-652f-4975-b9e0-51b406927fa8 req-53ce98b7-577b-4006-b758-2ad82c48d0f3 service nova] Creating event network-changed:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:20:10.243766 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cde60c46-652f-4975-b9e0-51b406927fa8 req-53ce98b7-577b-4006-b758-2ad82c48d0f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 Mar 29 02:20:10.244692 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1340/2568] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:10.250178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:10.250898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:10.258418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:10.261509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:10.261509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:10.261509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:10.471988 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7e032ac-d0ac-415b-bb45-01eacf925c5b tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1532 microversion: 2.1 time: 0.225484 Mar 29 02:20:10.483000 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1341/2569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:10 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1532 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:10.496674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:10.496674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:10.502613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:10.503335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:10.504192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:10.504637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:10.712382 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00d81fee-8c8a-42a8-93e8-70341094b332 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238131 Mar 29 02:20:10.719343 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1342/2570] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:20:10 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-interface => generated 284 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:10.719343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6212a3b2-a254-44bc-9cb6-d02dfb009828 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8724c6dee0>, body: {"security_group": {"name": " tempest-securitygroup -759917980 ", "description": "tempest-description-558533170"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:11.704941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Building network info cache for instance {{(pid=103514) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:20:11.870716 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6212a3b2-a254-44bc-9cb6-d02dfb009828 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 1.155800 Mar 29 02:20:11.877116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1343/2571] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:10 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:11.881988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:11.882823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:11.892157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:11.892777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:11.893729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:11.894302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:12.235990 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:20:12.319469 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c18ae33-2b2f-481f-b5f0-5afc7379d9fb tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.440738 Mar 29 02:20:12.320484 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1344/2572] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:11 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:12.472377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:12.473145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:12.489340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:12.489340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:12.489340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:12.489340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.046108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Updating instance_info_cache with network_info: [{"id": "fc1d6bda-e489-4d67-8ddd-9094740d1863", "address": "fa:16:3e:fe:09:09", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfc1d6bda-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103514) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:20:13.054261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:13.068052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:13.073837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:13.073837 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04aa1558-38fe-49b0-a7ef-b2b4616b727e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2950 microversion: 2.32 time: 0.750130 Mar 29 02:20:13.076692 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1345/2573] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:20:12 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2950 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:20:13.081870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.082554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:13.091006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.096376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.096376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.096376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.162465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:13.167741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Releasing lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:20:13.168184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-35ad381a-e2ba-4ea8-9f3c-6bb1d1569d2d tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action" status: 202 len: 0 microversion: 2.1 time: 5.143131 Mar 29 02:20:13.168880 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1229/2574] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:08 2022] POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action => generated 0 bytes in 5144 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:20:13.177489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.177489 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:13.177489 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:13.177489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.177489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.178843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.179368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.215867 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9ba27f8b-6622-45d0-9293-81c4f7dc80da tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045874 Mar 29 02:20:13.216564 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1230/2575] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:20:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:13.220862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c455063e-d51e-48f0-accb-54d442d3a680 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8725e0b670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.246234 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60232. Mar 29 02:20:13.286250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c455063e-d51e-48f0-accb-54d442d3a680 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417" status: 200 len: 222 microversion: 2.1 time: 0.068523 Mar 29 02:20:13.293195 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1231/2576] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:20:13 2022] GET /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417 => generated 222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:13.293195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.293970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:13.307857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.308546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.309558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.310357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.475634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-013d9497-ed11-4314-a575-c3aa3ffd3128 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 204 len: 0 microversion: 2.1 time: 0.397343 Mar 29 02:20:13.476221 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1346/2577] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:13 2022] DELETE /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:13.483619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1020c507-540a-4100-9fb6-091dfeea06d5", "name": "network-vif-deleted", "tag": "8612595e-f8da-4bba-8d2b-bb05bd0f8abb"}, {"name": "network-changed", "server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:13.485651 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:13.485651 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:13.497937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.497937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.520759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] Creating event network-vif-deleted:8612595e-f8da-4bba-8d2b-bb05bd0f8abb for instance 1020c507-540a-4100-9fb6-091dfeea06d5 on n-h2-828148-1 Mar 29 02:20:13.521849 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] Creating event network-changed:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:20:13.535718 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6593aba2-8ebf-4d2a-90a6-86cb993aeee8 req-fff9dcce-b28d-4f53-9ed8-43749bf60102 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.056795 Mar 29 02:20:13.536899 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1347/2578] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:13.545466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-18fabcf3-e101-4ac8-8cd0-14f0a9e15665 req-e1d65b97-b25c-4ca2-ad60-98588f802a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a4869d-3270-4784-ba92-e6dd6f6c5908", "tag": "03378b5b-21ef-45f5-9b97-31e714be8b0b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:13.547266 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:13.547266 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:13.559087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18fabcf3-e101-4ac8-8cd0-14f0a9e15665 req-e1d65b97-b25c-4ca2-ad60-98588f802a80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.559879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18fabcf3-e101-4ac8-8cd0-14f0a9e15665 req-e1d65b97-b25c-4ca2-ad60-98588f802a80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.567481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:13.578191 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-18fabcf3-e101-4ac8-8cd0-14f0a9e15665 req-e1d65b97-b25c-4ca2-ad60-98588f802a80 service nova] Creating event network-changed:03378b5b-21ef-45f5-9b97-31e714be8b0b for instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 on n-h2-828148-1 Mar 29 02:20:13.580546 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f61a951-8534-49f2-83a1-a4a0d38ba85a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.290027 Mar 29 02:20:13.581088 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1232/2579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:13 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:13.587374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-18fabcf3-e101-4ac8-8cd0-14f0a9e15665 req-e1d65b97-b25c-4ca2-ad60-98588f802a80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048781 Mar 29 02:20:13.588721 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1348/2580] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:13.592639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.597314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:13.600178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c340b7e-2c2b-4dd2-ac20-aa8e3999a43e tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '.version_select at 0x7f8717ea8940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:13.615114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.618281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:13.619333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:13.619777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:14.009451 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4c034e7-2fba-469d-92e5-53eb0881acc5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.425976 Mar 29 02:20:14.018667 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1233/2581] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:20:13 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1/os-interface => generated 1830 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:20:14.018667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-828148-1", "block_migration": false, "disk_over_commit": false}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:14.018667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:14.028813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:14.033506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:14.038929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:14.038929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:14.135047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lazy-loading 'flavor' on Instance uuid 8ac83902-c5a9-4382-95d7-664c16270919 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:14.255652 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c340b7e-2c2b-4dd2-ac20-aa8e3999a43e tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/os-floating-ips/b55c570a-f5d7-45b7-88b9-8632390cbf04" status: 200 len: 184 microversion: 2.1 time: 0.661674 Mar 29 02:20:14.259305 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1349/2582] 10.222.0.36 () {58 vars in 1259 bytes} [Tue Mar 29 02:20:13 2022] GET /compute/v2.1/os-floating-ips/b55c570a-f5d7-45b7-88b9-8632390cbf04 => generated 184 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:14.264687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6bb5e469-f36e-4131-aacf-e6083502718d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724295ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:14.299859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Going to try to live migrate instance to n-h1-828148-1 {{(pid=103514) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:20:14.951502 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6bb5e469-f36e-4131-aacf-e6083502718d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417" status: 202 len: 0 microversion: 2.1 time: 0.693280 Mar 29 02:20:14.956002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1350/2583] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:14 2022] DELETE /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:14.961999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:14.965475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:14.977426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:14.977901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:14.978973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:14.979608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:15.201101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:15.209097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74aa0760-4797-420e-920a-e1a0c176c224 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1474 microversion: 2.1 time: 0.251978 Mar 29 02:20:15.209661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1351/2584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:14 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1474 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:15.214350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:15.214965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:15.224636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:15.224636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:15.224636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:15.224636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:15.428563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:15.438092 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd830994-2a61-4161-b056-4ea551f5dd6c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.227391 Mar 29 02:20:15.438703 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1352/2585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:15 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:15.443725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.152"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:15.630241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:15.642202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:15.642202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:15.642202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:15.642202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:15.998689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Acquired lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:20:17.258592 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-33a18629-c8a2-44e1-8f8e-5056a22e1ed2 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919/action" status: 202 len: 0 microversion: 2.1 time: 3.246801 Mar 29 02:20:17.259255 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1234/2586] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:14 2022] POST /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919/action => generated 0 bytes in 3249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:17.264128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717f5c8b0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:17.295976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:17.296607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 86b98b1f-80d9-4898-97f9-93958d46c417 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:20:17.297843 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist Mar 29 02:20:17.297843 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-34160242-d885-4d38-a407-c0cbb18bcffc'] Mar 29 02:20:17.298122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist Mar 29 02:20:17.298122 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-34160242-d885-4d38-a407-c0cbb18bcffc'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:17.299511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db58643c-8e69-4519-8442-c594fe1b35e7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417" status: 404 len: 194 microversion: 2.1 time: 0.038615 Mar 29 02:20:17.300804 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1235/2587] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:20:17 2022] GET /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417 => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:17.307801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:17.317789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:17.317789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.318391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.319220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.319478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.435901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. Mar 29 02:20:17.437446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:17.439230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c884956d-90c6-436f-8832-c906c8886950 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27/action" status: 404 len: 111 microversion: 2.1 time: 0.137407 Mar 29 02:20:17.441037 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1236/2588] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:17 2022] POST /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27/action => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:17.453140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:17.454806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:17.482306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.482925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.483741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.484421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.511058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:20:17.562791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.563230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.563690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lazy-loading 'fault' on Instance uuid dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:17.753249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:17.773284 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e9f506d-3e8d-46f9-84ff-c5afedd0f84a tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 200 len: 1308 microversion: 2.1 time: 0.331018 Mar 29 02:20:17.773925 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1237/2589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:17 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 1308 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:17.779426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-dbb9fa0f-d8cf-4c7e-a6d6-a260c8d6d6ab req-1c33de3a-3ab0-4f5a-9c13-aa5d79aa7619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46", "name": "network-vif-deleted", "tag": "faa71cb0-0282-4786-98a7-fcfe8beb8b52"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:17.781228 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:17.781228 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:17.791253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dbb9fa0f-d8cf-4c7e-a6d6-a260c8d6d6ab req-1c33de3a-3ab0-4f5a-9c13-aa5d79aa7619 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.792436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dbb9fa0f-d8cf-4c7e-a6d6-a260c8d6d6ab req-1c33de3a-3ab0-4f5a-9c13-aa5d79aa7619 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.811709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-dbb9fa0f-d8cf-4c7e-a6d6-a260c8d6d6ab req-1c33de3a-3ab0-4f5a-9c13-aa5d79aa7619 service nova] Creating event network-vif-deleted:faa71cb0-0282-4786-98a7-fcfe8beb8b52 for instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 on n-h1-828148-1 Mar 29 02:20:17.817647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-dbb9fa0f-d8cf-4c7e-a6d6-a260c8d6d6ab req-1c33de3a-3ab0-4f5a-9c13-aa5d79aa7619 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042162 Mar 29 02:20:17.818958 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1238/2590] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:17.825831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:17.826975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:17.835668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.836456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:17.837772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:17.839086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.302972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:18.319164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d92c3154-b506-42c4-afce-4bae3b07e0a4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.498830 Mar 29 02:20:18.320587 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1239/2591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:17 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:18.328566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e47b72e7-8504-4c73-a237-9f03dfc00ac0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f87244644c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2146069272", "description": "tempest-description-993183199"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:18.453767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Updating instance_info_cache with network_info: [{"id": "fc1d6bda-e489-4d67-8ddd-9094740d1863", "address": "fa:16:3e:fe:09:09", "network": {"id": "998b072a-86bc-4a55-9066-577586ad4414", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1681246663-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8d23a4584f474fdb85d8e58153e29978", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapfc1d6bda-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:20:18.549672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Releasing lock "refresh_cache-b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:20:18.550696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a7ea4c2-b88d-462b-8b85-9a0bf476b5a0 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action" status: 202 len: 0 microversion: 2.1 time: 3.110548 Mar 29 02:20:18.551702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1353/2592] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:15 2022] POST /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb/action => generated 0 bytes in 3112 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:20:18.562000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:18.562542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:18.570499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.571108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.571913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.572349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.799117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:18.808496 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b20cef4b-273a-470e-bbf5-85beeb8f3931 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.251113 Mar 29 02:20:18.809923 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1354/2593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:18 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:18.815181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-48d2d891-58e9-4642-b581-371903d3d54b req-ec076163-dd05-4bcb-b3bd-1aafb6f8465f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:18.817347 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:18.817347 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:18.827079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-48d2d891-58e9-4642-b581-371903d3d54b req-ec076163-dd05-4bcb-b3bd-1aafb6f8465f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.827512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-48d2d891-58e9-4642-b581-371903d3d54b req-ec076163-dd05-4bcb-b3bd-1aafb6f8465f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.844953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-48d2d891-58e9-4642-b581-371903d3d54b req-ec076163-dd05-4bcb-b3bd-1aafb6f8465f service nova] Creating event network-changed:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:20:18.849908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-48d2d891-58e9-4642-b581-371903d3d54b req-ec076163-dd05-4bcb-b3bd-1aafb6f8465f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038497 Mar 29 02:20:18.851199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1355/2594] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:18.857156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:18.857746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:18.877889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.878598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.879386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.879944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.937360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] HTTP exception thrown: Instance 1020c507-540a-4100-9fb6-091dfeea06d5 could not be found. Mar 29 02:20:18.937968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Returning 404 to user: Instance 1020c507-540a-4100-9fb6-091dfeea06d5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:18.938805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ba268126-933b-4407-994c-5c62d878f065 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 404 len: 111 microversion: 2.1 time: 0.086292 Mar 29 02:20:18.939686 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1356/2595] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:18 2022] DELETE /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:18.944280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:18.944936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:18.952918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.953968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:18.955026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:18.955634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.023920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] HTTP exception thrown: Instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 could not be found. Mar 29 02:20:19.024531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Returning 404 to user: Instance dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:19.025407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e0f6e829-0bd6-4b64-84ac-ad6e95086ef8 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46" status: 404 len: 111 microversion: 2.1 time: 0.084714 Mar 29 02:20:19.026504 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1357/2596] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:18 2022] GET /compute/v2.1/servers/dfb7688a-3ba3-45a2-9c60-d5f6b36b4d46 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:19.041095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:19.041803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:19.062526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.062986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.063902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.064368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.147363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e47b72e7-8504-4c73-a237-9f03dfc00ac0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.825261 Mar 29 02:20:19.148372 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1240/2597] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:18 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:19.155545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:19.156343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: 1020c507-540a-4100-9fb6-091dfeea06d5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:19.168387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.170346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.170346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.174788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.225958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] HTTP exception thrown: Instance 1020c507-540a-4100-9fb6-091dfeea06d5 could not be found. Mar 29 02:20:19.226565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Returning 404 to user: Instance 1020c507-540a-4100-9fb6-091dfeea06d5 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:19.227385 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7d0b777-682f-42af-8083-53ce73bba08b tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5" status: 404 len: 111 microversion: 2.1 time: 0.076764 Mar 29 02:20:19.228112 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1241/2598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:19 2022] GET /compute/v2.1/servers/1020c507-540a-4100-9fb6-091dfeea06d5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:19.232974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:19.233438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:19.240876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.241549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.242481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:19.243067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:19.305364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:19.484760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:19.495837 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-998e51d1-c1fd-4473-9570-2ba8dcf9a205 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.468110 Mar 29 02:20:19.496483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1358/2599] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:19 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:19.502234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a5ec7f2-738b-478b-9a88-576c16413cc4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8717ea8280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-767620847", "description": "tempest-description-1480560961"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:19.618563 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-306cdb39-ad37-4616-b0a4-e0e77627c411 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 204 len: 0 microversion: 2.1 time: 0.388683 Mar 29 02:20:19.620819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1242/2600] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:19 2022] DELETE /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:19.626512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59ddf0e1-6de7-4c5d-b6c2-95927a71adba tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '.version_select at 0x7f8717e7cf70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:20.180605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a5ec7f2-738b-478b-9a88-576c16413cc4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.682744 Mar 29 02:20:20.181550 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1359/2601] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:20.186169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:20.187064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:20.194737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.195307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:20.196155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.196657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:20.404151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:20.413638 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32e4a058-7443-4804-afb1-1dcc1678bcdc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.230788 Mar 29 02:20:20.414504 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1360/2602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:20 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:20.420148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89e60faf-9742-4a14-bc88-68ace740d942 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:20.421475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-89e60faf-9742-4a14-bc88-68ace740d942 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 91cad086-8040-4f7e-83d0-3d5c91b0451c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:20.429024 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-89e60faf-9742-4a14-bc88-68ace740d942 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 91cad086-8040-4f7e-83d0-3d5c91b0451c could not be found. Mar 29 02:20:20.429989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89e60faf-9742-4a14-bc88-68ace740d942 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 91cad086-8040-4f7e-83d0-3d5c91b0451c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:20.430999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89e60faf-9742-4a14-bc88-68ace740d942 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/91cad086-8040-4f7e-83d0-3d5c91b0451c/action" status: 404 len: 111 microversion: 2.1 time: 0.015265 Mar 29 02:20:20.433318 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1361/2603] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:20 2022] POST /compute/v2.1/servers/91cad086-8040-4f7e-83d0-3d5c91b0451c/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:20.438968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:20.439390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:20.449299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.449992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:20.451429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.452089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:20.725183 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82458d9b-144b-4d60-88c7-b6ef5e15ba5d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.290403 Mar 29 02:20:20.727015 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1362/2604] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:20 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:20.731866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:20.732575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:20.740237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.740677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:20.741610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:20.742037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.070837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:21.078832 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9ec76ab-6e62-4238-b344-993a8ebb86d9 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1474 microversion: 2.1 time: 0.349420 Mar 29 02:20:21.081379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1363/2605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:20 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1474 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:21.087035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8ca535e-c60a-433d-ba82-52371a737fe1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8724c439d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1586825932", "description": "tempest-description-1943816563"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:21.221017 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59ddf0e1-6de7-4c5d-b6c2-95927a71adba tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/b55c570a-f5d7-45b7-88b9-8632390cbf04" status: 202 len: 0 microversion: 2.1 time: 1.598770 Mar 29 02:20:21.222132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1243/2606] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:20:19 2022] DELETE /compute/v2.1/os-floating-ips/b55c570a-f5d7-45b7-88b9-8632390cbf04 => generated 0 bytes in 1601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:21.226888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:21.227649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:21.236728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.237356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.238165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.238843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.489194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8ca535e-c60a-433d-ba82-52371a737fe1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.406636 Mar 29 02:20:21.489814 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1364/2607] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:21 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:21.494332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:21.494946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:21.502915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.503441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.504138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.504667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.592612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:21.602975 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f033eae8-c350-40a8-a113-ddbfc7af30ef tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.379832 Mar 29 02:20:21.604544 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1244/2608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:21 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:21.609658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:21.610222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:21.622259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.623121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.624429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.625068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.693275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:21.766589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:21.776181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd5818bc-6874-4ecb-b886-91da7f14a9ed tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1672 microversion: 2.1 time: 0.285340 Mar 29 02:20:21.777350 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1365/2609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:21 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1672 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:21.781876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:21.782758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:21.790261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.790709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.791676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:21.792145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:21.995993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:22.006064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-081dc77f-8ee2-4b2a-88b9-f3c545da8b4c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.227462 Mar 29 02:20:22.006643 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1366/2610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:21 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:22.011804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88bf1bde-9707-45f3-a08a-8e0d67e251bf tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f87240cfee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:22.027961 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0abbfa23-903f-4155-a10e-f0e576ef04f4 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 204 len: 0 microversion: 2.1 time: 0.418237 Mar 29 02:20:22.027961 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1245/2611] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:21 2022] DELETE /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:22.031908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:22.032807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:22.041844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.042288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.043059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.043492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.399912 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88bf1bde-9707-45f3-a08a-8e0d67e251bf tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.391650 Mar 29 02:20:22.401284 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1367/2612] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:20:22 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:22.405982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:22.406593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:22.414582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.415119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.415927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.416997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.478533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:22.488222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94ed8cb8-a08a-454d-b046-0f8c9fec0237 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.460426 Mar 29 02:20:22.488905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1246/2613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:22 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:22.493450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:22.494134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:22.504357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.505030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.505830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:22.506293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:22.613473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:22.622333 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2566e754-46b1-49ab-97e6-8fef15e5f8c8 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 200 len: 1525 microversion: 2.1 time: 0.220055 Mar 29 02:20:22.623295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1368/2614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:22 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 1525 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:22.628149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13f280f1-5e55-4477-84a3-aca531e6e473 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724c6df70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.007256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:23.016741 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0a21e37-26d2-4b44-b1f0-72221f175329 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1474 microversion: 2.1 time: 0.526551 Mar 29 02:20:23.017370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1247/2615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:22 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1474 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:23.021799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:23.023268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.030355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.030796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.031619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.032046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.070664 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13f280f1-5e55-4477-84a3-aca531e6e473 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384" status: 202 len: 0 microversion: 2.1 time: 0.445865 Mar 29 02:20:23.071559 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1369/2616] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:22 2022] DELETE /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:23.077505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.078307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.083884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. Mar 29 02:20:23.088147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:23.088147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bd9f0a81-633b-4bd2-9023-a203afe57969 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27/action" status: 404 len: 111 microversion: 2.1 time: 0.067034 Mar 29 02:20:23.088147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1248/2617] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:23 2022] POST /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:23.088532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.088532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.088532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.088532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.090384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.090996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.098174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.099433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.099811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.100240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.316025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:23.325509 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-532e95c3-1d66-4243-809e-d7ef90aa1452 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1677 microversion: 2.1 time: 0.252523 Mar 29 02:20:23.326119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1370/2618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1677 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:23.330858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724b99f70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.353034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:23.356657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:23.357306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 56897519-f511-40f7-8a78-6bdcf49f9384 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:20:23.357914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist Mar 29 02:20:23.357914 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-dd9196af-790c-47fd-9852-b677aab37866'] Mar 29 02:20:23.358537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist Mar 29 02:20:23.358537 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-dd9196af-790c-47fd-9852-b677aab37866'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:23.359347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b998b30e-b3ba-4fc3-b00d-f650b39d97b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384" status: 404 len: 194 microversion: 2.1 time: 0.031951 Mar 29 02:20:23.359890 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1371/2619] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:23.362402 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0631d551-3d96-4d7d-bc52-f5f366234c98 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.275563 Mar 29 02:20:23.363310 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1249/2620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:23.364628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.365272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.367908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-782f0af8-2323-459e-be17-a43fd343b353 req-39acf8af-92d7-4f6a-976e-c1a874e656e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8f191a-48a1-42b0-aa25-3c8e9910e694", "name": "network-vif-deleted", "tag": "ad76061b-ab7f-4bda-b237-52409edd20c2"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:23.369623 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:23.369623 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:23.373310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.378125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.378125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.378125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.381207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-782f0af8-2323-459e-be17-a43fd343b353 req-39acf8af-92d7-4f6a-976e-c1a874e656e2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.381207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-782f0af8-2323-459e-be17-a43fd343b353 req-39acf8af-92d7-4f6a-976e-c1a874e656e2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.408074 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-782f0af8-2323-459e-be17-a43fd343b353 req-39acf8af-92d7-4f6a-976e-c1a874e656e2 service nova] Creating event network-vif-deleted:ad76061b-ab7f-4bda-b237-52409edd20c2 for instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 on n-h1-828148-1 Mar 29 02:20:23.408074 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-782f0af8-2323-459e-be17-a43fd343b353 req-39acf8af-92d7-4f6a-976e-c1a874e656e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040084 Mar 29 02:20:23.408074 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1250/2621] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:23.420924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be64b947-080b-4b03-99b3-cc86ca0467d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8725e6c430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.816189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:23.825449 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-303a6978-dc87-4535-ae4a-f6c3519f9c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.464542 Mar 29 02:20:23.826284 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1372/2622] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:23.847144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.847144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.850835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.851342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.861698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.861698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.904358 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be64b947-080b-4b03-99b3-cc86ca0467d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96" status: 202 len: 0 microversion: 2.1 time: 0.490330 Mar 29 02:20:23.905495 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1251/2623] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:23 2022] DELETE /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:23.909784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:23.910497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:23.926844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.926844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:23.926844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:23.926844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.161525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:24.168899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7649ef72-7534-4aee-9dd2-67b3b395ed3c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.257720 Mar 29 02:20:24.184692 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1252/2624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:24.184692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724d0b550>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-c00bf99b-5402-418c-ae82-b943f58623d5'] Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist Mar 29 02:20:24.223725 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-c00bf99b-5402-418c-ae82-b943f58623d5'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:24.231316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-35dad88a-44d7-4162-b9e1-dea2c0eca71f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96" status: 404 len: 194 microversion: 2.1 time: 0.034211 Mar 29 02:20:24.231316 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1253/2625] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:20:24 2022] GET /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:24.231316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:24.231316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:24.231316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.234084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.234084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.234084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.317424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.317424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.317424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lazy-loading 'fault' on Instance uuid 0d8f191a-48a1-42b0-aa25-3c8e9910e694 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:24.430701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:24.430701 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b21fdeb3-67d2-4d46-9dbc-0900931cc6d3 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 200 len: 1525 microversion: 2.1 time: 0.585795 Mar 29 02:20:24.430701 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1373/2626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:23 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 1525 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:24.430701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f81a64aa-dc31-4f6f-84ba-f3974d6aafe0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:24.438848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f81a64aa-dc31-4f6f-84ba-f3974d6aafe0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: abc871b7-853b-497d-b78f-26f362ad2acf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:24.438848 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f81a64aa-dc31-4f6f-84ba-f3974d6aafe0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance abc871b7-853b-497d-b78f-26f362ad2acf could not be found. Mar 29 02:20:24.456737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f81a64aa-dc31-4f6f-84ba-f3974d6aafe0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance abc871b7-853b-497d-b78f-26f362ad2acf could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:24.456737 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f81a64aa-dc31-4f6f-84ba-f3974d6aafe0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/abc871b7-853b-497d-b78f-26f362ad2acf/action" status: 404 len: 111 microversion: 2.1 time: 0.013982 Mar 29 02:20:24.456737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1374/2627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:24 2022] POST /compute/v2.1/servers/abc871b7-853b-497d-b78f-26f362ad2acf/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:24.461295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283a9a04d31043dfa14f90328f0e38eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5470d84721448dbbef995c3e5c4748a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:24.465773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87aa07b3-2267-44f9-891d-d642ee356fd4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717ea8280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:24.471211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c97e70e-201a-42a3-ab29-6aa5b8cf80e3 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 200 len: 1308 microversion: 2.1 time: 0.250357 Mar 29 02:20:24.481919 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1254/2628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:24 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:24.481919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:24.481919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:24.498415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.498415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.498415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.498415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.739674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:24.748519 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edb15e86-fdd7-487a-8f9d-506f22b85e62 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1677 microversion: 2.1 time: 0.271630 Mar 29 02:20:24.750086 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1255/2629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:24.753835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:24.754824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:24.762108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.762562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:24.763326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:24.763822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.003947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:25.012365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2bec5e2-678f-4b41-a5e6-b65ec5c4aa1c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.261863 Mar 29 02:20:25.012950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1256/2630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:24 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:25.017380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.017990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:25.025032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.025514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.026282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.026744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.128513 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87aa07b3-2267-44f9-891d-d642ee356fd4 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6" status: 202 len: 0 microversion: 2.1 time: 0.683340 Mar 29 02:20:25.129609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1375/2631] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:24 2022] DELETE /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:25.134554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7dbb25da-84ab-40e4-a39e-c5c67ed87158 req-ec36a5b3-9f6a-4aa3-915d-a2ce7fa38cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7b6a20e-6ae7-4cbf-b946-e5e89a878afb", "name": "network-vif-deleted", "tag": "fc1d6bda-e489-4d67-8ddd-9094740d1863"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:25.149001 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:25.149001 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:25.150365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7dbb25da-84ab-40e4-a39e-c5c67ed87158 req-ec36a5b3-9f6a-4aa3-915d-a2ce7fa38cf8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.150832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7dbb25da-84ab-40e4-a39e-c5c67ed87158 req-ec36a5b3-9f6a-4aa3-915d-a2ce7fa38cf8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.170133 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7dbb25da-84ab-40e4-a39e-c5c67ed87158 req-ec36a5b3-9f6a-4aa3-915d-a2ce7fa38cf8 service nova] Creating event network-vif-deleted:fc1d6bda-e489-4d67-8ddd-9094740d1863 for instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb on n-h2-828148-1 Mar 29 02:20:25.176252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7dbb25da-84ab-40e4-a39e-c5c67ed87158 req-ec36a5b3-9f6a-4aa3-915d-a2ce7fa38cf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045172 Mar 29 02:20:25.177314 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1376/2632] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:25.183282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724172700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.215465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1744679d-9486-4ec1-b1cf-eabe5614cf40'] Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1744679d-9486-4ec1-b1cf-eabe5614cf40'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:25.218198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3af021a-88ed-40d4-954f-c6dcf63d6aed tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6" status: 404 len: 194 microversion: 2.1 time: 0.039810 Mar 29 02:20:25.219940 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1377/2633] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:25.232657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9571b89-23b9-4d23-ab92-01cd2a985ae5 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724c43550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.247237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:25.255782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-083582ef-19ed-4f34-8970-bbab50f09374 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.241722 Mar 29 02:20:25.256973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1257/2634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:25.273183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.276679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:25.282008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.282809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.283874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.284401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.492540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:25.500650 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-798d8264-b94a-4a4d-b720-d8da949f2ff1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.231247 Mar 29 02:20:25.501233 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1258/2635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:25.505823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.506425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:25.513623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.514069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.514833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.515260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.532687 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9571b89-23b9-4d23-ab92-01cd2a985ae5 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.305124 Mar 29 02:20:25.533322 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1378/2636] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:25.537837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:25.538906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] [instance: 0d8f191a-48a1-42b0-aa25-3c8e9910e694] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:25.547345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.547792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.548862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.549326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.583082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:25.583520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:25.583964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lazy-loading 'fault' on Instance uuid b7b6a20e-6ae7-4cbf-b946-e5e89a878afb {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:25.599968 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] HTTP exception thrown: Instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 could not be found. Mar 29 02:20:25.600569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Returning 404 to user: Instance 0d8f191a-48a1-42b0-aa25-3c8e9910e694 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:25.601416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7237bd8-c91b-447e-9506-b09f3b7184d2 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694" status: 404 len: 111 microversion: 2.1 time: 0.067184 Mar 29 02:20:25.601968 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1379/2637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/servers/0d8f191a-48a1-42b0-aa25-3c8e9910e694 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:25.606953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9dbe85e6-0c44-4ee5-8c2e-438510818973 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:25.607491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9dbe85e6-0c44-4ee5-8c2e-438510818973 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: c940b993-c6ea-41cb-9e9c-7a598900c6dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:25.614584 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9dbe85e6-0c44-4ee5-8c2e-438510818973 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance c940b993-c6ea-41cb-9e9c-7a598900c6dc could not be found. Mar 29 02:20:25.615161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9dbe85e6-0c44-4ee5-8c2e-438510818973 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance c940b993-c6ea-41cb-9e9c-7a598900c6dc could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:25.615965 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9dbe85e6-0c44-4ee5-8c2e-438510818973 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/c940b993-c6ea-41cb-9e9c-7a598900c6dc/action" status: 404 len: 111 microversion: 2.1 time: 0.013092 Mar 29 02:20:25.616510 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1380/2638] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:25 2022] POST /compute/v2.1/servers/c940b993-c6ea-41cb-9e9c-7a598900c6dc/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:25.621146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5d6eef7-1739-41f7-a10c-965f2d22ba5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8724c43310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-16091297", "description": "tempest-description-303182322"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:25.728579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c85deb5dc90342e88d02accfb83272e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23a4584f474fdb85d8e58153e29978', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:25.736804 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4339d48-d2be-45cc-bfeb-863988eebff6 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 200 len: 1313 microversion: 2.1 time: 0.234638 Mar 29 02:20:25.746498 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1259/2639] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:25 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:25.746498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-65aff43f-3113-4cb7-9ce3-7cd15b906288 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8724d419d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.099918 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5d6eef7-1739-41f7-a10c-965f2d22ba5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.482171 Mar 29 02:20:26.100588 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1381/2640] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:25 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:26.107884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.107884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.113739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.114184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.114938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.115368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.319416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:26.328154 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7a7ee073-e26d-42df-8508-355fba5ec24c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.226589 Mar 29 02:20:26.328707 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1382/2641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:26.332906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.333506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.340484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.341000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.341782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.342209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.347875 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-65aff43f-3113-4cb7-9ce3-7cd15b906288 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285" status: 204 len: 0 microversion: 2.1 time: 0.609431 Mar 29 02:20:26.348438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1260/2642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:25 2022] DELETE /compute/v2.1/images/6c05392c-4dd9-41a1-91f3-0d2d527ae285 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:26.353117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.354292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.361791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.362268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.363096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.363535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.540653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:26.549755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-266a4ef6-8595-4e2d-801d-519979b31fb0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1677 microversion: 2.1 time: 0.220076 Mar 29 02:20:26.550320 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1383/2643] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:26.554582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6052bbbd-bf29-4f1d-96ad-ff13473ea0b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8724d21af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2040991360", "description": "tempest-description-850834761"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:26.565678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:26.573899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a05ae18-71e6-4a4f-b819-86ee8bd17a6b tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.224172 Mar 29 02:20:26.574469 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1261/2644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:26.578676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.579280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.586242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.586729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.587493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.587920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.789832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:26.798928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f526c8fd-47f5-4a71-bb88-ed87c7f48b13 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.223256 Mar 29 02:20:26.799601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1262/2645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:26.803803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-76217b5c-d6f7-4701-96b8-bd9f9a08c748 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f8717e7c790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.877377 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6052bbbd-bf29-4f1d-96ad-ff13473ea0b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.325946 Mar 29 02:20:26.878260 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1384/2646] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:26.883108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:26.886198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] [instance: b7b6a20e-6ae7-4cbf-b946-e5e89a878afb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.893860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.894607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.895118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.895594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.951123 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] HTTP exception thrown: Instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb could not be found. Mar 29 02:20:26.951848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] Returning 404 to user: Instance b7b6a20e-6ae7-4cbf-b946-e5e89a878afb could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:26.952512 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4b9b6c6-74a3-40ac-8702-c3cf0d4ada87 tempest-FloatingIPsAssociationTestJSON-2110088279 tempest-FloatingIPsAssociationTestJSON-2110088279-project] 10.222.0.36 "GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb" status: 404 len: 111 microversion: 2.1 time: 0.073284 Mar 29 02:20:26.953084 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1385/2647] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] GET /compute/v2.1/servers/b7b6a20e-6ae7-4cbf-b946-e5e89a878afb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:26.961759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:26.962311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:26.970511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.970961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:26.971744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:26.972175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:27.030000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'restore' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active Mar 29 02:20:27.030603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'restore' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:27.031534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a77d4b8a-45dc-4abb-83f4-b58629ae0be1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 145 microversion: 2.1 time: 0.077447 Mar 29 02:20:27.032012 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1386/2648] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:26 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:20:27.038928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-664712046", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "eeb1fafd-c7c7-4d1d-bc00-0de30e05c250"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:27.112013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] validate_networks() for [('eeb1fafd-c7c7-4d1d-bc00-0de30e05c250', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:20:27.313461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-76217b5c-d6f7-4701-96b8-bd9f9a08c748 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc" status: 204 len: 0 microversion: 2.1 time: 0.512782 Mar 29 02:20:27.314026 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1263/2649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:26 2022] DELETE /compute/v2.1/images/e6b266b8-72ba-4166-947b-11bbf32c68cc => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:27.320670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:27.321393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:27.330783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:27.331234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:27.332015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:27.332744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:27.811280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:20:27.811720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:20:27.814794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:20:27.814794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:20:27.814794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:20:27.823220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:27.823220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:27.823623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:27.824049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:27.844417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:27.845154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Getting quotas for project e0a643d48830408fb8ab75ad5d8040a2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:20:27.852206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Getting quotas for user 47c8cbb3524b44628dcb9c78f8a06fe4 and project e0a643d48830408fb8ab75ad5d8040a2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:20:27.855704 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c873e1c-b7cd-4bbd-9760-ebd6ca29df69 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.540662 Mar 29 02:20:27.856536 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1264/2650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:27 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:27.862135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6e40ed6-7c20-4fd8-b84f-61cad5eab424 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] Calling method '.version_select at 0x7f87241dc280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:27.864002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:20:27.871018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:20:28.034751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2a9cc3e-0c41-420e-9ad1-8d5da340b867 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001629 Mar 29 02:20:28.035755 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1387/2651] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:20:28.048489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:28.049925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:28.063604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.063604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.063604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.063604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.328499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:28.333607 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee69b30f-4bcc-40c4-b567-54a89ba19beb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.291444 Mar 29 02:20:28.334206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1388/2652] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:28 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:28.467766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6e40ed6-7c20-4fd8-b84f-61cad5eab424 tempest-ListImageFiltersTestJSON-1548654339 tempest-ListImageFiltersTestJSON-1548654339-project] 10.222.0.36 "DELETE /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f" status: 204 len: 0 microversion: 2.1 time: 0.600449 Mar 29 02:20:28.467766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1265/2653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:27 2022] DELETE /compute/v2.1/images/143b3231-8225-40a4-b867-f659ab3baf7f => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:28.472583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:28.473140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:28.498408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:28.499238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:28.500236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.501561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.502475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.503367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.511150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.512057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.513293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.513912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.790393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:28.805653 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f4da487-0b19-4754-8e03-86297cdc0e67 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.466907 Mar 29 02:20:28.809066 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1389/2654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:28 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:28.813847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-add21ee5-f093-4506-8a38-3ee08b0e11d8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:28.814460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-add21ee5-f093-4506-8a38-3ee08b0e11d8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:28.884770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-add21ee5-f093-4506-8a38-3ee08b0e11d8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:28.893331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-add21ee5-f093-4506-8a38-3ee08b0e11d8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1215 microversion: 2.1 time: 0.082082 Mar 29 02:20:28.893331 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1390/2655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:28 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:28.899022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-851693c6-7394-4f7b-90b6-e8ea31e41f9b req-2a5447c1-72e7-4349-8fec-3f52d8b555f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac83902-c5a9-4382-95d7-664c16270919", "name": "network-vif-unplugged", "status": "completed", "tag": "53ab3e71-0b99-4c85-a59d-08a29cd2f220"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:28.900454 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:28.900454 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:28.910683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-851693c6-7394-4f7b-90b6-e8ea31e41f9b req-2a5447c1-72e7-4349-8fec-3f52d8b555f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:28.911193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-851693c6-7394-4f7b-90b6-e8ea31e41f9b req-2a5447c1-72e7-4349-8fec-3f52d8b555f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:28.939267 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-851693c6-7394-4f7b-90b6-e8ea31e41f9b req-2a5447c1-72e7-4349-8fec-3f52d8b555f3 service nova] Creating event network-vif-unplugged:53ab3e71-0b99-4c85-a59d-08a29cd2f220 for instance 8ac83902-c5a9-4382-95d7-664c16270919 on n-h2-828148-1 Mar 29 02:20:28.943943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-851693c6-7394-4f7b-90b6-e8ea31e41f9b req-2a5447c1-72e7-4349-8fec-3f52d8b555f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048903 Mar 29 02:20:28.944884 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1391/2656] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:29.421641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:29.431043 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1943c04e-7034-4da4-8d2b-28d23676ba36 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.970952 Mar 29 02:20:29.431345 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1266/2657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:28 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:29.449229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f9fc222-bad6-4773-bf03-57e50bc2a554 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:29.450314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f9fc222-bad6-4773-bf03-57e50bc2a554 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: b3d72be1-c6f9-47e9-b224-31766518f12f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:29.458095 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8f9fc222-bad6-4773-bf03-57e50bc2a554 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance b3d72be1-c6f9-47e9-b224-31766518f12f could not be found. Mar 29 02:20:29.458777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f9fc222-bad6-4773-bf03-57e50bc2a554 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance b3d72be1-c6f9-47e9-b224-31766518f12f could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:29.459655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f9fc222-bad6-4773-bf03-57e50bc2a554 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/b3d72be1-c6f9-47e9-b224-31766518f12f/action" status: 404 len: 111 microversion: 2.1 time: 0.015720 Mar 29 02:20:29.460288 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1392/2658] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:29 2022] POST /compute/v2.1/servers/b3d72be1-c6f9-47e9-b224-31766518f12f/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:29.470274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:29.470457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:29.484122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:29.484122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:29.484122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:29.484122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:29.824889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:29.826063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:29.834429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:29.835257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:29.835645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:29.836538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.102067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:30.113860 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c2b37fd-4945-469f-a294-0438652efbd1 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.297598 Mar 29 02:20:30.114854 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1393/2659] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:29 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:30.120745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:30.121578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:30.136008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.137114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.138204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.138646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.178147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:30.186353 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a616451-053b-4b3e-8c28-8bacca55af32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.720469 Mar 29 02:20:30.188124 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1267/2660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:29 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:30.206666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:30.207490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:30.215628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.216086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.216938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.217383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.409870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:30.420589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce0e6b47-4543-47ca-9206-8db53ecad82e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1267 microversion: 2.1 time: 0.303841 Mar 29 02:20:30.430507 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1394/2661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:30 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:30.681938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:30.710668 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5208a36-a371-451f-9bb5-a00aa820916f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.507682 Mar 29 02:20:30.724100 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1268/2662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:30.736027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:30.736765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:30.789668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.789668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.805484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.805484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.897359 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'resume' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active Mar 29 02:20:30.898017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'resume' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:30.898337 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0cdad0b5-edad-4f89-9d06-2e55ba06b20b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 144 microversion: 2.1 time: 0.167686 Mar 29 02:20:30.898872 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1395/2663] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:30 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 144 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:20:30.907525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:30.908172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:30.917005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.917005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:30.924553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:30.924553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.300946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:31.300946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:31.300946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.300946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.304250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.304250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.352829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:31.362379 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2cc01a1-634f-42b3-820e-13e1ee9dfaf4 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.231751 Mar 29 02:20:31.362379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1396/2664] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:31 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:31.369512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-05856e71-0891-4eaa-b424-3d3797244adc req-fc93238a-c5fb-4e3b-ad3e-4fea1783dd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac83902-c5a9-4382-95d7-664c16270919", "tag": "53ab3e71-0b99-4c85-a59d-08a29cd2f220"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:31.369512 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:31.369512 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:31.396592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-05856e71-0891-4eaa-b424-3d3797244adc req-fc93238a-c5fb-4e3b-ad3e-4fea1783dd3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.396592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-05856e71-0891-4eaa-b424-3d3797244adc req-fc93238a-c5fb-4e3b-ad3e-4fea1783dd3b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.406302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-05856e71-0891-4eaa-b424-3d3797244adc req-fc93238a-c5fb-4e3b-ad3e-4fea1783dd3b service nova] Creating event network-changed:53ab3e71-0b99-4c85-a59d-08a29cd2f220 for instance 8ac83902-c5a9-4382-95d7-664c16270919 on n-h2-828148-1 Mar 29 02:20:31.438491 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-05856e71-0891-4eaa-b424-3d3797244adc req-fc93238a-c5fb-4e3b-ad3e-4fea1783dd3b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047791 Mar 29 02:20:31.438491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1397/2665] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:31.449582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:31.449582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:31.465735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.465735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.465735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.465735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.579394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:31.589777 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-506f89e3-774c-4caf-a31f-c80c881842b7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.685987 Mar 29 02:20:31.590685 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1269/2666] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:31.609205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:31.618643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:31.618643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.618643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.620415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:31.620513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:31.620513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:31.631433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86aa99e9-bffc-4be5-80f6-c9852924a0a1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1285 microversion: 2.1 time: 0.197684 Mar 29 02:20:31.648740 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1398/2667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:31 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:32.051287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Calling method '.version_select at 0x7f87242e85e0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:32.061120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.061492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.062848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.062848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.085674 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23053ab4-572c-4ebd-b2eb-953ac468c3a7 tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] 10.222.0.36 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.217537 Mar 29 02:20:32.086473 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1399/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Tue Mar 29 02:20:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:32.147477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-2105866241", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:32.225241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:20:32.298856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:32.307827 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5d61bb5-90a7-4a38-9bbe-0250327c0233 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.703135 Mar 29 02:20:32.366287 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1270/2669] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:31 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:32.378277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:32.379555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:32.389353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.390142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.391338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.392346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.601878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Getting quotas for project 4cc841aca6444660ba64de3fb756beca. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:20:32.608162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Getting quotas for user 8ad24c04056941c4b986f277b82a05e1 and project 4cc841aca6444660ba64de3fb756beca. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:20:32.621767 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Mar 29 02:20:32.622365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:32.623181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8ad3bda-35f9-4080-95f2-95143304610b tempest-AbsoluteLimitsNegativeTestJSON-2084221684 tempest-AbsoluteLimitsNegativeTestJSON-2084221684-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.480083 Mar 29 02:20:32.623954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1400/2670] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Mar 29 02:20:32 2022] POST /compute/v2.1/servers => generated 87 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:20:32.634554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18fac780-f3b7-4226-8ceb-18a27195ce1e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a722a75c-2ddf-4bff-8ad8-e09644f11137"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:32.635786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18fac780-f3b7-4226-8ceb-18a27195ce1e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:32.636570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18fac780-f3b7-4226-8ceb-18a27195ce1e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.006181 Mar 29 02:20:32.637118 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1401/2671] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:20:32 2022] POST /compute/v2.1/servers => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:32.646960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:32.647659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:32.655678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.656157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.657019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.657511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.898875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:32.910818 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-073a7580-c9e9-4b38-bdf0-4e52be621863 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.268625 Mar 29 02:20:32.911811 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1402/2672] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:32 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:32.930309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:32.931388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:32.945550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.945999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:32.946940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:32.947533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:33.047451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:33.058291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3bd329c-1275-4510-b999-91162ded16b8 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.683866 Mar 29 02:20:33.059930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1271/2673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:32 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:33.065741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:33.066358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:33.074215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:33.075729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:33.076620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:33.077287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:33.158897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:33.179413 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac1a04a4-ab6c-4d49-8758-c28d2f74822b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1273 microversion: 2.1 time: 0.257045 Mar 29 02:20:33.180968 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1403/2674] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:32 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:33.608105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:33.618148 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-550bcf02-3f28-4594-8631-05026262ecae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.557126 Mar 29 02:20:33.621899 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1272/2675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:33 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:33.636799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82eda127-7e7c-40c3-a866-ed0e8538ee03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:33.637616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82eda127-7e7c-40c3-a866-ed0e8538ee03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: e12040a7-3d93-429e-b6aa-db9d8adfee5c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:33.650659 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-82eda127-7e7c-40c3-a866-ed0e8538ee03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance e12040a7-3d93-429e-b6aa-db9d8adfee5c could not be found. Mar 29 02:20:33.651578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82eda127-7e7c-40c3-a866-ed0e8538ee03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance e12040a7-3d93-429e-b6aa-db9d8adfee5c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:33.652601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82eda127-7e7c-40c3-a866-ed0e8538ee03 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/e12040a7-3d93-429e-b6aa-db9d8adfee5c/action" status: 404 len: 111 microversion: 2.1 time: 0.020478 Mar 29 02:20:33.653871 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1404/2676] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:33 2022] POST /compute/v2.1/servers/e12040a7-3d93-429e-b6aa-db9d8adfee5c/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:33.662227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:33.662776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:33.671254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:33.671952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:33.673211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:33.674152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.078223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:34.078964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:34.089340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.089830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.090676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.091146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.234230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:34.243575 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05c87ef4-7e18-41d2-a246-b1f0535d919e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.584964 Mar 29 02:20:34.244934 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1273/2677] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:33 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:34.250500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:34.251302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:34.262203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.263724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.265201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.265850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.824597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:34.830699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ddd33c0-83cf-4f70-9b5a-9a9654d9e3dd tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.757159 Mar 29 02:20:34.831249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1405/2678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:34 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:34.835697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:34.836298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:34.843425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.843865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.844809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:34.845268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:34.879762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:34.901592 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1628f1ea-4ca2-4368-a2dd-8ebfc976b4c9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.652877 Mar 29 02:20:34.904704 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1274/2679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:34 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:35.199439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2b0d0dfb-d5cc-4dc7-8213-8f1b3aa5eba3 req-5fc66ace-0954-4636-9879-03fb3534e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34179265-2821-4ab0-9f32-3319d2bc9c65", "tag": "5acf862c-d793-4450-9029-a9c7f7a328b6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:35.201118 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:35.201118 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:35.210466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b0d0dfb-d5cc-4dc7-8213-8f1b3aa5eba3 req-5fc66ace-0954-4636-9879-03fb3534e8d9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:35.210973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b0d0dfb-d5cc-4dc7-8213-8f1b3aa5eba3 req-5fc66ace-0954-4636-9879-03fb3534e8d9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:35.229609 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2b0d0dfb-d5cc-4dc7-8213-8f1b3aa5eba3 req-5fc66ace-0954-4636-9879-03fb3534e8d9 service nova] Creating event network-changed:5acf862c-d793-4450-9029-a9c7f7a328b6 for instance 34179265-2821-4ab0-9f32-3319d2bc9c65 on n-h1-828148-1 Mar 29 02:20:35.234579 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2b0d0dfb-d5cc-4dc7-8213-8f1b3aa5eba3 req-5fc66ace-0954-4636-9879-03fb3534e8d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039265 Mar 29 02:20:35.235354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1275/2680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:35.786165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:35.791294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-396f9644-8e94-42c4-960c-79ad66c9a253 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.958256 Mar 29 02:20:35.791848 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1406/2681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:34 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:35.809673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:35.810654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:35.819328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:35.819995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:35.820985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:35.821556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:35.862330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:35.863077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:35.879661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:35.880127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:35.881013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:35.881460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:35.901348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lazy-loading 'flavor' on Instance uuid 18fccd9e-363a-446e-8b19-eb469eee1129 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:36.246816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:36.261280 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ea6d7fc-2db4-41a1-9578-6f2da2945914 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.416813 Mar 29 02:20:36.268086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1407/2682] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:35 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:36.276769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:36.277349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:36.297745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:36.297745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:36.297745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:36.297745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:36.645157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:36.652473 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-048c00af-a015-4ff5-a3c0-0d2ab9d9c9ce tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.388810 Mar 29 02:20:36.653363 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1408/2683] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:36 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:36.731930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81d34258-2cf7-4aa1-ae9b-e5e0a1e14b6f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.927369 Mar 29 02:20:36.732571 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1276/2684] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:35 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:36.743063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:36.743194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:36.751366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:36.751863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:36.752713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:36.753208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:37.239038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:37.254943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0663fc61-3fce-4328-812f-ca19245571b8 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.517620 Mar 29 02:20:37.256297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1409/2685] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:36 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:37.279301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:37.280600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:37.288589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:37.289387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:37.290429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:37.291094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:37.669740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:37.670277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:37.683628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:37.690802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:37.692063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:37.692721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:37.965393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:37.973546 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5153228-9068-4449-8aa2-2b446d235421 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.307863 Mar 29 02:20:37.979677 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1410/2686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:37 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:37.982200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:37.990834 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-788f1cd5-f737-4130-af14-552080213173 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1391 microversion: 2.1 time: 0.715709 Mar 29 02:20:37.991347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1277/2687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:37 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1391 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:38.273588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:38.274040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:38.281667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:38.282114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:38.282876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:38.283312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:38.687275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:38.703499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ba5bf34-0b4a-490b-9768-1f56d320bdab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.433999 Mar 29 02:20:38.704106 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1411/2688] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:38 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:38.990954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:38.991836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:38.999742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.000191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.000997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.001423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.008296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:39.009142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:39.019041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.019041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.020006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.020680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.235440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:39.244383 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c0024b8-fd3b-45d5-ab2b-05213c1ca4f0 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1381 microversion: 2.1 time: 0.239189 Mar 29 02:20:39.246381 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1412/2689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:39 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1381 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:39.260138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-37d9ac9b-282b-4854-8f91-99edfc785694 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '.version_select at 0x7f87240cf940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:39.264523 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-migrations:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:39.264523 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:39.264523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37d9ac9b-282b-4854-8f91-99edfc785694 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.264523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37d9ac9b-282b-4854-8f91-99edfc785694 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.273979 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-37d9ac9b-282b-4854-8f91-99edfc785694 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.017279 Mar 29 02:20:39.281976 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1413/2690] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:20:39 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:39.286841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:39.287422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:39.288223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:39.300996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.308239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.308239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.308239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.317081 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58cfc1d1-7796-421b-8049-2f175316ee7c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.330111 Mar 29 02:20:39.324742 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1278/2691] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:38 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:39.591933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7a48f7a-657a-4054-9841-b5c11dfa4840 tempest-LiveMigrationTest-2102155895 tempest-LiveMigrationTest-2102155895-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1532 microversion: 2.1 time: 0.308649 Mar 29 02:20:39.592404 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1414/2692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:39 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1532 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:39.625418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:39.631058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:39.635860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.636542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.638093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.638992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.721425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:39.723478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:39.725693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:39.737294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.737936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:39.739517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:39.740517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:40.034084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:40.037892 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-47d77b4c-fe8e-4ced-96bf-c8d27ca0b40f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.320061 Mar 29 02:20:40.038670 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1415/2693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:39 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:40.160443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d146d5a-f624-4752-aa17-885b6ec7e56f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 204 len: 0 microversion: 2.1 time: 0.538961 Mar 29 02:20:40.164807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1279/2694] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:39 2022] DELETE /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:40.170457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:40.171651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:40.180004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:40.180442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:40.181328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:40.181922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:40.336815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:40.338326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:40.350802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:40.351388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:40.353608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:40.354129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:40.430853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:40.441943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5db0d635-5bb3-4ad7-bee5-f6f6750bc558 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1387 microversion: 2.1 time: 0.275671 Mar 29 02:20:40.442494 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1416/2695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:40 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1387 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:40.858655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:40.869323 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d7bdffd-131b-47ee-b39f-9f4eb4293568 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.538671 Mar 29 02:20:40.873381 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1280/2696] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:40 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:41.055453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:41.056283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:41.064316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.064865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:41.065615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.066047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:41.365268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:41.377351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12b6ecbf-06e7-4616-b97e-491cf727c234 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.325562 Mar 29 02:20:41.378160 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1417/2697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:41 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:41.459137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:41.459779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:41.467851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.468298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:41.469507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.469507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:41.890282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:41.890991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:41.898836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.899281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:41.900623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:41.901103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:42.346765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:42.357322 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb5c2de2-c0ed-4e74-82c6-e157c538f5c3 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1387 microversion: 2.1 time: 0.901769 Mar 29 02:20:42.358618 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1281/2698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:41 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1387 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:42.369871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:42.379729 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7cfa6b3d-6f1c-4aa9-a474-86ddf5ec044d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.493274 Mar 29 02:20:42.381239 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1418/2699] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:41 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:42.394916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:42.395728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:42.404386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:42.405201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:42.405965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:42.406543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:42.764482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-636c195f-b7c7-40db-aae2-31dd97080c20 req-47841ba4-07a4-4da2-8e4a-02f6c9f725ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac83902-c5a9-4382-95d7-664c16270919", "name": "network-vif-deleted", "tag": "53ab3e71-0b99-4c85-a59d-08a29cd2f220"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:42.766225 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:42.766225 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:42.776763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-636c195f-b7c7-40db-aae2-31dd97080c20 req-47841ba4-07a4-4da2-8e4a-02f6c9f725ce service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:42.777270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-636c195f-b7c7-40db-aae2-31dd97080c20 req-47841ba4-07a4-4da2-8e4a-02f6c9f725ce service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:42.794373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-636c195f-b7c7-40db-aae2-31dd97080c20 req-47841ba4-07a4-4da2-8e4a-02f6c9f725ce service nova] Creating event network-vif-deleted:53ab3e71-0b99-4c85-a59d-08a29cd2f220 for instance 8ac83902-c5a9-4382-95d7-664c16270919 on n-h1-828148-1 Mar 29 02:20:42.800199 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-636c195f-b7c7-40db-aae2-31dd97080c20 req-47841ba4-07a4-4da2-8e4a-02f6c9f725ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044645 Mar 29 02:20:42.805221 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1419/2700] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:42.849728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:42.864489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-342a2b31-5006-4dec-b51e-1b04cefe5dd5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.471281 Mar 29 02:20:42.867836 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1282/2701] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:42 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:43.376824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:43.378687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:43.397612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:43.397885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:43.398597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:43.400247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:43.402419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:43.403728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:43.413071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:43.413835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:43.415777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:43.416424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:43.642696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:43.673676 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2e919c4-5455-471b-8f39-8a369d940aac tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1183 microversion: 2.1 time: 0.301264 Mar 29 02:20:43.685171 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1420/2702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:43 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:43.870419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca7cbebc-ab50-46e8-919f-052fcfa5db37 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f87240cf700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1127231849", "description": "tempest-description-1006622521"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:44.081595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:44.095780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09a9d9f6-2ab2-45bc-b76e-bb93f1d422a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.701981 Mar 29 02:20:44.097084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1283/2703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:43 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:44.101709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:44.104958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:44.120114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:44.122758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:44.124227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:44.125113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:44.406868 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca7cbebc-ab50-46e8-919f-052fcfa5db37 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.720494 Mar 29 02:20:44.407457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1421/2704] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:43 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:44.418972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99fa6641-c33c-4663-bf01-25f67d2577f4 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724b09c10>, body: {"security_group_rule": {"parent_group_id": "0ada1fc3-e3d9-470f-8c27-db23e355887a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:44.534321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:44.544273 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9494a6d-6302-4cb7-8e36-f6aad24195dc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.445862 Mar 29 02:20:44.545723 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1284/2705] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:44 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:44.693938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:44.697604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:44.708676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:44.709438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:44.710687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:44.711587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.010622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:45.011412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.012236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lazy-loading 'fault' on Instance uuid 8ac83902-c5a9-4382-95d7-664c16270919 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:45.217757 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99fa6641-c33c-4663-bf01-25f67d2577f4 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.802639 Mar 29 02:20:45.218654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1422/2706] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:20:45.230697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:45.233828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:45.235447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:45.248060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:45.248872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.249113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66b28fa1-a18f-495d-bd87-bdbef9e9cdcc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 200 len: 1188 microversion: 2.1 time: 0.558983 Mar 29 02:20:45.249690 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1285/2707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:44 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 1188 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:45.250778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:45.251543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.253903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b73d7b13-355c-459c-87bc-6ecfe30a4184 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724233310>, body: {"security_group_rule": {"parent_group_id": "0ada1fc3-e3d9-470f-8c27-db23e355887a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:45.314377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b73d7b13-355c-459c-87bc-6ecfe30a4184 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: This rule already exists in group 0ada1fc3-e3d9-470f-8c27-db23e355887a Mar 29 02:20:45.315208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b73d7b13-355c-459c-87bc-6ecfe30a4184 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: This rule already exists in group 0ada1fc3-e3d9-470f-8c27-db23e355887a {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:45.316131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b73d7b13-355c-459c-87bc-6ecfe30a4184 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.065532 Mar 29 02:20:45.316764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1286/2708] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:45 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:45.325798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7226b341-ccf3-4fa9-a968-768ba0da8371 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8724d5cb80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:45.591054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7226b341-ccf3-4fa9-a968-768ba0da8371 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/fb1bd485-2c2a-4499-bf6c-a603a37c9fd0" status: 202 len: 0 microversion: 2.1 time: 0.269869 Mar 29 02:20:45.592281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1287/2709] 10.222.0.36 () {58 vars in 1286 bytes} [Tue Mar 29 02:20:45 2022] DELETE /compute/v2.1/os-security-group-rules/fb1bd485-2c2a-4499-bf6c-a603a37c9fd0 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:20:45.596717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:45.597404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:45.613867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:45.614878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.616253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:45.616967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:45.805414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:45.816197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cf8eec4-5749-4e40-965d-1fb0f84a7917 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.594287 Mar 29 02:20:45.817029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1423/2710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:45 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:45.825518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7995388-7b90-4b54-ab2b-8bfa55350763 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f87240cf940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2097126498", "description": "tempest-description-1940657285"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:45.894221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:45.905227 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8de75fec-18c3-4414-931e-80422d49a9e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.311749 Mar 29 02:20:45.906571 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1288/2711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:45 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:46.266123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:46.267453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8ac83902-c5a9-4382-95d7-664c16270919] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:46.275190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.275826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.276758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.277393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.344141 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] HTTP exception thrown: Instance 8ac83902-c5a9-4382-95d7-664c16270919 could not be found. Mar 29 02:20:46.345259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Returning 404 to user: Instance 8ac83902-c5a9-4382-95d7-664c16270919 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:46.346242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d13e642-51a9-4fe0-94ba-2010a72d223f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919" status: 404 len: 111 microversion: 2.1 time: 0.083805 Mar 29 02:20:46.350272 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1289/2712] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:46 2022] GET /compute/v2.1/servers/8ac83902-c5a9-4382-95d7-664c16270919 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:46.620675 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7995388-7b90-4b54-ab2b-8bfa55350763 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.802430 Mar 29 02:20:46.634315 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1424/2713] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:45 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:46.646586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ca93f4a-0e64-4546-af89-ae20e8ff6108 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724233ca0>, body: {"security_group_rule": {"parent_group_id": "20aaa31e-3b27-4bb0-8f52-8b3169ce37d2", "ip_protocol": "tcp", "from_port": 864223117, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:46.715022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:46.715679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:46.731472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.732241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.733456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.735617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.793648 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1ca93f4a-0e64-4546-af89-ae20e8ff6108 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Invalid port range 864223117:22. Former value cannot be greater than the later Mar 29 02:20:46.794500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ca93f4a-0e64-4546-af89-ae20e8ff6108 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: Invalid port range 864223117:22. Former value cannot be greater than the later {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:46.795525 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ca93f4a-0e64-4546-af89-ae20e8ff6108 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.153436 Mar 29 02:20:46.798621 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1290/2714] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:46 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:46.810902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca29ca10-1146-4038-b623-5ef6cb84fce9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f872405dd30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1678279753", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:46.824679 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-ca29ca10-1146-4038-b623-5ef6cb84fce9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Security group id should be uuid Mar 29 02:20:46.826984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca29ca10-1146-4038-b623-5ef6cb84fce9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: Security group id should be uuid {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:46.828894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca29ca10-1146-4038-b623-5ef6cb84fce9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024515 Mar 29 02:20:46.835547 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1291/2715] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:46 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:20:46.857605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:46.858609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:46.882857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.883314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.884704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:46.885161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:46.948427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4937256f-dbf6-4e72-8362-5cf7a79a070c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/ips" status: 200 len: 149 microversion: 2.1 time: 0.233234 Mar 29 02:20:46.949432 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1425/2716] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:20:46 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/ips => generated 149 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:46.955666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95d89e1c-833f-4d00-9c42-a1f824e9d6cd tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724b09280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-340310319", "description": "tempest-description-1994464519"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:47.298087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:47.314120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12bc7501-35d7-411b-8836-9134f0aa7d81 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.477153 Mar 29 02:20:47.324295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1292/2717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:46 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:47.335629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:47.337966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:47.351744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:47.353488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:47.354410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:47.354967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:47.699331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:47.712332 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-91949ba7-fe07-4b3e-9d9d-1c251e6896c3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.383451 Mar 29 02:20:47.713272 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1293/2718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:47 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:47.730377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4780b6f3-559f-41aa-8307-02b6a5d4aaf3 req-2ce61be0-c368-46e9-a304-ac7903e43f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34179265-2821-4ab0-9f32-3319d2bc9c65", "name": "network-vif-plugged", "status": "completed", "tag": "5acf862c-d793-4450-9029-a9c7f7a328b6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:47.733676 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:47.733676 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:47.768142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4780b6f3-559f-41aa-8307-02b6a5d4aaf3 req-2ce61be0-c368-46e9-a304-ac7903e43f26 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:47.768594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4780b6f3-559f-41aa-8307-02b6a5d4aaf3 req-2ce61be0-c368-46e9-a304-ac7903e43f26 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:47.814883 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4780b6f3-559f-41aa-8307-02b6a5d4aaf3 req-2ce61be0-c368-46e9-a304-ac7903e43f26 service nova] Creating event network-vif-plugged:5acf862c-d793-4450-9029-a9c7f7a328b6 for instance 34179265-2821-4ab0-9f32-3319d2bc9c65 on n-h1-828148-1 Mar 29 02:20:47.821973 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4780b6f3-559f-41aa-8307-02b6a5d4aaf3 req-2ce61be0-c368-46e9-a304-ac7903e43f26 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104125 Mar 29 02:20:47.823065 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1294/2719] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:48.005182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95d89e1c-833f-4d00-9c42-a1f824e9d6cd tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.054480 Mar 29 02:20:48.012995 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1426/2720] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:46 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:48.035602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-362e87bd-2a91-4a35-8df9-188bcaa93f0d tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724d418b0>, body: {"security_group_rule": {"parent_group_id": "fb8f5d7f-6d12-499d-84a9-ca87ec49f434", "ip_protocol": "tempest-999-1332014779", "from_port": 22, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:48.222667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-362e87bd-2a91-4a35-8df9-188bcaa93f0d tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Invalid IP protocol tempest-999-1332014779. Mar 29 02:20:48.223246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-362e87bd-2a91-4a35-8df9-188bcaa93f0d tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: Invalid IP protocol tempest-999-1332014779. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:48.224054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-362e87bd-2a91-4a35-8df9-188bcaa93f0d tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.210295 Mar 29 02:20:48.224786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1295/2721] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:48 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 29 02:20:48.234002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1fed025-c6f2-44e7-8b83-a67be2f8e8c4 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724cf6550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-14761251", "description": "tempest-description-1655077468"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:48.338130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:48.338867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:48.358124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:48.358569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:48.359557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:48.359988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:48.416275 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:20:48.745106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:48.770647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8dc0238a-ce3d-4d01-932c-102586eaa197 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.436722 Mar 29 02:20:48.775747 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1296/2722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:48 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:48.786563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:48.787771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:48.824066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:48.824756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:48.829700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:48.830765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:49.278123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:49.287156 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0ddf5d0-8b02-4a03-ae53-59ca24e4d231 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1533 microversion: 2.1 time: 0.510032 Mar 29 02:20:49.287786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1297/2723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:48 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1533 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:49.427195 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60846. Mar 29 02:20:49.615600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Action: 'create', calling method: .version_select at 0x7f8717f5c940>, body: {"keypair": {"name": "tempest-keypair-896366402"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:49.633992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1fed025-c6f2-44e7-8b83-a67be2f8e8c4 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.396888 Mar 29 02:20:49.633992 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1427/2724] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:48 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:49.639277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75359fa8-2cdc-4bd1-8d39-d70318218022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724b99f70>, body: {"security_group_rule": {"parent_group_id": "c556a67b-1d4a-4421-938d-b85ff7497aea", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:49.653140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for project 31bfe204d0b546f88575e1d38a708577. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:20:49.660000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for user 68a1ad4d3f7646beb994d9195bc58c2e and project 31bfe204d0b546f88575e1d38a708577. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:20:49.798942 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-75359fa8-2cdc-4bd1-8d39-d70318218022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Mar 29 02:20:49.799790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75359fa8-2cdc-4bd1-8d39-d70318218022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:49.801722 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75359fa8-2cdc-4bd1-8d39-d70318218022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.165956 Mar 29 02:20:49.802573 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1428/2725] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:49 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:20:49.808663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:49.814976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:49.832254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:49.832699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:49.833592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:49.834102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:50.251408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:50.273440 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6a45d0f0-3b9e-45a5-b297-698dbf6e7676 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1315 microversion: 2.1 time: 0.461805 Mar 29 02:20:50.274535 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1429/2726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:49 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:50.289338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa563adb-33ce-4425-bc34-de8d502b175c tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724d2cc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2082641992", "description": "tempest-description-672895356"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:50.566713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for project 31bfe204d0b546f88575e1d38a708577. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:20:50.578917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for user 68a1ad4d3f7646beb994d9195bc58c2e and project 31bfe204d0b546f88575e1d38a708577. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:20:50.622523 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2d3ea10-6d39-4dca-bd57-57869f479476 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.070527 Mar 29 02:20:50.629064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1298/2727] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:20:49 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:20:50.629064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:50.629064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:50.646199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:50.646963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:50.647908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:50.648684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:50.918094 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa563adb-33ce-4425-bc34-de8d502b175c tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.632535 Mar 29 02:20:50.918738 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1430/2728] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:20:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:50.927236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:50.929631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:50.941988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:50.942433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:50.944889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:50.945429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:51.047317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:51.145096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:51.155497 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47bd6f62-9237-4439-891e-a126b178f690 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.530992 Mar 29 02:20:51.156260 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1299/2729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:50 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:51.175054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b83c03eb-37f2-4640-93c8-8dbde5746891"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:51.176150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:51.201189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:51.201801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:51.204957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:51.205478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:51.573659 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-873e3e06-0bd2-4572-93b0-4efa99c01e8c tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 204 len: 0 microversion: 2.1 time: 0.652217 Mar 29 02:20:51.575289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1431/2730] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:50 2022] DELETE /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:51.596985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ff958c5-e409-4403-b4fc-a932a329b40f tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724badd30>, body: {"security_group_rule": {"parent_group_id": "fbdb8a96-40ef-41d5-882b-105ba59b307c", "ip_protocol": "tcp", "from_port": 22, "to_port": 204876253}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:51.761765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-6ff958c5-e409-4403-b4fc-a932a329b40f tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Invalid port range 22:204876253. Valid TCP ports should be between 1-65535 Mar 29 02:20:51.762369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ff958c5-e409-4403-b4fc-a932a329b40f tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 400 to user: Invalid port range 22:204876253. Valid TCP ports should be between 1-65535 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:51.763263 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ff958c5-e409-4403-b4fc-a932a329b40f tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.186488 Mar 29 02:20:51.763828 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1432/2731] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:51 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:51.773304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ce2404b1-cbe2-478b-b650-fd6d1a465262 req-717b6341-b918-42fb-a9d3-67d861b0ae8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "name": "network-vif-plugged", "status": "completed", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:51.774970 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:51.774970 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:51.834370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ce2404b1-cbe2-478b-b650-fd6d1a465262 req-717b6341-b918-42fb-a9d3-67d861b0ae8a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:51.834724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ce2404b1-cbe2-478b-b650-fd6d1a465262 req-717b6341-b918-42fb-a9d3-67d861b0ae8a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:51.901659 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ce2404b1-cbe2-478b-b650-fd6d1a465262 req-717b6341-b918-42fb-a9d3-67d861b0ae8a service nova] Creating event network-vif-plugged:5faa6732-f151-4e2d-ae92-94ace19df2b9 for instance 18fccd9e-363a-446e-8b19-eb469eee1129 on n-h2-828148-1 Mar 29 02:20:51.911669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ce2404b1-cbe2-478b-b650-fd6d1a465262 req-717b6341-b918-42fb-a9d3-67d861b0ae8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141899 Mar 29 02:20:51.914469 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1433/2732] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:51.943620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:51.945631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:51.957557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:51.958267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:51.959241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:51.959898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.252804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:52.269950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fee94e9-e3d1-42e9-8fbc-31f37d1a8ca6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1504 microversion: 2.1 time: 0.353655 Mar 29 02:20:52.273710 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1434/2733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:51 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1504 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:52.288274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:52.293618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:52.302352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.302910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.303752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.304246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.433706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-48b65288-11a7-4808-9d4e-38a9b0fba84f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.275222 Mar 29 02:20:52.442413 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1300/2734] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:20:51 2022] POST /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments => generated 194 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:52.455181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Action: 'create', calling method: .version_select at 0x7f8724233dc0>, body: {"security_group_rule": {"parent_group_id": "a4677427-fb54-4752-a835-f638ccf1c031", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:52.543284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a4677427-fb54-4752-a835-f638ccf1c031 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:52.545099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Neutron security group a4677427-fb54-4752-a835-f638ccf1c031 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:20:52.547827 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Security group a4677427-fb54-4752-a835-f638ccf1c031 does not exist Mar 29 02:20:52.547827 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-29f10fb2-00a5-4223-a9d3-b74b79d6c9ac'] Mar 29 02:20:52.550191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 404 to user: Security group a4677427-fb54-4752-a835-f638ccf1c031 does not exist Mar 29 02:20:52.550191 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-29f10fb2-00a5-4223-a9d3-b74b79d6c9ac'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:52.552696 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-555df7d6-f0e5-4a6e-9e5c-5ac4cf370fca tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.108702 Mar 29 02:20:52.553472 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1301/2735] 10.222.0.36 () {60 vars in 1194 bytes} [Tue Mar 29 02:20:52 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:52.563589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:52.568656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:52.600166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.600639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.603253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.603703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.917594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:52.931150 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96073612-452d-4716-97c5-16752d929b9e tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1499 microversion: 2.1 time: 0.652849 Mar 29 02:20:52.931788 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1435/2736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:52 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1499 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:52.939172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-16091297"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:52.943770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:52.963532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.966764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:52.967887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:52.968488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:53.334204 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Adding security group af146865-e7f9-44d2-ade1-fa62a3d02c85 to port 5acf862c-d793-4450-9029-a9c7f7a328b6 Mar 29 02:20:54.049337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:54.061760 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b23bb9f-6e60-4a12-881d-3f0faed8ddca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 1.507350 Mar 29 02:20:54.074219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1302/2737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:52 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:54.081209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8724464ca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:54.169638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d28269a4-78d2-4f9c-b7d7-cd5eab469c37 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:54.171553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Neutron security group rule d28269a4-78d2-4f9c-b7d7-cd5eab469c37 not found {{(pid=103514) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Mar 29 02:20:54.172510 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] HTTP exception thrown: Security group rule d28269a4-78d2-4f9c-b7d7-cd5eab469c37 does not exist Mar 29 02:20:54.172510 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-4f7cd486-d9aa-4c7f-a3dd-934d852f9d7a'] Mar 29 02:20:54.173688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Returning 404 to user: Security group rule d28269a4-78d2-4f9c-b7d7-cd5eab469c37 does not exist Mar 29 02:20:54.173688 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-4f7cd486-d9aa-4c7f-a3dd-934d852f9d7a'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:54.178138 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-33ad4cc0-55bd-4b86-8878-55f09339b8d9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-group-rules/d28269a4-78d2-4f9c-b7d7-cd5eab469c37" status: 404 len: 199 microversion: 2.1 time: 0.099267 Mar 29 02:20:54.178138 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1303/2738] 10.222.0.36 () {58 vars in 1286 bytes} [Tue Mar 29 02:20:54 2022] DELETE /compute/v2.1/os-security-group-rules/d28269a4-78d2-4f9c-b7d7-cd5eab469c37 => generated 199 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:54.181969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:54.182801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:54.208096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:54.208096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:54.212059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:54.212807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:54.334369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17856da8-91ba-486e-b2c6-ccf23bf42e8f tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action" status: 202 len: 0 microversion: 2.1 time: 1.398822 Mar 29 02:20:54.357618 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1436/2739] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:52 2022] POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action => generated 0 bytes in 1424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:54.373861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62665917-feed-4645-8b4e-2db4640a0022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8725ee3790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:55.009188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62665917-feed-4645-8b4e-2db4640a0022 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/fbdb8a96-40ef-41d5-882b-105ba59b307c" status: 202 len: 0 microversion: 2.1 time: 0.649100 Mar 29 02:20:55.015475 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1437/2740] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:54 2022] DELETE /compute/v2.1/os-security-groups/fbdb8a96-40ef-41d5-882b-105ba59b307c => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:55.025308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4abdfdb4-3ee5-4f3a-ba99-f351cc306a53 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724b09310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:55.631594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:55.648355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1035ce9-7520-460f-8bea-6468b5dad971 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1499 microversion: 2.1 time: 1.467964 Mar 29 02:20:55.659064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1304/2741] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:54 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1499 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:55.669282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3b6d12c1-7c7b-4fa6-86a4-14b749436c40 req-8d75f803-9a71-48d3-b7d4-67a9d148b671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34179265-2821-4ab0-9f32-3319d2bc9c65", "tag": "5acf862c-d793-4450-9029-a9c7f7a328b6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:55.674971 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:55.674971 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:20:55.726383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3b6d12c1-7c7b-4fa6-86a4-14b749436c40 req-8d75f803-9a71-48d3-b7d4-67a9d148b671 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:55.729085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3b6d12c1-7c7b-4fa6-86a4-14b749436c40 req-8d75f803-9a71-48d3-b7d4-67a9d148b671 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:55.787271 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3b6d12c1-7c7b-4fa6-86a4-14b749436c40 req-8d75f803-9a71-48d3-b7d4-67a9d148b671 service nova] Creating event network-changed:5acf862c-d793-4450-9029-a9c7f7a328b6 for instance 34179265-2821-4ab0-9f32-3319d2bc9c65 on n-h1-828148-1 Mar 29 02:20:55.799532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3b6d12c1-7c7b-4fa6-86a4-14b749436c40 req-8d75f803-9a71-48d3-b7d4-67a9d148b671 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146746 Mar 29 02:20:55.801117 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1305/2742] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:55.814643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c91c03b0-3845-479c-bea3-ffe8b77ae792 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8717d57310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:56.421046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-4abdfdb4-3ee5-4f3a-ba99-f351cc306a53 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group af146865-e7f9-44d2-ade1-fa62a3d02c85 in use.", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:20:56.427001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4abdfdb4-3ee5-4f3a-ba99-f351cc306a53 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security Group af146865-e7f9-44d2-ade1-fa62a3d02c85 in use. Mar 29 02:20:56.427001 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-d5d112ea-da60-454d-b2bd-e2e5a3712989'] Mar 29 02:20:56.428033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4abdfdb4-3ee5-4f3a-ba99-f351cc306a53 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 400 to user: Security Group af146865-e7f9-44d2-ade1-fa62a3d02c85 in use. Mar 29 02:20:56.428033 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-d5d112ea-da60-454d-b2bd-e2e5a3712989'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:56.429228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4abdfdb4-3ee5-4f3a-ba99-f351cc306a53 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85" status: 400 len: 185 microversion: 2.1 time: 1.412527 Mar 29 02:20:56.437803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1438/2743] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:55 2022] DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85 => generated 185 bytes in 1416 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:20:56.441658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:56.443993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:56.466215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:56.466842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:56.468956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:56.472411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:56.959651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:56.973302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbeebe8f-9345-4cd4-8cf1-e00f38e8e633 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.539520 Mar 29 02:20:56.975567 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1439/2744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:56 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:56.988034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-db9b1dc8-c586-4e4d-983c-6eb614ebb0c7 req-7c73dfd6-e542-4840-b186-e171ab6ff15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7781b7-c582-43ee-9cb7-d94dbca08133", "name": "network-vif-deleted", "tag": "0d3962b5-57c5-452a-8526-28529acaea6c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:56.990147 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:20:56.990147 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:20:57.009383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db9b1dc8-c586-4e4d-983c-6eb614ebb0c7 req-7c73dfd6-e542-4840-b186-e171ab6ff15f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.013588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db9b1dc8-c586-4e4d-983c-6eb614ebb0c7 req-7c73dfd6-e542-4840-b186-e171ab6ff15f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.046167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-db9b1dc8-c586-4e4d-983c-6eb614ebb0c7 req-7c73dfd6-e542-4840-b186-e171ab6ff15f service nova] Creating event network-vif-deleted:0d3962b5-57c5-452a-8526-28529acaea6c for instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 on n-h1-828148-1 Mar 29 02:20:57.052342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-db9b1dc8-c586-4e4d-983c-6eb614ebb0c7 req-7c73dfd6-e542-4840-b186-e171ab6ff15f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072279 Mar 29 02:20:57.053287 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1440/2745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:20:57.059510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:57.061168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:57.069702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.070481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.071616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.072268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.494101 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d9884e7d-880a-4ce4-85c4-09cc4f0b836a tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action" status: 202 len: 0 microversion: 2.1 time: 0.438837 Mar 29 02:20:57.496699 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1441/2746] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:20:57 2022] POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:57.510614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:57.511816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:57.523496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.524336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.525327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.525978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.614179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.614944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.619603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lazy-loading 'fault' on Instance uuid 8b7781b7-c582-43ee-9cb7-d94dbca08133 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:20:57.672665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c91c03b0-3845-479c-bea3-ffe8b77ae792 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/c556a67b-1d4a-4421-938d-b85ff7497aea" status: 202 len: 0 microversion: 2.1 time: 1.861571 Mar 29 02:20:57.672665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1306/2747] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:55 2022] DELETE /compute/v2.1/os-security-groups/c556a67b-1d4a-4421-938d-b85ff7497aea => generated 0 bytes in 1867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:57.677489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:57.684608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:57.705409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.706124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.707197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:57.707703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:57.753376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:57.764877 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d938ce8-acfd-4649-b066-fd697f28e814 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 200 len: 1301 microversion: 2.1 time: 0.266630 Mar 29 02:20:57.766068 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1442/2748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:57 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 1301 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:57.771084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf956328-9420-4b47-8128-1e48d2ccfb7a tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8724295ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.228165 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf956328-9420-4b47-8128-1e48d2ccfb7a tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/fb8f5d7f-6d12-499d-84a9-ca87ec49f434" status: 202 len: 0 microversion: 2.1 time: 0.460700 Mar 29 02:20:58.229173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1443/2749] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:57 2022] DELETE /compute/v2.1/os-security-groups/fb8f5d7f-6d12-499d-84a9-ca87ec49f434 => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:58.234077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.234886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:58.244983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.245429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:58.246391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.246985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:58.504562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:58.516603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce489f41-d3ff-4fd2-9212-122f93c9a5b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.285443 Mar 29 02:20:58.517512 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1444/2750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:58 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:58.522257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5dbef48c-696c-435d-bd5e-fbe916adf5e9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8724c6d280>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.599914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:20:58.613502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31c72d80-d115-45a2-9932-a8743571effb tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1573 microversion: 2.1 time: 0.943449 Mar 29 02:20:58.625287 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1307/2751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:57 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1573 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:20:58.782539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.783879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 8b7781b7-c582-43ee-9cb7-d94dbca08133] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:58.798553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.799241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:58.800183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.800760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:58.879704 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] HTTP exception thrown: Instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 could not be found. Mar 29 02:20:58.884316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Returning 404 to user: Instance 8b7781b7-c582-43ee-9cb7-d94dbca08133 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:20:58.885328 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9c5c099-df95-4f64-b603-fe34727a36ab tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133" status: 404 len: 111 microversion: 2.1 time: 0.106527 Mar 29 02:20:58.886412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1308/2752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:58 2022] GET /compute/v2.1/servers/8b7781b7-c582-43ee-9cb7-d94dbca08133 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:20:58.896578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.904268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:58.918240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5dbef48c-696c-435d-bd5e-fbe916adf5e9 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/20aaa31e-3b27-4bb0-8f52-8b3169ce37d2" status: 202 len: 0 microversion: 2.1 time: 0.399441 Mar 29 02:20:58.918964 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1445/2753] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:58 2022] DELETE /compute/v2.1/os-security-groups/20aaa31e-3b27-4bb0-8f52-8b3169ce37d2 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:58.935702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b34a1d1e-edab-427d-aefb-61dd585b4755 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] Calling method '.version_select at 0x7f8724b09310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:58.969266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.969997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:58.971009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:58.975816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:59.063494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:20:59.368325 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b34a1d1e-edab-427d-aefb-61dd585b4755 tempest-SecurityGroupRulesNegativeTestJSON-98098519 tempest-SecurityGroupRulesNegativeTestJSON-98098519-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/0ada1fc3-e3d9-470f-8c27-db23e355887a" status: 202 len: 0 microversion: 2.1 time: 0.437140 Mar 29 02:20:59.368917 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1446/2754] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:20:58 2022] DELETE /compute/v2.1/os-security-groups/0ada1fc3-e3d9-470f-8c27-db23e355887a => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:20:59.386900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-329934100", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d80c749b-90fb-48aa-bb47-61752bb092da"}], "security_groups": [{"name": "tempest-securitygroup--650876016"}], "key_name": "tempest-keypair-896366402", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:20:59.541741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] validate_networks() for [('d80c749b-90fb-48aa-bb47-61752bb092da', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:20:59.554036 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e174f711-2a6a-4826-a18b-a37c492d2033 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 204 len: 0 microversion: 2.1 time: 0.663241 Mar 29 02:20:59.554638 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1309/2755] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:20:58 2022] DELETE /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:20:59.561697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:20:59.563316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:20:59.607798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:59.608579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:20:59.611655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:20:59.612182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:00.517934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:00.527984 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a007c85e-35a0-4540-8bef-038f5dccbb28 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.972099 Mar 29 02:21:00.537931 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1310/2756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:20:59 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:00.543116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:00.543939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:00.555281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:00.559515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:00.560549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:00.562544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:00.749687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for project 31bfe204d0b546f88575e1d38a708577. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:00.756471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for user 68a1ad4d3f7646beb994d9195bc58c2e and project 31bfe204d0b546f88575e1d38a708577. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:00.785572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:00.785977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:00.786448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:00.786854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:00.787265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:00.796948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:00.797676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:00.798622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:00.799197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:00.824741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for project 31bfe204d0b546f88575e1d38a708577. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:00.831307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Getting quotas for user 68a1ad4d3f7646beb994d9195bc58c2e and project 31bfe204d0b546f88575e1d38a708577. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:00.845947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:00.848650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:01.000286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-757c2253-7105-4c84-8baf-8c3f0c82f709 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.626431 Mar 29 02:21:01.006688 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1447/2757] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:20:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:21:01.011565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:01.012360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:01.020336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:01.020786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:01.021607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:01.022042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:01.303643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:01.315793 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6187202e-86af-4122-a0c8-a7246ee226f2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1578 microversion: 2.1 time: 0.307707 Mar 29 02:21:01.316374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1448/2758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:01 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1578 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:01.339057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df0d4628-fd07-4dce-b330-a1942a924b12 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:01.348397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df0d4628-fd07-4dce-b330-a1942a924b12 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:01.432224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df0d4628-fd07-4dce-b330-a1942a924b12 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:01.450048 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df0d4628-fd07-4dce-b330-a1942a924b12 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1268 microversion: 2.1 time: 0.114937 Mar 29 02:21:01.463521 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1449/2759] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:01 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:01.502301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:01.513192 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7667adcb-6ff7-4d24-bae9-d6487ae29978 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1483 microversion: 2.1 time: 0.973725 Mar 29 02:21:01.514245 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1311/2760] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:00 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1483 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:01.545279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:01.546202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:01.559833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:01.560293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:01.561109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:01.561544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:01.982719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:01.993000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a45f32d4-c294-4767-ad67-e53da25228c7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.447745 Mar 29 02:21:01.996238 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1450/2761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:01 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:02.334768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:02.335407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:02.357931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.362819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.362819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.362819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.478856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5aa1703b-c5b8-434a-b567-6f36cc19c8d1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:02.479426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5aa1703b-c5b8-434a-b567-6f36cc19c8d1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:02.634402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5aa1703b-c5b8-434a-b567-6f36cc19c8d1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:02.652534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5aa1703b-c5b8-434a-b567-6f36cc19c8d1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1268 microversion: 2.1 time: 0.177269 Mar 29 02:21:02.653761 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1451/2762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:02 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:02.660160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:02.661072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:02.670902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.671755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.672723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.682726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.824383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:02.833619 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-95ad9d47-efaa-401d-9d51-f0366aba0ae1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1571 microversion: 2.1 time: 0.503980 Mar 29 02:21:02.845901 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1312/2763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:02 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1571 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:02.852716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-566d424a-f440-464d-ad58-b65563b506a5 req-442e00bd-c558-4a10-9d45-6476e7a08cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f26e84-cb3a-47ab-a37b-faf0c3a2c896", "name": "network-vif-deleted", "tag": "020be6cb-31c2-43ca-bf79-09fffb0c481d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:02.854976 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:02.854976 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:02.865434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:02.866820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-566d424a-f440-464d-ad58-b65563b506a5 req-442e00bd-c558-4a10-9d45-6476e7a08cf2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.867524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-566d424a-f440-464d-ad58-b65563b506a5 req-442e00bd-c558-4a10-9d45-6476e7a08cf2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.875465 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1de8d75b-ff1a-49bb-93eb-91b86c0cf6bc tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1441 microversion: 2.1 time: 0.219857 Mar 29 02:21:02.876167 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1452/2764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:02 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1441 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:02.881818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2040991360"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:02.882849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:02.885065 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-566d424a-f440-464d-ad58-b65563b506a5 req-442e00bd-c558-4a10-9d45-6476e7a08cf2 service nova] Creating event network-vif-deleted:020be6cb-31c2-43ca-bf79-09fffb0c481d for instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 on n-h1-828148-1 Mar 29 02:21:02.890237 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-566d424a-f440-464d-ad58-b65563b506a5 req-442e00bd-c558-4a10-9d45-6476e7a08cf2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042915 Mar 29 02:21:02.890816 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1313/2765] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:02.891962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.892422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:02.893329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:02.893783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.007931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:03.008642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:03.129258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.129258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.129258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.129258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.129940 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Adding security group 99416124-dbdf-4a1e-8aa1-b45abecf97df to port 5acf862c-d793-4450-9029-a9c7f7a328b6 Mar 29 02:21:03.239071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:03.251852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ef7bea54-5f93-445d-8417-16d00797e6a1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.247995 Mar 29 02:21:03.269325 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1314/2766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:03 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:03.378067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: .version_select at 0x7f872405d1f0>, body: {"keypair": {"name": "tempest-keypair-1828834910"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:03.409012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:03.417904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:03.721607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:03.736763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:03.781013 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ffcb218-bf83-4c94-8703-6a4f28b167ff tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.407543 Mar 29 02:21:03.786184 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1315/2767] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:21:03 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:03.787351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:03.788152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:03.812196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.814842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.816491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.817352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.902559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1611aa30-23a3-4e6b-be39-dec98d240bbc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action" status: 202 len: 0 microversion: 2.1 time: 1.024782 Mar 29 02:21:03.904086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1453/2768] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:02 2022] POST /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65/action => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:03.911017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:03.922492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:03.931884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.933362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:03.935798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:03.947681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.011763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:04.022720 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-500e7842-3a8b-4a21-beb9-4e3d9971e2a7 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1264 microversion: 2.1 time: 0.237474 Mar 29 02:21:04.025614 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1316/2769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:03 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:04.038158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-221c90f4-2e48-4d93-a6a4-34bb14ff8a37 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717e559d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:04.105160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.106287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.106759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lazy-loading 'fault' on Instance uuid d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:21:04.258208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:04.271188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8209a665-23e4-4f38-95de-f150d2c32f8a tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 200 len: 1299 microversion: 2.1 time: 0.364475 Mar 29 02:21:04.271772 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1454/2770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:03 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:04.278420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-bd53d721-f69a-4785-a948-e8f89ae0f769 req-c096f228-2fdf-41b4-8cd0-8bfc69ae81a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34179265-2821-4ab0-9f32-3319d2bc9c65", "tag": "5acf862c-d793-4450-9029-a9c7f7a328b6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:04.280335 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:04.280335 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:04.292782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bd53d721-f69a-4785-a948-e8f89ae0f769 req-c096f228-2fdf-41b4-8cd0-8bfc69ae81a4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.293263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bd53d721-f69a-4785-a948-e8f89ae0f769 req-c096f228-2fdf-41b4-8cd0-8bfc69ae81a4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.326795 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-bd53d721-f69a-4785-a948-e8f89ae0f769 req-c096f228-2fdf-41b4-8cd0-8bfc69ae81a4 service nova] Creating event network-changed:5acf862c-d793-4450-9029-a9c7f7a328b6 for instance 34179265-2821-4ab0-9f32-3319d2bc9c65 on n-h1-828148-1 Mar 29 02:21:04.339202 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-bd53d721-f69a-4785-a948-e8f89ae0f769 req-c096f228-2fdf-41b4-8cd0-8bfc69ae81a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064916 Mar 29 02:21:04.357404 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1455/2771] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:04.369277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:04.371819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:04.394671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.395349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.397575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.399592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.479871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-221c90f4-2e48-4d93-a6a4-34bb14ff8a37 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 99416124-dbdf-4a1e-8aa1-b45abecf97df in use.", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:04.481184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-221c90f4-2e48-4d93-a6a4-34bb14ff8a37 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security Group 99416124-dbdf-4a1e-8aa1-b45abecf97df in use. Mar 29 02:21:04.481184 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-b7a58d23-abdd-4502-8230-cb7974e336ee'] Mar 29 02:21:04.482274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-221c90f4-2e48-4d93-a6a4-34bb14ff8a37 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 400 to user: Security Group 99416124-dbdf-4a1e-8aa1-b45abecf97df in use. Mar 29 02:21:04.482274 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-b7a58d23-abdd-4502-8230-cb7974e336ee'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:04.483492 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-221c90f4-2e48-4d93-a6a4-34bb14ff8a37 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df" status: 400 len: 185 microversion: 2.1 time: 0.456937 Mar 29 02:21:04.488335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1317/2772] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:04 2022] DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df => generated 185 bytes in 462 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:21:04.493184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:04.494910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:04.511682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.515255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.530016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:04.530789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:04.651684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:21:04.773038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:04.782836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a6fddaaa-2ac2-4fe6-89ae-2a259767a073 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.423870 Mar 29 02:21:04.784563 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1456/2773] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:04 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:05.043244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:05.044482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:05.062667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.063674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.065216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.066230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.315120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-972ec427-14f5-4b4d-9a76-7cc18eb0b6cc tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 204 len: 0 microversion: 2.1 time: 0.822902 Mar 29 02:21:05.315732 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1318/2774] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:21:04 2022] DELETE /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:21:05.325183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:05.328419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: d0f26e84-cb3a-47ab-a37b-faf0c3a2c896] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:05.345314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.345962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.348376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.348817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.411204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:05.423716 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6ead76c-439d-403f-8f58-8f6dbb0c6467 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1328 microversion: 2.1 time: 0.384984 Mar 29 02:21:05.424372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1457/2775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:05 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1328 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:05.443734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:05.451288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:05.466720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.468076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.469866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.470639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.488563 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] HTTP exception thrown: Instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 could not be found. Mar 29 02:21:05.489204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Returning 404 to user: Instance d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:05.490035 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ea9edfb-5658-4b7c-af4d-666d38693364 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896" status: 404 len: 111 microversion: 2.1 time: 0.170509 Mar 29 02:21:05.490582 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1319/2776] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:05 2022] GET /compute/v2.1/servers/d0f26e84-cb3a-47ab-a37b-faf0c3a2c896 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:05.505322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:05.508674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:05.516673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.517658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.518598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:05.519184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:05.692467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:21:06.178730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:06.179835 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e32e78b9-9f16-43fa-b1a4-d8cbf70dff2d tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "DELETE /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 204 len: 0 microversion: 2.1 time: 0.683754 Mar 29 02:21:06.183849 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1320/2777] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:21:05 2022] DELETE /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:21:06.188313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa76587d-775c-4a10-b797-1f83110f5ba1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1646 microversion: 2.1 time: 0.757588 Mar 29 02:21:06.191927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:06.192870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:06.198498 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1458/2778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:05 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1646 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:06.203698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:06.204089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.204700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:06.205456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:06.207441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.208235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:06.216141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.229462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:06.230488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.231040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:06.736046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:06.740725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:06.749069 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca077e75-be37-4d78-ab96-171bf7c9bff7 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1499 microversion: 2.1 time: 0.549177 Mar 29 02:21:06.749822 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1459/2779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:06 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1499 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:06.756802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:06.758429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:06.777593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a1d1c63-9c47-4950-a2f5-63f5f8a9a2e5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.583622 Mar 29 02:21:06.784389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1321/2780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:06 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:06.793405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.802459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:06.803522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:06.804060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:07.206651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:07.207689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:07.227109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:07.229659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:07.230785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:07.231410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:07.252353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:07.266481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-76420c32-231f-41ca-872d-e682fd399bdd tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1326 microversion: 2.1 time: 0.513015 Mar 29 02:21:07.268358 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1460/2781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:06 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1326 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:07.766442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:07.767083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:07.779790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:07.780511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:07.781663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:07.782317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:08.225778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:08.247998 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f788b282-24a2-481e-8587-0135338a6a42 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1499 microversion: 2.1 time: 0.483824 Mar 29 02:21:08.250430 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1461/2782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:07 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1499 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:08.259451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:08.261081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:08.281529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:08.282370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:08.283361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:08.285971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:08.459990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:08.477724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3682b04c-4c0e-4587-81a5-8374355d8de6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1646 microversion: 2.1 time: 1.276185 Mar 29 02:21:08.478307 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1322/2783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:07 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1646 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:08.482606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:08.483655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:08.516447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:08.519341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:08.519341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:08.519341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:08.884107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:08.892321 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-241c042c-cce0-44b5-ad17-1ef608aea383 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.640649 Mar 29 02:21:08.893201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1462/2784] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:08 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:09.266383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:09.266995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:09.275185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:09.275909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:09.276741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:09.277200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:09.805013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:09.816990 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6533478-2b9b-4303-9b00-bba3ef79d94f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1499 microversion: 2.1 time: 0.554987 Mar 29 02:21:09.818249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1463/2785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:09 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1499 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:09.828106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5d879240-4935-4540-acab-f405ffd8250b req-a1d31f88-cca0-4091-84b8-60fd3d8054d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b146b08d-d840-4086-a4ef-f0bb38b32cec", "tag": "d70e5afb-00e3-4338-97ac-f191b56be8c0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:09.830202 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:09.830202 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:09.851543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5d879240-4935-4540-acab-f405ffd8250b req-a1d31f88-cca0-4091-84b8-60fd3d8054d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:09.855788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5d879240-4935-4540-acab-f405ffd8250b req-a1d31f88-cca0-4091-84b8-60fd3d8054d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:09.888468 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5d879240-4935-4540-acab-f405ffd8250b req-a1d31f88-cca0-4091-84b8-60fd3d8054d1 service nova] Creating event network-changed:d70e5afb-00e3-4338-97ac-f191b56be8c0 for instance b146b08d-d840-4086-a4ef-f0bb38b32cec on n-h2-828148-1 Mar 29 02:21:09.894687 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5d879240-4935-4540-acab-f405ffd8250b req-a1d31f88-cca0-4091-84b8-60fd3d8054d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074970 Mar 29 02:21:09.895936 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1464/2786] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:09.903637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:09.904514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:09.912424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:09.913139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:09.914115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:09.914741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:10.064696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:10.081049 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-83100769-c6ad-4f86-833b-2860649dd476 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1468 microversion: 2.1 time: 0.177687 Mar 29 02:21:10.082102 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1465/2787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:09 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1468 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:10.087326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:10.089989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:10.108424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:10.109178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:10.111935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:10.114499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff3d76e1-e54b-42be-b078-99468b0f12ab tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1393 microversion: 2.1 time: 1.974342 Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1323/2788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:08 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1393 bytes in 1976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fe9f056f-4454-416c-a84e-889157431b0d req-a35bc984-5daf-479f-8a3f-bb993c318994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34179265-2821-4ab0-9f32-3319d2bc9c65", "name": "network-vif-deleted", "tag": "5acf862c-d793-4450-9029-a9c7f7a328b6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fe9f056f-4454-416c-a84e-889157431b0d req-a35bc984-5daf-479f-8a3f-bb993c318994 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:10.481532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fe9f056f-4454-416c-a84e-889157431b0d req-a35bc984-5daf-479f-8a3f-bb993c318994 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:10.498577 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fe9f056f-4454-416c-a84e-889157431b0d req-a35bc984-5daf-479f-8a3f-bb993c318994 service nova] Creating event network-vif-deleted:5acf862c-d793-4450-9029-a9c7f7a328b6 for instance 34179265-2821-4ab0-9f32-3319d2bc9c65 on n-h1-828148-1 Mar 29 02:21:10.505489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fe9f056f-4454-416c-a84e-889157431b0d req-a35bc984-5daf-479f-8a3f-bb993c318994 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049092 Mar 29 02:21:10.506443 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1324/2789] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:10.581242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:10.606192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a04dc22a-c6c0-442d-82c8-5264f7d34c0e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1528 microversion: 2.1 time: 0.522541 Mar 29 02:21:10.608627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1466/2790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:10 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1528 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:10.836168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:10.837313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:10.844891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:10.845456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:10.846247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:10.846693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.099569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:11.103766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:11.110137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.110833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.112573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.113506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.216150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.217376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.218678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lazy-loading 'fault' on Instance uuid 34179265-2821-4ab0-9f32-3319d2bc9c65 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:21:11.289093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:11.298098 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eca002f7-7631-4bac-b7b1-baf606477182 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 200 len: 1305 microversion: 2.1 time: 0.202798 Mar 29 02:21:11.298906 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1467/2791] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:11 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 1305 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:11.308661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '808db28af62c4400b9f28220649f0985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '398f7f38ad214cc9a1b389b1cc6f4dd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:11.324413 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-318aef43-3c74-4b48-a20f-fbcb1d2e1847 tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 200 len: 1296 microversion: 2.1 time: 0.487030 Mar 29 02:21:11.324413 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1325/2792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:10 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 1296 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:11.474555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:11.476231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:11.486520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.486976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.487787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.488215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.626829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:11.629125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:11.647441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.650593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:11.651942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:11.654322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:12.092347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:12.104455 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4d07749-6805-4ee6-8d30-7dab6b740fb0 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1393 microversion: 2.1 time: 0.637048 Mar 29 02:21:12.106955 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1468/2793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:11 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1393 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:12.254002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2048245981", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff676c7f-9045-4fad-b565-a27f45650edb"}], "security_groups": [{"name": "tempest-securitygroup--1795805499"}], "key_name": "tempest-keypair-1828834910", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:12.366236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:12.376547 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96fe294e-1c9a-464f-8fe4-0996be69caf3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1510 microversion: 2.1 time: 0.754246 Mar 29 02:21:12.377780 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1326/2794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:11 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1510 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:12.383582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:12.384563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:12.395299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:12.396491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:12.397526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:12.399221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:12.467765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. Mar 29 02:21:12.469395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:12.470764 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39dc9042-a6db-4fda-aac1-6130d05143a8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 404 len: 111 microversion: 2.1 time: 0.091576 Mar 29 02:21:12.471724 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1327/2795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:12 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:12.478988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:12.479966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] [instance: 69a64121-445b-4fcb-8b77-7db8db344cab] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:12.488130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:12.488870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:12.490018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:12.491043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:12.535406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] validate_networks() for [('ff676c7f-9045-4fad-b565-a27f45650edb', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:21:12.543828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] HTTP exception thrown: Instance 69a64121-445b-4fcb-8b77-7db8db344cab could not be found. Mar 29 02:21:12.544541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] Returning 404 to user: Instance 69a64121-445b-4fcb-8b77-7db8db344cab could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:12.545494 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1ff95d6-1d96-42ab-a3ab-fb43eae2b83f tempest-LiveMigrationTest-197180647 tempest-LiveMigrationTest-197180647-project] 10.222.0.36 "GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab" status: 404 len: 111 microversion: 2.1 time: 0.072564 Mar 29 02:21:12.546887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1328/2796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:12 2022] GET /compute/v2.1/servers/69a64121-445b-4fcb-8b77-7db8db344cab => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:12.551515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bfe398cd-c7c6-460c-a6fc-024aaf8f37f5 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717f5c670>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:13.604455 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bfe398cd-c7c6-460c-a6fc-024aaf8f37f5 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85" status: 202 len: 0 microversion: 2.1 time: 1.056229 Mar 29 02:21:13.608134 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1329/2797] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:12 2022] DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:13.613041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0c6cd3e8-ab27-4547-99cf-c764bd3ab2c7 req-cceeff89-4ec4-40d3-b743-e0e6c5836e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a64121-445b-4fcb-8b77-7db8db344cab", "name": "network-vif-deleted", "tag": "2ff59a99-506e-4a84-9b64-206ecb4e2882"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:13.614845 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:13.614845 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:13.624616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0c6cd3e8-ab27-4547-99cf-c764bd3ab2c7 req-cceeff89-4ec4-40d3-b743-e0e6c5836e64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:13.625303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0c6cd3e8-ab27-4547-99cf-c764bd3ab2c7 req-cceeff89-4ec4-40d3-b743-e0e6c5836e64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:13.641681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0c6cd3e8-ab27-4547-99cf-c764bd3ab2c7 req-cceeff89-4ec4-40d3-b743-e0e6c5836e64 service nova] Creating event network-vif-deleted:2ff59a99-506e-4a84-9b64-206ecb4e2882 for instance 69a64121-445b-4fcb-8b77-7db8db344cab on n-h2-828148-1 Mar 29 02:21:13.646539 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0c6cd3e8-ab27-4547-99cf-c764bd3ab2c7 req-cceeff89-4ec4-40d3-b743-e0e6c5836e64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036889 Mar 29 02:21:13.647740 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1330/2798] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:13.652606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:13.653545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:13.661261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:13.661706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:13.662724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:13.663844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:13.846268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:13.846778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:13.847163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:13.847576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:13.847993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:13.871825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:13.872274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:13.873110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:13.873549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:13.916707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:13.927688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:13.950339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:13.956917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:14.122703 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be8f7b85-8ba5-4796-8c87-fbfde15f1acd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.872542 Mar 29 02:21:14.124476 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1469/2799] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:21:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:21:14.136851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:14.140788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:14.153414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:14.158011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:14.160938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:14.160938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:14.169255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:14.188347 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47908797-edf5-4dce-a474-05ce0220f738 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1393 microversion: 2.1 time: 0.539766 Mar 29 02:21:14.199888 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1331/2800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:13 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1393 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:14.199888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a19f3e6-82c1-47b3-8f2c-eeba5a39b0ee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8725e6c430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:14.690798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:14.703027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ec55d897-f1ee-4c9c-a48d-73078e1ac294 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1510 microversion: 2.1 time: 0.577129 Mar 29 02:21:14.703608 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1470/2801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:14 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:14.719254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e816aa1-5ec7-4abd-ba09-12a77f94697c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:14.721114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e816aa1-5ec7-4abd-ba09-12a77f94697c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:14.822123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e816aa1-5ec7-4abd-ba09-12a77f94697c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:14.832651 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e816aa1-5ec7-4abd-ba09-12a77f94697c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1242 microversion: 2.1 time: 0.125702 Mar 29 02:21:14.833593 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1471/2802] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:14 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:14.917090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a19f3e6-82c1-47b3-8f2c-eeba5a39b0ee tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df" status: 202 len: 0 microversion: 2.1 time: 0.724730 Mar 29 02:21:14.917659 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1332/2803] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:14 2022] DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:14.934982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fd9fd44-0b6f-4ef4-984a-f46f3aef4b02 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'create', calling method: .version_select at 0x7f8724172310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1601840225", "description": "tempest-description-1969389162"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:14.973239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b70993a7-a3b7-4c1a-9c5d-3d8a6c31c742 req-80ac1301-f35e-4456-8b8b-4c964e624f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b146b08d-d840-4086-a4ef-f0bb38b32cec", "name": "network-vif-plugged", "status": "completed", "tag": "d70e5afb-00e3-4338-97ac-f191b56be8c0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:14.974728 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:14.974728 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:14.988920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b70993a7-a3b7-4c1a-9c5d-3d8a6c31c742 req-80ac1301-f35e-4456-8b8b-4c964e624f5a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:14.993009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b70993a7-a3b7-4c1a-9c5d-3d8a6c31c742 req-80ac1301-f35e-4456-8b8b-4c964e624f5a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:15.011479 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b70993a7-a3b7-4c1a-9c5d-3d8a6c31c742 req-80ac1301-f35e-4456-8b8b-4c964e624f5a service nova] Creating event network-vif-plugged:d70e5afb-00e3-4338-97ac-f191b56be8c0 for instance b146b08d-d840-4086-a4ef-f0bb38b32cec on n-h2-828148-1 Mar 29 02:21:15.016950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b70993a7-a3b7-4c1a-9c5d-3d8a6c31c742 req-80ac1301-f35e-4456-8b8b-4c964e624f5a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047197 Mar 29 02:21:15.017541 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1333/2804] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:21:15.208003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:15.208996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:15.217874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:15.223592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:15.223592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:15.223592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:15.666236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:15.675052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a450babe-d46b-41af-9169-8a132281713e tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1393 microversion: 2.1 time: 0.471147 Mar 29 02:21:15.678184 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1334/2805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:15 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1393 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:15.739927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:15.739927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:15.744014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:15.744454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:15.745299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:15.745722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:15.797637 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fd9fd44-0b6f-4ef4-984a-f46f3aef4b02 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.864576 Mar 29 02:21:15.797637 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1472/2806] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:21:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:15.810910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a2217ab-303d-41b7-ab0c-79e4e4f91cc9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Action: 'update', calling method: .version_select at 0x7f8724c435e0>, body: {"security_group": {"name": "tempest-sg-hth-1669635975", "description": "tempest-description-hth-1669815403"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:16.115064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1a2217ab-303d-41b7-ab0c-79e4e4f91cc9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "PUT /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9" status: 200 len: 218 microversion: 2.1 time: 0.312981 Mar 29 02:21:16.116620 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1473/2807] 10.222.0.36 () {60 vars in 1289 bytes} [Tue Mar 29 02:21:15 2022] PUT /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9 => generated 218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:16.125437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:16.136524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:16.140063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.140518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:16.141375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.141802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:16.189376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:16.199961 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be122b11-1265-451e-a843-6038cda13c5b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1513 microversion: 2.1 time: 0.482090 Mar 29 02:21:16.215561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1335/2808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:15 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1513 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:16.221382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3a802a1-9f35-453f-b09a-f8822dd9b4bf tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717f5c3a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:16.295585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:16.309703 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b76e2053-c51a-4c4d-bea9-5350eb2b3152 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1294 microversion: 2.1 time: 0.191827 Mar 29 02:21:16.310666 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1474/2809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:16 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:16.316106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:16.317115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:16.328133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.328967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:16.330084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.330782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:16.388164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3a802a1-9f35-453f-b09a-f8822dd9b4bf tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9" status: 200 len: 218 microversion: 2.1 time: 0.170474 Mar 29 02:21:16.392027 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1336/2810] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:21:16 2022] GET /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9 => generated 218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:16.403039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e5616bd-f837-45f7-8261-5b62c449349d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f87241caf70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:16.646491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:16.654289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-822e22c3-27d6-4bdd-9049-cb6589af5c2d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1453 microversion: 2.1 time: 0.342243 Mar 29 02:21:16.655129 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1475/2811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:16 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1453 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:16.695907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:16.697133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:16.721449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.723256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:16.725474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:16.726044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.072618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:17.083358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25a64f64-6fd9-4777-b360-2e315b61b433 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1393 microversion: 2.1 time: 0.395144 Mar 29 02:21:17.093952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1476/2812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:16 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1393 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:17.099629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:17.100165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.109172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.109610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.110387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.111219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.187742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lazy-loading 'flavor' on Instance uuid 18fccd9e-363a-446e-8b19-eb469eee1129 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:21:17.266181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'shelve' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state shelved_offloaded Mar 29 02:21:17.266797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'shelve' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state shelved_offloaded {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:17.268051 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-97e9ed35-c0d3-4c87-8d91-2d1be3ff2e19 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 155 microversion: 2.1 time: 0.171816 Mar 29 02:21:17.268819 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1477/2813] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:17 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 155 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:21:17.275136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-db0b52b5-88f9-40e1-97d4-1054b94e9c3c req-a5c21965-e4e7-4143-b4e6-ce2325ea6d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "name": "network-vif-unplugged", "status": "completed", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:17.276738 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:17.276738 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:17.285477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db0b52b5-88f9-40e1-97d4-1054b94e9c3c req-a5c21965-e4e7-4143-b4e6-ce2325ea6d8e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.285920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-db0b52b5-88f9-40e1-97d4-1054b94e9c3c req-a5c21965-e4e7-4143-b4e6-ce2325ea6d8e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.328036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.server_external_events [req-db0b52b5-88f9-40e1-97d4-1054b94e9c3c req-a5c21965-e4e7-4143-b4e6-ce2325ea6d8e service nova] Unable to find a host for instance 18fccd9e-363a-446e-8b19-eb469eee1129. Dropping event network-vif-unplugged {{(pid=103513) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Mar 29 02:21:17.329013 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-db0b52b5-88f9-40e1-97d4-1054b94e9c3c req-a5c21965-e4e7-4143-b4e6-ce2325ea6d8e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059057 Mar 29 02:21:17.339893 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1478/2814] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 29 02:21:17.343311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:17.343893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.364484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.366978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.366978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.366978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.557464 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e5616bd-f837-45f7-8261-5b62c449349d tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9" status: 202 len: 0 microversion: 2.1 time: 1.159724 Mar 29 02:21:17.558260 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1337/2815] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:16 2022] DELETE /compute/v2.1/os-security-groups/5c42ca93-38fa-4adf-8fd9-07f9917270d9 => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:17.563123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:17.564386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.573666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.574108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.575321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.575939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.726902 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ab5695f-08d3-48ab-814f-4707eea97c7e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.392019 Mar 29 02:21:17.730712 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1479/2816] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:17 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:17.732735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:17.733331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.741785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.742210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.743068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:17.743900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.744533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.757838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ecfe08ff-9e25-4747-a2d2-f86db79bcc21 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1300 microversion: 2.1 time: 0.197898 Mar 29 02:21:17.767780 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1338/2817] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:17 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1300 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:17.772132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:17.772783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.785926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.785926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.785926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.785926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.812211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. Mar 29 02:21:17.812875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:17.814400 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf1f1350-3a7d-45c0-8c6b-4057b90ba0e8 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 404 len: 111 microversion: 2.1 time: 0.085440 Mar 29 02:21:17.815260 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1480/2818] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:21:17 2022] DELETE /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:17.826961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:17.826961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 34179265-2821-4ab0-9f32-3319d2bc9c65] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:17.833910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.834258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.835182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:17.835683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:17.891215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. Mar 29 02:21:17.891823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Instance 34179265-2821-4ab0-9f32-3319d2bc9c65 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:17.892655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e6d5ecfe-32b1-4452-92f2-9786cdcaab5c tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65" status: 404 len: 111 microversion: 2.1 time: 0.070919 Mar 29 02:21:17.895043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1481/2819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:17 2022] GET /compute/v2.1/servers/34179265-2821-4ab0-9f32-3319d2bc9c65 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:17.901431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724c6daf0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:17.943518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 99416124-dbdf-4a1e-8aa1-b45abecf97df does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:17.944127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 99416124-dbdf-4a1e-8aa1-b45abecf97df not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:17.944770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 99416124-dbdf-4a1e-8aa1-b45abecf97df does not exist Mar 29 02:21:17.944770 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-7a631dbc-e8ae-4e56-b0b8-76fd5982ec90'] Mar 29 02:21:17.945477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 99416124-dbdf-4a1e-8aa1-b45abecf97df does not exist Mar 29 02:21:17.945477 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-7a631dbc-e8ae-4e56-b0b8-76fd5982ec90'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:17.946400 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07c22c1d-12bb-4954-8ddb-fbb24fdc69c1 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df" status: 404 len: 194 microversion: 2.1 time: 0.048983 Mar 29 02:21:17.947032 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1482/2820] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:17 2022] DELETE /compute/v2.1/os-security-groups/99416124-dbdf-4a1e-8aa1-b45abecf97df => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:21:17.956165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724172dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.035883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group af146865-e7f9-44d2-ade1-fa62a3d02c85 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:18.036795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group af146865-e7f9-44d2-ade1-fa62a3d02c85 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:18.037429 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group af146865-e7f9-44d2-ade1-fa62a3d02c85 does not exist Mar 29 02:21:18.037429 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1a782e74-420f-40a9-bf26-a3f7fed1a7a6'] Mar 29 02:21:18.038742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group af146865-e7f9-44d2-ade1-fa62a3d02c85 does not exist Mar 29 02:21:18.038742 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-1a782e74-420f-40a9-bf26-a3f7fed1a7a6'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:18.039672 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ac71a5a-61ff-496d-afea-f358be97a6b0 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85" status: 404 len: 194 microversion: 2.1 time: 0.088377 Mar 29 02:21:18.040336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1483/2821] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:17 2022] DELETE /compute/v2.1/os-security-groups/af146865-e7f9-44d2-ade1-fa62a3d02c85 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:21:18.049324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724172670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.077865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:18.079329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:18.079329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist Mar 29 02:21:18.079329 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-e6ff37d0-43cf-42f6-bb9c-88a01a29f75b'] Mar 29 02:21:18.079649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 does not exist Mar 29 02:21:18.079649 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-e6ff37d0-43cf-42f6-bb9c-88a01a29f75b'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:18.080758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9858efe0-281c-447e-af2d-c2e855195045 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6" status: 404 len: 194 microversion: 2.1 time: 0.035683 Mar 29 02:21:18.081341 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1484/2822] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:18 2022] DELETE /compute/v2.1/os-security-groups/4f4d3ae0-3f29-402d-ad19-6ea818afc4f6 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:18.091657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724c6d940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.139351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG neutronclient.v2_0.client [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist", "detail": ""}} {{(pid=103513) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:18.139957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.security_group_api [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 not found {{(pid=103513) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:18.140478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist Mar 29 02:21:18.140478 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-b07b7394-bfde-4962-8b40-42624538c775'] Mar 29 02:21:18.141136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 16f089ff-3112-4e4d-b2b8-0835b4f1ba96 does not exist Mar 29 02:21:18.141136 n-d-828148-1 devstack@n-api.service[103513]: Neutron server returns request_ids: ['req-b07b7394-bfde-4962-8b40-42624538c775'] {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:18.141954 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f832ac4-9383-4712-a2c4-1bda063e29be tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96" status: 404 len: 194 microversion: 2.1 time: 0.054934 Mar 29 02:21:18.142499 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1485/2823] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:18 2022] DELETE /compute/v2.1/os-security-groups/16f089ff-3112-4e4d-b2b8-0835b4f1ba96 => generated 194 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:18.150308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.151182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:18.172605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.173085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.173938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.174429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.297984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:18.307069 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c22c6b69-69f2-4abf-8a7f-91c60ec7046f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1461 microversion: 2.1 time: 0.545248 Mar 29 02:21:18.307629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1339/2824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:17 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1461 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:18.315804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717e55790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.452041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:18.452639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 56897519-f511-40f7-8a78-6bdcf49f9384 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:18.453191 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist Mar 29 02:21:18.453191 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-4d971166-ef24-471a-beec-a7cb4077de26'] Mar 29 02:21:18.453777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 56897519-f511-40f7-8a78-6bdcf49f9384 does not exist Mar 29 02:21:18.453777 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-4d971166-ef24-471a-beec-a7cb4077de26'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:18.454588 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f0a03b8-622b-407c-9a0b-25697056d944 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384" status: 404 len: 194 microversion: 2.1 time: 0.142698 Mar 29 02:21:18.455131 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1340/2825] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:18 2022] DELETE /compute/v2.1/os-security-groups/56897519-f511-40f7-8a78-6bdcf49f9384 => generated 194 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:18.464588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8717f5c5e0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.478035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:18.486717 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3c5482f-9350-4382-a99c-d87d9db44b44 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1574 microversion: 2.1 time: 0.342997 Mar 29 02:21:18.487301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1486/2826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:18 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1574 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:18.504744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.505340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:18.520959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.520959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.520959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.520959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.678147 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e07a79b2-2dc0-47d5-a015-ab3e2ada99b4 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177647 Mar 29 02:21:18.679997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1487/2827] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:21:18 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec/os-interface => generated 285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:21:18.755401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG neutronclient.v2_0.client [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist", "detail": ""}} {{(pid=103514) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:258}} Mar 29 02:21:18.758341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.security_group_api [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Neutron security group 86b98b1f-80d9-4898-97f9-93958d46c417 not found {{(pid=103514) get /opt/stack/nova/nova/network/security_group_api.py:313}} Mar 29 02:21:18.759344 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist Mar 29 02:21:18.759344 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-7c2d85d4-9661-4f76-aca8-7362b1778439'] Mar 29 02:21:18.762106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Security group 86b98b1f-80d9-4898-97f9-93958d46c417 does not exist Mar 29 02:21:18.762106 n-d-828148-1 devstack@n-api.service[103514]: Neutron server returns request_ids: ['req-7c2d85d4-9661-4f76-aca8-7362b1778439'] {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:18.763942 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4ae63229-b1b8-4bc2-8bd9-833ec9ac46d9 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417" status: 404 len: 194 microversion: 2.1 time: 0.302428 Mar 29 02:21:18.765186 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1341/2828] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:18 2022] DELETE /compute/v2.1/os-security-groups/86b98b1f-80d9-4898-97f9-93958d46c417 => generated 194 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:21:18.772805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.773320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:18.780037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:18.781527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:18.789547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.789999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.793423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.796255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.810330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.811626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.812582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:18.813214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:18.937818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:21:19.139173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:19.145494 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b92c619-307d-4e94-9531-ef1b4213dc2b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1300 microversion: 2.1 time: 0.368994 Mar 29 02:21:19.145972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1342/2829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:18 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1300 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:19.326114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:19.326731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:19.340078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:19.340078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:19.340078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:19.340078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:19.475373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c19ecc8-8ade-48c1-b113-1cd271904655 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 204 len: 0 microversion: 2.1 time: 0.703724 Mar 29 02:21:19.475373 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1488/2830] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:21:18 2022] DELETE /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:21:19.489293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:19.490012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:19.504622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:19.504622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:19.504622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:19.504622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:20.684526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:20.698315 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1ac84d0-6687-4272-a856-b97748326fe1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1461 microversion: 2.1 time: 1.376299 Mar 29 02:21:20.700046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1343/2831] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:19 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1461 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:20.718257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:20.722847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:20.739857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:20.740308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:20.741640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:20.742070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:20.890129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:20.901815 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-535077ca-bdd8-4610-9942-23d11a9507ea tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1645 microversion: 2.1 time: 1.422092 Mar 29 02:21:20.912427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1489/2832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:19 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1645 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:21.469941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:21.469941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:21.486281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:21.488819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:21.493970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:21.496336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:21.739467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:21.751533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17aae0a8-6cb6-42d0-b96a-f6218ea9a38c tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1574 microversion: 2.1 time: 0.292030 Mar 29 02:21:21.753346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1490/2833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:21 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:21.760524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b48f4606-d533-4c8e-a12d-6227ba98552d req-b9f54959-6046-47fd-8aa1-03ef6b97369a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b146b08d-d840-4086-a4ef-f0bb38b32cec", "tag": "d70e5afb-00e3-4338-97ac-f191b56be8c0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:21.783016 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:21.783016 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:21.785142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:21.794917 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-89886563-5aed-4a77-9d39-5e0d3c0674fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 1.090663 Mar 29 02:21:21.796259 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1344/2834] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:20 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:21.820103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b48f4606-d533-4c8e-a12d-6227ba98552d req-b9f54959-6046-47fd-8aa1-03ef6b97369a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:21.820543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b48f4606-d533-4c8e-a12d-6227ba98552d req-b9f54959-6046-47fd-8aa1-03ef6b97369a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:21.856945 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b48f4606-d533-4c8e-a12d-6227ba98552d req-b9f54959-6046-47fd-8aa1-03ef6b97369a service nova] Creating event network-changed:d70e5afb-00e3-4338-97ac-f191b56be8c0 for instance b146b08d-d840-4086-a4ef-f0bb38b32cec on n-h2-828148-1 Mar 29 02:21:21.862345 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b48f4606-d533-4c8e-a12d-6227ba98552d req-b9f54959-6046-47fd-8aa1-03ef6b97369a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107211 Mar 29 02:21:21.863458 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1491/2835] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:21.881336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:21.882149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:21.891130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:21.892279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:21.893714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:21.899150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:22.050526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-370199706", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:22.176698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:21:22.517872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:22.534978 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c26acf0f-0e81-4640-93bc-77c4405c98ad tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.669286 Mar 29 02:21:22.544565 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1492/2836] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:21 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:22.559602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:22.565535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:22.576541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:22.577257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:22.578200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:22.578632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:22.997694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:23.009378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8cc586d8-8fc0-46ba-87f6-6ebce92374c6 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1645 microversion: 2.1 time: 0.459663 Mar 29 02:21:23.021293 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1493/2837] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:22 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1645 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:23.027217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:23.027992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:23.039175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.039737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.040684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.043264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.372227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:23.382091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95ef48a0-37da-4676-b546-3dff0799a8ef tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.358734 Mar 29 02:21:23.383457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1494/2838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:23 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:23.513648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:23.514260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:23.527570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.527884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.528699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.529950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.590025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:23.590025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:23.591341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:23.591824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:23.592395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:23.601451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.601809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.602603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.603030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.632974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:23.641256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:23.658376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:23.661936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:23.804777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:23.813606 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12a159cc-9a7e-46f6-bab1-0ff810769109 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.303562 Mar 29 02:21:23.814195 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1495/2839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:23 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:23.818862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:23.820161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:23.831181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.831181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.831949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.832383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.908020 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9fac108-cb00-4d9c-8d19-7bee79b6769b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.110439 Mar 29 02:21:23.919219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1345/2840] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:21:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:21:23.921067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:23.921997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:23.932120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.932676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:23.933585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:23.934122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.064156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:24.073564 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-406aebbd-16d6-4bac-8f23-e1c31c28f32a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.257809 Mar 29 02:21:24.073663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1496/2841] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:23 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:24.084692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44bf348d-9650-4780-8fe8-27f77e919504 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:24.085421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44bf348d-9650-4780-8fe8-27f77e919504 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:24.161804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44bf348d-9650-4780-8fe8-27f77e919504 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:24.170349 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44bf348d-9650-4780-8fe8-27f77e919504 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1216 microversion: 2.1 time: 0.089261 Mar 29 02:21:24.171254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1497/2842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:24 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:24.186383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:24.186383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:24.192898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.193431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.194230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.194657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.422214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:24.430532 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8694ed49-834f-4228-a874-94bf6e9090d2 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1645 microversion: 2.1 time: 0.258112 Mar 29 02:21:24.431095 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1498/2843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:24 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1645 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:24.435520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-281d91c3-0ba7-46a6-89b9-0b0c0cc273eb req-5081ed61-803c-4520-bbec-07615d257470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "name": "network-vif-unplugged", "status": "completed", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:24.445484 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:24.445484 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:24.447819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-281d91c3-0ba7-46a6-89b9-0b0c0cc273eb req-5081ed61-803c-4520-bbec-07615d257470 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.448012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-281d91c3-0ba7-46a6-89b9-0b0c0cc273eb req-5081ed61-803c-4520-bbec-07615d257470 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.468415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-281d91c3-0ba7-46a6-89b9-0b0c0cc273eb req-5081ed61-803c-4520-bbec-07615d257470 service nova] Creating event network-vif-unplugged:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:21:24.471274 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-281d91c3-0ba7-46a6-89b9-0b0c0cc273eb req-5081ed61-803c-4520-bbec-07615d257470 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039036 Mar 29 02:21:24.472201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1499/2844] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:24.477318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:24.478222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:24.492672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.492672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.492672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.492672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.728253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:24.736020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b29ffbfb-fc52-4e63-9825-0ceb614cb4f8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.262392 Mar 29 02:21:24.736532 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1500/2845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:24 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:24.853837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-34a2e500-2d6d-402b-be7f-69b6e9227648 req-7b07c38b-290f-4ed6-8e6f-9eeec6893c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3eebc6-e934-4947-9eec-edd26d59cb81", "tag": "3a1e5442-44cf-4860-9688-fdc391fe8d90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:24.855860 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:24.855860 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:24.864985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:24.871403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-34a2e500-2d6d-402b-be7f-69b6e9227648 req-7b07c38b-290f-4ed6-8e6f-9eeec6893c3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.872233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-34a2e500-2d6d-402b-be7f-69b6e9227648 req-7b07c38b-290f-4ed6-8e6f-9eeec6893c3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.878000 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1db3bf12-ea5f-4516-9ccd-ae909d78ecf6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.961406 Mar 29 02:21:24.878487 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1346/2846] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:23 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:24.897830 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-34a2e500-2d6d-402b-be7f-69b6e9227648 req-7b07c38b-290f-4ed6-8e6f-9eeec6893c3f service nova] Creating event network-changed:3a1e5442-44cf-4860-9688-fdc391fe8d90 for instance ed3eebc6-e934-4947-9eec-edd26d59cb81 on n-h1-828148-1 Mar 29 02:21:24.899061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:24.900204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:24.903195 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-34a2e500-2d6d-402b-be7f-69b6e9227648 req-7b07c38b-290f-4ed6-8e6f-9eeec6893c3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053885 Mar 29 02:21:24.904406 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1501/2847] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:24.918217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.918799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:24.919685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:24.920186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.090938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:25.093408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:25.103938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.104394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.105202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.105635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.392918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:25.405525 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93aaf179-3cd1-4039-a051-c132a85b6795 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.318718 Mar 29 02:21:25.415818 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1502/2848] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:25 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:25.419761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:25.420671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:25.443578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.443578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.443841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.444265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.668061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:25.681656 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e260e6af-eb5a-44b3-afe0-fe39b4912de5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1220 microversion: 2.1 time: 0.266724 Mar 29 02:21:25.682486 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1503/2849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:25 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1220 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:25.687502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:25.688356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:25.697468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.703190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.703190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:25.703190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:25.930781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:25.942516 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a83c30ca-afab-495c-83e9-54ea246d6c0d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 1.049515 Mar 29 02:21:25.964242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1347/2850] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:25.971567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:25.977620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:26.017147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:26.017147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:26.017147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:26.017147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:26.313398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:26.340329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae0d635a-7139-419e-ba4b-6fc4dfaae36b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1645 microversion: 2.1 time: 0.648572 Mar 29 02:21:26.341302 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1504/2851] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:25 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1645 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:26.355765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:26.361960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:26.387155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:26.399825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:26.399825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:26.399825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.203077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:27.221971 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58f9e58d-f34d-40c3-9f34-6872d644f888 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.876623 Mar 29 02:21:27.237428 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1505/2852] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:27.257962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:27.262139 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e723efb-0ad2-4c4c-b308-e9aa2dd44d3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 1.296470 Mar 29 02:21:27.262838 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1348/2853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:25 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:27.269147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:27.269767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:27.304056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:27.304056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:27.304344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.304344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.304344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.304344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.309929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.313377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.314698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.316170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.789335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:27.809091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0442d982-a63a-4d7a-ab63-e22355827822 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1276 microversion: 2.1 time: 0.540621 Mar 29 02:21:27.811702 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1349/2854] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:27 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1276 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:27.837292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:27.837928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:27.863383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.868367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:27.869454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:27.876270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:28.277094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:28.306346 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-daeb6581-20ea-4f53-9dab-58b629e7c6ca tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 1.040849 Mar 29 02:21:28.308765 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1506/2855] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:27 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:28.323825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1970190888", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9222f6f3-d189-4e16-8c8f-3078bec78258"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:28.474301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] validate_networks() for [('9222f6f3-d189-4e16-8c8f-3078bec78258', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:21:28.493623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c8cbb3524b44628dcb9c78f8a06fe4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a643d48830408fb8ab75ad5d8040a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:28.509280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-367e8785-6d74-4eef-bb9c-554d81edbd3b tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 200 len: 1467 microversion: 2.1 time: 0.696690 Mar 29 02:21:28.511055 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1350/2856] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:27 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 1467 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:28.517694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-432af964-1201-434e-9dac-69551bbe5aee req-25ea836f-3af6-4b51-bf94-407231bea5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "476ceec3-a352-49c9-9b22-b3e8ef2d4d2d", "name": "network-vif-deleted", "tag": "5ec929a7-370a-4ea9-999b-149a72d340f1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:28.523751 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:28.523751 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:28.543007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-432af964-1201-434e-9dac-69551bbe5aee req-25ea836f-3af6-4b51-bf94-407231bea5de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:28.543697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-432af964-1201-434e-9dac-69551bbe5aee req-25ea836f-3af6-4b51-bf94-407231bea5de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:28.570968 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-432af964-1201-434e-9dac-69551bbe5aee req-25ea836f-3af6-4b51-bf94-407231bea5de service nova] Creating event network-vif-deleted:5ec929a7-370a-4ea9-999b-149a72d340f1 for instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d on n-h1-828148-1 Mar 29 02:21:28.581633 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-432af964-1201-434e-9dac-69551bbe5aee req-25ea836f-3af6-4b51-bf94-407231bea5de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063987 Mar 29 02:21:28.583268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1351/2857] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:28.607899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:28.608649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:28.633217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:28.633672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:28.634471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:28.634909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:29.691909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:29.707113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1ab47f9-060e-438b-8661-e1876e653c33 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 1.118979 Mar 29 02:21:29.716727 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1352/2858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:28 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:29.721944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:29.735503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:29.769977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:29.770676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:29.771492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:29.772469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:29.918357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:29.918903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:29.919962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:29.919962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:29.920668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:29.941851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:29.942594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:29.945906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:29.948327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.023448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:30.033964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:30.058291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:30.062386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:30.246671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee71fe70-d22f-42e0-8a7a-2c4f4ba1fe9d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.936454 Mar 29 02:21:30.248449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1507/2859] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:21:30.281802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:30.283305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:30.301511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.316359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.318275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.319666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.417543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:30.433469 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41c6312c-8a93-491e-add7-2954bf8065c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1274 microversion: 2.1 time: 0.715071 Mar 29 02:21:30.438259 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1353/2860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:29 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1274 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:30.443102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:30.444261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] [instance: 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:30.487894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.489366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.493025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.493654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.618188 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] HTTP exception thrown: Instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d could not be found. Mar 29 02:21:30.620984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Returning 404 to user: Instance 476ceec3-a352-49c9-9b22-b3e8ef2d4d2d could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:30.622015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b3fb8e8-53fd-4d6c-af90-09a37df4d30e tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d" status: 404 len: 111 microversion: 2.1 time: 0.182772 Mar 29 02:21:30.635492 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1354/2861] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:30 2022] GET /compute/v2.1/servers/476ceec3-a352-49c9-9b22-b3e8ef2d4d2d => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:30.647179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59c61d9c-cadd-4610-9828-e65ded2c6150 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:30.647179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59c61d9c-cadd-4610-9828-e65ded2c6150 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:30.894252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:30.920035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b67a7035-7446-42be-865e-ffef2aa56ea2 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.668936 Mar 29 02:21:30.921174 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1508/2862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:30.936788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59c61d9c-cadd-4610-9828-e65ded2c6150 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:30.938548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-136258bf-08d4-474c-893c-26048552b333 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724c43550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:30.944423 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59c61d9c-cadd-4610-9828-e65ded2c6150 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1215 microversion: 2.1 time: 0.303967 Mar 29 02:21:30.945010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1355/2863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:30 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:30.953557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:30.954171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:30.978097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.978649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:30.979526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:30.980288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:31.642513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:31.661786 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f469f5fd-43f9-4e74-8a74-e0ad4ad1082d tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.715653 Mar 29 02:21:31.666929 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1356/2864] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:30 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:31.685108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:31.688911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:31.706910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:31.706910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:31.706910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:31.706910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:31.738271 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-136258bf-08d4-474c-893c-26048552b333 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/974eb039-d8b5-414b-91b3-9899861570b4" status: 202 len: 0 microversion: 2.1 time: 0.806342 Mar 29 02:21:31.739592 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1509/2865] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:30 2022] DELETE /compute/v2.1/os-security-groups/974eb039-d8b5-414b-91b3-9899861570b4 => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:31.748028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-afcc9768-25d2-4a15-9a8e-1116cdb190a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] Calling method '.version_select at 0x7f8724bad310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:32.187563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:32.203127 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4b6c1c3-dd8e-48ff-9a10-e1f19879f6c5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1274 microversion: 2.1 time: 0.534870 Mar 29 02:21:32.207561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1357/2866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:31 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1274 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:32.230704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:32.237905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:32.270029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:32.270422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:32.271374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:32.276706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:32.708231 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-afcc9768-25d2-4a15-9a8e-1116cdb190a7 tempest-SecurityGroupsTestJSON-1185627366 tempest-SecurityGroupsTestJSON-1185627366-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/d1ffca13-597d-4b93-8f0b-ce5a91a6c636" status: 202 len: 0 microversion: 2.1 time: 0.964628 Mar 29 02:21:32.709760 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1510/2867] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:21:31 2022] DELETE /compute/v2.1/os-security-groups/d1ffca13-597d-4b93-8f0b-ce5a91a6c636 => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:21:32.738493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:32.738493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:32.756479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:32.756951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:32.761929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:32.762383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:33.156557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:33.171481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9eab49dc-3124-4ba1-bc6b-63d5f5b15672 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1267 microversion: 2.1 time: 0.457251 Mar 29 02:21:33.181367 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1511/2868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:32 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:33.189865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:33.193043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:33.218418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:33.219235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:33.220179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:33.220767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:33.872439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:33.886587 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4ca50471-f2f1-466c-9ec7-d92750d970ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 1.675293 Mar 29 02:21:33.886587 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1358/2869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:32 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:33.891733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:33.895761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:33.898997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:33.906252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ac3caef-28db-4ee1-b263-6478a6fc7bc5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.723188 Mar 29 02:21:33.918813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:33.918931 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1512/2870] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:33 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:33.920195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:33.921568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:33.922064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:34.131910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:34.141864 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f1f18d3-14bc-431c-b4ae-dc693dae24ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1274 microversion: 2.1 time: 0.253109 Mar 29 02:21:34.144268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1359/2871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:33 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:34.189308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:34.190034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:34.212434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:34.212434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:34.212434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:34.217144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:34.518947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:34.532615 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-742cf54e-f1bc-4669-9d6f-17b31f5ac900 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1273 microversion: 2.1 time: 0.347171 Mar 29 02:21:34.533427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1513/2872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:34 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:34.574038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1435711142", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "74e4b624-f54e-4eff-84f4-02fdb2947b8b"}, {"uuid": "8144f73c-e8fb-488a-90f3-eb2886922864"}, {"uuid": "74e4b624-f54e-4eff-84f4-02fdb2947b8b"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:34.690405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] validate_networks() for [('74e4b624-f54e-4eff-84f4-02fdb2947b8b', None, None, None), ('8144f73c-e8fb-488a-90f3-eb2886922864', None, None, None), ('74e4b624-f54e-4eff-84f4-02fdb2947b8b', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:34.930816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:35.406202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:35.421030 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-934a93d1-47af-4732-b216-bbc781985b2f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.519421 Mar 29 02:21:35.434567 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1514/2873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:34 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:35.439801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:35.441162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:35.450896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:35.451609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:35.452564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:35.453722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:35.723887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:35.752336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-52df1c7b-a12c-4072-97b9-d118f2833ed3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.303915 Mar 29 02:21:35.757465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1515/2874] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:35 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:35.773152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:35.774638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:35.800694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:35.803092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:35.805855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:35.805855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.144212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:36.159782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6fa5fa79-630b-4864-9fb7-b814685ff30b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.398806 Mar 29 02:21:36.161077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1516/2875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:35 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:36.174477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:36.175546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:36.184445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.185233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.186293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.186956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.394035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:36.408645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-143277da-e300-465d-8cec-72cf002bbbe2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1273 microversion: 2.1 time: 0.246089 Mar 29 02:21:36.409275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1517/2876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:36 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1273 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:36.439730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:36.442678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:36.472120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.473896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.477154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.478782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.909757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:36.920247 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2a72234-fcf1-44ca-b60f-1a82fdd9f7b9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.486279 Mar 29 02:21:36.920810 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1518/2877] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:36 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:36.925540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:36.927557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:36.935517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.936112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:36.937147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:36.937572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1107a423-641e-46a8-808b-43f5ea068b89 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.247072 Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1519/2878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:36 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-95383eed-8ea8-4b89-b7dd-95ffacf0fe03 req-13c0ef57-054e-4410-b0f9-173fca25fb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3eebc6-e934-4947-9eec-edd26d59cb81", "name": "network-vif-plugged", "status": "completed", "tag": "3a1e5442-44cf-4860-9688-fdc391fe8d90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-95383eed-8ea8-4b89-b7dd-95ffacf0fe03 req-13c0ef57-054e-4410-b0f9-173fca25fb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-95383eed-8ea8-4b89-b7dd-95ffacf0fe03 req-13c0ef57-054e-4410-b0f9-173fca25fb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-95383eed-8ea8-4b89-b7dd-95ffacf0fe03 req-13c0ef57-054e-4410-b0f9-173fca25fb04 service nova] Creating event network-vif-plugged:3a1e5442-44cf-4860-9688-fdc391fe8d90 for instance ed3eebc6-e934-4947-9eec-edd26d59cb81 on n-h1-828148-1 Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-95383eed-8ea8-4b89-b7dd-95ffacf0fe03 req-13c0ef57-054e-4410-b0f9-173fca25fb04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1520/2879] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:37.272617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:37.274742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:37.274742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:37.485088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31db6a9b-ca6b-47cb-9a0b-ba7f9230b37f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.280070 Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1521/2880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:37 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:37.588050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3cdd9c53-8e83-461b-9349-a5a1a7265034 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.488657 Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1522/2881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:37 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.024612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.396038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:38.411331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf1026a3-7709-4579-9316-65a350a057b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.420914 Mar 29 02:21:38.420664 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1523/2882] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:37 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:38.427214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:38.428226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:38.440240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.441066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.442067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.442676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.825189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:38.841841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88630125-577d-4130-a86b-d579edaf2269 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1368 microversion: 2.1 time: 0.417828 Mar 29 02:21:38.845716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1524/2883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:38 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:38.874975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:38.874975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:38.896257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.897524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:38.898579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:38.899176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:39.442097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:39.453894 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2258ed4b-2af2-442f-b6d2-16e77089b04b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.606662 Mar 29 02:21:39.465705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1525/2884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:38 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:39.478262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:39.479067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:39.488350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:39.489238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:39.490808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:39.491393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.000898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:40.014805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d512963e-6f7f-435e-8a7d-8fedce4fa878 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.550477 Mar 29 02:21:40.030512 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1526/2885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:39 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:40.047985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:40.048618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:40.060467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.060950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.062130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.062869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.371605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:40.387493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-64d59249-3c77-4fec-a4e1-c1cd2826927c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.355723 Mar 29 02:21:40.388432 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1527/2886] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:40 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:40.399262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:40.399460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:40.407692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.408143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.409034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.409470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.728187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:40.758464 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1bb8f43-5d00-4f06-8334-a75f6d274b8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1557 microversion: 2.1 time: 0.363326 Mar 29 02:21:40.775378 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1528/2887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:40 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1557 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:40.781029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a9bdd229-99d7-4ea2-8148-660aae79bb41 req-830e16fd-d925-4de0-94aa-de0c6c060f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f861d750-c866-4f2d-ac1b-26bd1b476195", "tag": "e3429ef1-8643-4684-b0a0-a2aaebc37d54"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:40.790915 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:40.790915 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:40.813802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a9bdd229-99d7-4ea2-8148-660aae79bb41 req-830e16fd-d925-4de0-94aa-de0c6c060f85 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.813802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a9bdd229-99d7-4ea2-8148-660aae79bb41 req-830e16fd-d925-4de0-94aa-de0c6c060f85 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.833646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a9bdd229-99d7-4ea2-8148-660aae79bb41 req-830e16fd-d925-4de0-94aa-de0c6c060f85 service nova] Creating event network-changed:e3429ef1-8643-4684-b0a0-a2aaebc37d54 for instance f861d750-c866-4f2d-ac1b-26bd1b476195 on n-h2-828148-1 Mar 29 02:21:40.838868 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a9bdd229-99d7-4ea2-8148-660aae79bb41 req-830e16fd-d925-4de0-94aa-de0c6c060f85 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062149 Mar 29 02:21:40.839860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1529/2888] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:40.848482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:40.849987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:40.859682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.860905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:40.862352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:40.863223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.067123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:41.074001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:41.074001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:41.074001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:41.074001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:41.087520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.088059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.088982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.089545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.112781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Getting quotas for project 4d93ba3926564c87b6059d8e20f556e1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:41.120251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Getting quotas for user 28a74618b933442cb404c2732a31d4c0 and project 4d93ba3926564c87b6059d8e20f556e1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:41.135605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:41.138308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:41.332256 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e440497-46ad-4a24-a7fb-e7d1b3727d3b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.761644 Mar 29 02:21:41.338427 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1360/2889] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 6769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:21:41.344090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:41.350059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:41.353685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.354305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.355336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.356420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.373075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:41.386507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15028a6c-36ca-48b7-b141-5d4e9a0d8ef8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.544722 Mar 29 02:21:41.387697 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1530/2890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:40 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:41.392621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:41.393252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:41.406596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.408215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.409401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:41.410301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:41.827315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:41.836497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1339bbe-9947-4a89-abc8-dc1006c18469 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.447393 Mar 29 02:21:41.837336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1531/2891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:41 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:41.842437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d121587-b273-42b4-b497-8507273b15f0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:41.843789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d121587-b273-42b4-b497-8507273b15f0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:41.979755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d121587-b273-42b4-b497-8507273b15f0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:42.008241 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d121587-b273-42b4-b497-8507273b15f0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1213 microversion: 2.1 time: 0.168423 Mar 29 02:21:42.008925 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1532/2892] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:41 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1213 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:42.024278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:42.024278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:42.033366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.033818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:42.034613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.035230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:42.191466 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5f01e65-f86b-449a-9f7f-9d168f2e38cc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.851845 Mar 29 02:21:42.192748 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1361/2893] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:21:41 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/os-interface => generated 284 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:42.407219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:42.407958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:42.421098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.421601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:42.424108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.425352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:42.426113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:42.439921 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23def4d5-b538-42cd-87c1-2dec829099b4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.425841 Mar 29 02:21:42.444516 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1533/2894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:42 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:42.854553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:42.856023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:42.864364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.865388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:42.866369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:42.866966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:43.491776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:43.499785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88a68da9-75c3-44a9-a904-a8bcd675ac60 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.649227 Mar 29 02:21:43.501681 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1534/2895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:42 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:43.511453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e7846562-bfff-405f-b1d4-b52de0b13f45 req-52423a5f-d818-45e8-b1ca-6b0ae7fd1cb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150eb6c6-0a7e-4a29-906f-1d86aaf95c08", "tag": "5ab67be9-617b-4604-973b-85d4a5b92bb3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:43.514099 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:43.514099 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:43.523434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e7846562-bfff-405f-b1d4-b52de0b13f45 req-52423a5f-d818-45e8-b1ca-6b0ae7fd1cb4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:43.523953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e7846562-bfff-405f-b1d4-b52de0b13f45 req-52423a5f-d818-45e8-b1ca-6b0ae7fd1cb4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:43.600334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e7846562-bfff-405f-b1d4-b52de0b13f45 req-52423a5f-d818-45e8-b1ca-6b0ae7fd1cb4 service nova] Creating event network-changed:5ab67be9-617b-4604-973b-85d4a5b92bb3 for instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 on n-h1-828148-1 Mar 29 02:21:43.609970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e7846562-bfff-405f-b1d4-b52de0b13f45 req-52423a5f-d818-45e8-b1ca-6b0ae7fd1cb4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106026 Mar 29 02:21:43.610948 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1535/2896] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:43.617470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:43.618549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:43.627466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:43.628458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:43.629662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:43.630498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:43.778081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:43.791256 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-541312dc-4f19-46fd-94f4-1b68c275526c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 1.390982 Mar 29 02:21:43.800752 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1362/2897] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:42 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:43.807228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:43.808642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:43.829059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:43.829827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:43.831345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:43.831882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:44.008463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:44.019390 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1c15f4c3-4ae7-400e-992c-38696f9ee780 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1265 microversion: 2.1 time: 0.406351 Mar 29 02:21:44.020564 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1536/2898] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:43 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:44.522773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:44.532027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:44.539186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:44.539899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:44.540863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:44.546159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:44.795762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:44.815914 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2061719-7de6-4288-af52-c8fe7590365c tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 1.022317 Mar 29 02:21:44.818298 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1363/2899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:43 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:44.830606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:44.832139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:44.852068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:44.852538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:44.857486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:44.857486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:45.480739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:45.490961 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b46befb-cd6b-408b-81f6-67b3433ded96 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.976961 Mar 29 02:21:45.505030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1537/2900] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:44 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:45.512687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:45.514295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:45.534024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:45.534744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:45.535679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:45.537079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.089633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:46.100329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c72d389-6c60-4432-8a97-0c52f00657c3 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1271 microversion: 2.1 time: 0.601537 Mar 29 02:21:46.101596 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1538/2901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:45 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1271 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:46.107950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4286365b-2802-4bab-9780-7ab0404f50f7 req-790d68e3-4e0e-4006-ab0d-01f7989d1a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "name": "network-vif-plugged", "status": "completed", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:46.109901 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:46.109901 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:46.119768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4286365b-2802-4bab-9780-7ab0404f50f7 req-790d68e3-4e0e-4006-ab0d-01f7989d1a62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.120384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4286365b-2802-4bab-9780-7ab0404f50f7 req-790d68e3-4e0e-4006-ab0d-01f7989d1a62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.139741 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4286365b-2802-4bab-9780-7ab0404f50f7 req-790d68e3-4e0e-4006-ab0d-01f7989d1a62 service nova] Creating event network-vif-plugged:5faa6732-f151-4e2d-ae92-94ace19df2b9 for instance 18fccd9e-363a-446e-8b19-eb469eee1129 on n-h2-828148-1 Mar 29 02:21:46.145295 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4286365b-2802-4bab-9780-7ab0404f50f7 req-790d68e3-4e0e-4006-ab0d-01f7989d1a62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041894 Mar 29 02:21:46.148909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1539/2902] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:46.154918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:46.156050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:46.166364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.167154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.168115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.168735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.404389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:46.424518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-987f4c48-3f41-4b82-9a36-10e15e460e0c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 1.604342 Mar 29 02:21:46.426218 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1364/2903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:44 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:46.512823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:46.513391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:46.520950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.523312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.523312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.523312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:46.771651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:46.787949 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1979250-d213-4874-bbfc-ee2ecbc13450 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.635212 Mar 29 02:21:46.788791 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1540/2904] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:46 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:46.974659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-aa0cceb7-7411-44bd-ac59-4483d31801f2 req-4f9d2a9c-761f-4330-99e1-84f52349af4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed3eebc6-e934-4947-9eec-edd26d59cb81", "tag": "3a1e5442-44cf-4860-9688-fdc391fe8d90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:46.976319 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:46.976319 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:46.988231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa0cceb7-7411-44bd-ac59-4483d31801f2 req-4f9d2a9c-761f-4330-99e1-84f52349af4d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:46.989141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aa0cceb7-7411-44bd-ac59-4483d31801f2 req-4f9d2a9c-761f-4330-99e1-84f52349af4d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:47.013307 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-aa0cceb7-7411-44bd-ac59-4483d31801f2 req-4f9d2a9c-761f-4330-99e1-84f52349af4d service nova] Creating event network-changed:3a1e5442-44cf-4860-9688-fdc391fe8d90 for instance ed3eebc6-e934-4947-9eec-edd26d59cb81 on n-h1-828148-1 Mar 29 02:21:47.021531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-aa0cceb7-7411-44bd-ac59-4483d31801f2 req-4f9d2a9c-761f-4330-99e1-84f52349af4d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051508 Mar 29 02:21:47.023344 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1541/2905] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:47.145563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:47.149399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:47.172812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:47.173280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:47.174067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:47.174496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:47.606820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:47.660165 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24f0fc90-9355-42f6-bc26-8a4bf55fd86f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 1.150945 Mar 29 02:21:47.661103 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1365/2906] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:46 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:47.673159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:47.675264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:47.684701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:47.685176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:47.685952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:47.686384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.159052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:48.172114 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffac4a01-5113-479e-9c25-e5f2aa5acf32 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.509213 Mar 29 02:21:48.182379 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1366/2907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:47 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:48.187642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:48.188546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:48.198645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:48.199528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.200759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:48.201951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.513879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:48.527730 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57c02ddf-6ce8-473c-a378-f637d2e9bb67 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1313 microversion: 2.1 time: 1.413552 Mar 29 02:21:48.537205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1542/2908] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:47 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1313 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:48.537205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-dd9ef8f8-af5d-4358-827c-9c2a9b7977b9 req-4b1fde75-41d5-4572-a7f9-e16305a367c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f861d750-c866-4f2d-ac1b-26bd1b476195", "name": "network-vif-plugged", "status": "completed", "tag": "e3429ef1-8643-4684-b0a0-a2aaebc37d54"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:48.538738 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:48.538738 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:48.555865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dd9ef8f8-af5d-4358-827c-9c2a9b7977b9 req-4b1fde75-41d5-4572-a7f9-e16305a367c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:48.556309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dd9ef8f8-af5d-4358-827c-9c2a9b7977b9 req-4b1fde75-41d5-4572-a7f9-e16305a367c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.583460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dd9ef8f8-af5d-4358-827c-9c2a9b7977b9 req-4b1fde75-41d5-4572-a7f9-e16305a367c1 service nova] Creating event network-vif-plugged:e3429ef1-8643-4684-b0a0-a2aaebc37d54 for instance f861d750-c866-4f2d-ac1b-26bd1b476195 on n-h2-828148-1 Mar 29 02:21:48.590693 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-dd9ef8f8-af5d-4358-827c-9c2a9b7977b9 req-4b1fde75-41d5-4572-a7f9-e16305a367c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059871 Mar 29 02:21:48.593685 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1543/2909] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:48.704165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:48.705889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:48.724948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:48.731225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.731225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:48.731225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:48.832765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:48.843998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ed21c00-ff07-4ee2-ae97-9e95da372961 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.660162 Mar 29 02:21:48.851268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1367/2910] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:48 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:49.189952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:49.190679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:49.207203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.211010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:49.212084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.212696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:49.244363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:49.259349 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a7958dff-5c2c-4fda-a6f8-3dbc77ee790a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.584995 Mar 29 02:21:49.263070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1544/2911] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:48 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:49.544922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:49.546271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:49.565158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.565970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:49.567009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.568257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:49.845850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:49.860394 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a6da73fd-44b8-4c5c-b11e-609ffb12ae07 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1316 microversion: 2.1 time: 0.674739 Mar 29 02:21:49.868575 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1368/2912] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:49 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:49.876900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:49.885295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:49.912812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.913618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:49.914626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:49.920239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:50.544906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:50.569774 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-61db3c12-8c8e-4539-918d-46794256c89f tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1519 microversion: 2.1 time: 0.689207 Mar 29 02:21:50.569774 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1369/2913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:49 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1519 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:50.577427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:50.578266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:50.587075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:50.587716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:50.588592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:50.589158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:50.795801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:50.804820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a7113c4-46ea-4c3a-b057-3f5e24c32db5 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1334 microversion: 2.1 time: 1.263871 Mar 29 02:21:50.805412 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1545/2914] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:49 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1334 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:21:50.881534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:50.883170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:50.891710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:50.892537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:50.893660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:50.894302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:51.006733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:51.019834 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cdfb4bce-9997-457b-8597-ec427410f7c2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.452209 Mar 29 02:21:51.021272 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1370/2915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:50 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:51.187738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:51.198344 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4e98504-0f73-424d-967f-b62d4d2397a1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1465 microversion: 2.1 time: 0.323025 Mar 29 02:21:51.205282 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1546/2916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:50 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1465 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:51.518034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:51.519086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:51.535321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:51.536218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:51.537057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:51.537496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:51.579930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:51.580968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:51.599918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:51.600923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:51.602141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:51.602825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.081412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:52.106967 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4f29be4-3e0c-4d38-8be8-1b263950c5a5 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.530906 Mar 29 02:21:52.116704 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1547/2917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:51 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:52.121899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:52.122766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:52.138442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.139188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.140207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.140829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.507386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:52.516545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8db3a57e-5f48-45ea-80c1-1d127170b7b9 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.398214 Mar 29 02:21:52.518062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1548/2918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:52 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:52.531809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:52.532426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:52.540870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.541585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.542580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.543166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.595928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4218daa5-4686-475a-8913-10d88cf925b2 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1616 microversion: 2.1 time: 1.384336 Mar 29 02:21:52.601240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1371/2919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:51 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1616 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:52.612136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:52.621253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:52.644613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.646400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:52.649120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:52.649610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:53.208502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:53.217317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19824971-9652-4566-a15c-0f57ae5e6ddc tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.614506 Mar 29 02:21:53.218009 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1372/2920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:52 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:53.223641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: .version_select at 0x7f87242e9040>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-34034396", "policies": ["affinity"]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:53.247504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:53.253620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:53.305955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:53.315053 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3aef672d-b0fd-470d-97cf-366500f24b4b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.796842 Mar 29 02:21:53.316113 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1549/2921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:52 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:53.321949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-fc857dcf-eec6-41ab-909b-bf0d32651b8d req-7f300fa6-719e-4135-9505-410896b14eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150eb6c6-0a7e-4a29-906f-1d86aaf95c08", "name": "network-vif-plugged", "status": "completed", "tag": "5ab67be9-617b-4604-973b-85d4a5b92bb3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:53.325090 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:53.325090 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:53.334849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fc857dcf-eec6-41ab-909b-bf0d32651b8d req-7f300fa6-719e-4135-9505-410896b14eac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:53.335378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fc857dcf-eec6-41ab-909b-bf0d32651b8d req-7f300fa6-719e-4135-9505-410896b14eac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:53.354925 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-fc857dcf-eec6-41ab-909b-bf0d32651b8d req-7f300fa6-719e-4135-9505-410896b14eac service nova] Creating event network-vif-plugged:5ab67be9-617b-4604-973b-85d4a5b92bb3 for instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 on n-h1-828148-1 Mar 29 02:21:53.360926 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-fc857dcf-eec6-41ab-909b-bf0d32651b8d req-7f300fa6-719e-4135-9505-410896b14eac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043451 Mar 29 02:21:53.361690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1550/2922] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:53.367208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:53.376325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:53.385650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:53.386241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:53.387162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:53.387692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:53.401481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:53.423402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:53.450363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5fd1c7ac-9294-4135-a60c-d6bcad99ee37 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.230736 Mar 29 02:21:53.451048 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1373/2923] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Mar 29 02:21:53 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:53.565442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Action: 'create', calling method: .version_select at 0x7f87242e9a60>, body: {"keypair": {"name": "tempest-keypair-940028873"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:53.591053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:53.598023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for user b0f52cb271964888a35b14a72a2a6760 and project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:53.937639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:53.949862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for user b0f52cb271964888a35b14a72a2a6760 and project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:53.965432 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e975e1f7-af3c-4a26-a0dd-98a32be03831 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.503428 Mar 29 02:21:53.966137 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1374/2924] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:21:53 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:53.971194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-49dcf08f-5dae-4173-b5d9-eba346a48cce req-d98f916b-7d95-4a4e-b11c-212f1a15b878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "tag": "0a804ae2-f197-428c-85f0-c28a4ec12fa6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:53.973466 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:53.973466 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:53.983612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-49dcf08f-5dae-4173-b5d9-eba346a48cce req-d98f916b-7d95-4a4e-b11c-212f1a15b878 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:53.984647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-49dcf08f-5dae-4173-b5d9-eba346a48cce req-d98f916b-7d95-4a4e-b11c-212f1a15b878 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.008780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-49dcf08f-5dae-4173-b5d9-eba346a48cce req-d98f916b-7d95-4a4e-b11c-212f1a15b878 service nova] Creating event network-changed:0a804ae2-f197-428c-85f0-c28a4ec12fa6 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:21:54.014431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-49dcf08f-5dae-4173-b5d9-eba346a48cce req-d98f916b-7d95-4a4e-b11c-212f1a15b878 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046613 Mar 29 02:21:54.015894 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1375/2925] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:54.021672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:54.022574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:54.033781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:54.033922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.033922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.033922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.033922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.049633 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89035f11-bb74-4a7f-8cff-b7dcfe218281 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.686429 Mar 29 02:21:54.061195 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1551/2926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:53 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:54.061195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1987750735", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "00b1ed25-5174-4132-a26b-80eeebe4f451"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:54.152405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:21:54.571366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:21:54.572027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:21:54.573242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:21:54.573906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:21:54.574927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:21:54.599066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.599856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.601698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.602427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.623697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:54.632065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:54.648944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 2 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:21:54.651713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:54.725899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:54.738802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a94169a-a3f1-4fa7-8cdd-9270e8851442 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.721399 Mar 29 02:21:54.741718 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1376/2927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:54 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:54.752440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4107ec8a-d814-4db2-816d-725d909c976e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:54.767126 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4107ec8a-d814-4db2-816d-725d909c976e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance f8224c7e-596e-4b00-9024-4c620b11d94c has no mapping to a cell. Mar 29 02:21:54.770546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4107ec8a-d814-4db2-816d-725d909c976e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance f8224c7e-596e-4b00-9024-4c620b11d94c has no mapping to a cell. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:54.771583 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4107ec8a-d814-4db2-816d-725d909c976e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/f8224c7e-596e-4b00-9024-4c620b11d94c/action" status: 404 len: 117 microversion: 2.1 time: 0.028710 Mar 29 02:21:54.773503 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1377/2928] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:54 2022] POST /compute/v2.1/servers/f8224c7e-596e-4b00-9024-4c620b11d94c/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:54.782729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:54.782962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=103513) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Mar 29 02:21:54.783345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:54.796479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.805056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.807061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:54.808119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:54.808761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:54.822142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:54.945538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:54.956780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:54.986894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=a274f0e4-8009-4256-bc94-d2b2d1cf590c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:21:55.193793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:55.204444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:55.309120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:55.310477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:21:55.315657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:21:55.318500 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69cabc4a-40f4-4a2e-a66a-711693479778 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1315 microversion: 2.1 time: 0.543521 Mar 29 02:21:55.328240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1378/2929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:54 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:55.328240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:55.328240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:55.333714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.334401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:55.335377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.339534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:55.393347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a87219c-c010-44d6-8b7a-63c480f5e35e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.341415 Mar 29 02:21:55.397488 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1552/2930] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:21:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 1343 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 29 02:21:55.408493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:55.420450 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:55.420450 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:55.421978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:55.423969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Searching by: {'deleted': False, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:21:55.482622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.483089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:55.483906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.492414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:55.640695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:21:55.805311 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e26c020e-77a0-4ab6-9b89-9d77d7912f51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.400627 Mar 29 02:21:55.814101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1553/2931] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:21:55 2022] GET /compute/v2.1/servers => generated 1003 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:55.819146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:55.822751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:55.823376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:55.833762 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d8de0f2a-b14e-4c1f-89fa-706cadd23db1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.513299 Mar 29 02:21:55.836874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1379/2932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:55 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:55.845588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5cd5d9b1-0521-4e2a-9290-9a8a7299e18d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:55.845754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5cd5d9b1-0521-4e2a-9290-9a8a7299e18d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:55.854749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.855373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:55.856480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:55.857325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.002301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5cd5d9b1-0521-4e2a-9290-9a8a7299e18d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.012034 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5cd5d9b1-0521-4e2a-9290-9a8a7299e18d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1219 microversion: 2.1 time: 0.173962 Mar 29 02:21:56.015615 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1380/2933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:55 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:56.021341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:56.021958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:56.046588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.051113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.052910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.054146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.405313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.414846 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d245ab13-f3b4-48b2-bbb7-2eb1d85a6261 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.398127 Mar 29 02:21:56.425077 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1381/2934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:56 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:56.425186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.425331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:56.428920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6fbbe05d-9c9e-4a4e-9d1b-4220405c096a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.613233 Mar 29 02:21:56.437611 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:56.437611 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:56.443018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1554/2935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:55 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:56.443277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.443277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Searching by: {'deleted': False, 'project_id': '31bfe204d0b546f88575e1d38a708577'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:21:56.443484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5cf5861e-8a1b-4cb7-9570-0ffe7322f845 req-1ae0e7a1-3925-458e-856a-733c259a6557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "tag": "3e3dfe60-0670-4352-bb20-41dfa90fe33c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:56.443484 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:56.443484 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:56.451188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.452542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.453405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.453852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.470507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5cf5861e-8a1b-4cb7-9570-0ffe7322f845 req-1ae0e7a1-3925-458e-856a-733c259a6557 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.470507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5cf5861e-8a1b-4cb7-9570-0ffe7322f845 req-1ae0e7a1-3925-458e-856a-733c259a6557 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.506970 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5cf5861e-8a1b-4cb7-9570-0ffe7322f845 req-1ae0e7a1-3925-458e-856a-733c259a6557 service nova] Creating event network-changed:3e3dfe60-0670-4352-bb20-41dfa90fe33c for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:21:56.511871 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5cf5861e-8a1b-4cb7-9570-0ffe7322f845 req-1ae0e7a1-3925-458e-856a-733c259a6557 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077760 Mar 29 02:21:56.512987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1555/2936] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:56.518794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:56.519636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:56.529664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.530217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.531105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.531631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.605722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:21:56.884821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.885418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bdaeb6f5-91a7-40d7-abd5-8acc6f6071a2 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.466267 Mar 29 02:21:56.895624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1aa14ac-a523-45a7-b3f1-623d8c78dfe9 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1502 microversion: 2.1 time: 0.380949 Mar 29 02:21:56.896378 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1556/2937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:56 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:56.897093 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1382/2938] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:21:56 2022] GET /compute/v2.1/servers => generated 333 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:56.901672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:56.904760 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:56.904760 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:21:56.909994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:56.911276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Searching by: {'deleted': False, 'project_id': '31bfe204d0b546f88575e1d38a708577'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:21:56.917097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.917814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.918777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd6db2bc-7b40-47df-b074-66b6ec47bd95 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:56.919858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.920573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.921825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd6db2bc-7b40-47df-b074-66b6ec47bd95 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 89fa2135-113f-42fb-8bf8-3a1a012552f7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:56.940043 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bd6db2bc-7b40-47df-b074-66b6ec47bd95 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 89fa2135-113f-42fb-8bf8-3a1a012552f7 could not be found. Mar 29 02:21:56.940784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd6db2bc-7b40-47df-b074-66b6ec47bd95 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 89fa2135-113f-42fb-8bf8-3a1a012552f7 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:21:56.942627 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd6db2bc-7b40-47df-b074-66b6ec47bd95 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/89fa2135-113f-42fb-8bf8-3a1a012552f7/action" status: 404 len: 111 microversion: 2.1 time: 0.035103 Mar 29 02:21:56.947591 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1557/2939] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:56 2022] POST /compute/v2.1/servers/89fa2135-113f-42fb-8bf8-3a1a012552f7/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:21:56.956545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:56.960800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:56.979857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.981181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:56.982692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:56.987724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:57.039491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:21:57.235261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:57.245230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:57.245926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:57.561158 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Removing security group fb05e545-19a4-4a5e-97e6-2149952a1061 from port 5ab67be9-617b-4604-973b-85d4a5b92bb3 Mar 29 02:21:57.757119 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2c33b93b-aa6d-4025-b35c-fb7a4750b5a1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.858789 Mar 29 02:21:57.758831 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1383/2940] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:21:56 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:57.776604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:57.777290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:57.797018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:57.797965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:57.798277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:57.798716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.372993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:58.383817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bdec188b-d730-44bd-a30a-e6f2bc7e6097 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.623775 Mar 29 02:21:58.384771 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1384/2941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:57 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:58.389694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:58.390519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:58.399471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.399933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.401375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.401974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.694445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:58.707570 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cef68650-3d73-4696-8408-2b7e94f99ed1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1215 microversion: 2.1 time: 0.320075 Mar 29 02:21:58.709821 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1385/2942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:58 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1215 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:58.717235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:58.717849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:58.733741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.734871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.735711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.736154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.773615 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0869c1d9-325f-448f-94ac-9b36b960e884 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08/action" status: 202 len: 0 microversion: 2.1 time: 1.824646 Mar 29 02:21:58.777941 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1558/2943] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:56 2022] POST /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08/action => generated 0 bytes in 1829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:21:58.784879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7040d2e8-782a-4751-86b7-6cfe2c9b3613 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:58.820959 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7040d2e8-782a-4751-86b7-6cfe2c9b3613 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041084 Mar 29 02:21:58.825541 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1559/2944] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:21:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:58.834149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:58.835019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:58.853168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.855004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:58.856024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:58.860802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.403431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:59.412182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f4469bd-2234-4cb9-ae28-4ddb6f4cba7a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.585304 Mar 29 02:21:59.412952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1560/2945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:58 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:59.417622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-53f1f6e1-037e-4671-9345-7fdbb56ffde2 req-9286159a-ec1d-4536-9916-85b085ecd693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "tag": "00790bdb-0d71-439a-ba86-8fc5bfc14e40"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:59.420075 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:21:59.420075 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:21:59.431528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-53f1f6e1-037e-4671-9345-7fdbb56ffde2 req-9286159a-ec1d-4536-9916-85b085ecd693 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.432203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-53f1f6e1-037e-4671-9345-7fdbb56ffde2 req-9286159a-ec1d-4536-9916-85b085ecd693 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.449625 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-53f1f6e1-037e-4671-9345-7fdbb56ffde2 req-9286159a-ec1d-4536-9916-85b085ecd693 service nova] Creating event network-changed:00790bdb-0d71-439a-ba86-8fc5bfc14e40 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:21:59.455027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-53f1f6e1-037e-4671-9345-7fdbb56ffde2 req-9286159a-ec1d-4536-9916-85b085ecd693 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040787 Mar 29 02:21:59.455812 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1561/2946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:21:59.461889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:59.462621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:59.470988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.471635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.472586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.473248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.574656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:59.586258 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1fc9abe-ced2-4659-8c97-e3bf92650574 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.875339 Mar 29 02:21:59.587205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1386/2947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:58 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:59.593433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:21:59.594236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:59.602297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.602828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.603672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.604211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.673152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:21:59.778651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:21:59.789459 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30705f27-5c35-4c77-81bc-70a97ada03ea tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1460 microversion: 2.1 time: 0.332316 Mar 29 02:21:59.800043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1562/2948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:21:59 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1460 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:21:59.814354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:21:59.824183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:21:59.848576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.848576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.848576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:21:59.848576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:21:59.911170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lazy-loading 'flavor' on Instance uuid 18fccd9e-363a-446e-8b19-eb469eee1129 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:22:00.123626 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-28c0960d-84b0-4edb-826e-ad9e1a314513 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 204 len: 0 microversion: 2.1 time: 0.534491 Mar 29 02:22:00.125349 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1387/2949] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:21:59 2022] DELETE /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:22:00.134355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:00.137011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:00.150712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.151559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.152535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.153005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.340657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:00.349588 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-239c450b-74d7-4157-9a03-25c90c09f57d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1279 microversion: 2.1 time: 0.222324 Mar 29 02:22:00.350360 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1388/2950] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:00 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:00.354573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:00.355174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:00.362576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.363032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.363892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.364322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.404897 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d40285c-6b79-40b6-8b1d-121d9a576b3d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.606376 Mar 29 02:22:00.405719 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1563/2951] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:21:59 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:22:00.421953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2077991310", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c8efb6c0-8ff3-4e32-8aae-b4a732dc705a"}], "security_groups": [{"name": "tempest-securitygroup--2006528814"}], "key_name": "tempest-keypair-940028873", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:00.900974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:00.910792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f9d8b0f-326f-4a64-b309-79bfd8cb2a0e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.559567 Mar 29 02:22:00.911363 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1389/2952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:00 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:00.916488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:00.917398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:00.929922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.933962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.933962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:00.933962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:00.968537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] validate_networks() for [('c8efb6c0-8ff3-4e32-8aae-b4a732dc705a', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:01.446093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:01.454653 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7ff74e2a-f49e-42ff-85c7-957300609fe3 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1698 microversion: 2.1 time: 0.541966 Mar 29 02:22:01.455532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1390/2953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:00 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1698 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:01.460005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:01.460479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:01.469505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.469951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:01.470722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.471156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:01.714119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:01.722226 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7fbc2fee-b77a-493f-96a3-e4ea1e17dad7 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1497 microversion: 2.1 time: 0.265729 Mar 29 02:22:01.722783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1391/2954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:01 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1497 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:01.735632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:01.735632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:01.735632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.735632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:01.736397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.737084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:01.948370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:01.958263 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-505d25db-7a02-499f-8551-560f76e95bd0 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.233354 Mar 29 02:22:01.959017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1392/2955] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:01 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:01.963939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:01.964742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:01.972099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.972622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:01.977697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:01.977697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.177219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:02.186136 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d721a24-330d-4210-bc4c-de6aa8d9ce92 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.225521 Mar 29 02:22:02.196284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1393/2956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:01 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:02.201717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:02.203159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:02.213681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:02.214333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.217350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:02.217350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.754930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:02.769649 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-228e2b3a-cf90-444c-aa79-795fcf3315d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.571607 Mar 29 02:22:02.777612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1394/2957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:02 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:02.783645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8c362c0e-0c68-42bf-ae65-ac8a42437a4b req-a56e3c03-ab21-4cc1-9d57-795758335e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150eb6c6-0a7e-4a29-906f-1d86aaf95c08", "tag": "5ab67be9-617b-4604-973b-85d4a5b92bb3"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:02.785598 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:02.785598 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:02.794766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c362c0e-0c68-42bf-ae65-ac8a42437a4b req-a56e3c03-ab21-4cc1-9d57-795758335e99 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:02.795475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c362c0e-0c68-42bf-ae65-ac8a42437a4b req-a56e3c03-ab21-4cc1-9d57-795758335e99 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.814960 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8c362c0e-0c68-42bf-ae65-ac8a42437a4b req-a56e3c03-ab21-4cc1-9d57-795758335e99 service nova] Creating event network-changed:5ab67be9-617b-4604-973b-85d4a5b92bb3 for instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 on n-h1-828148-1 Mar 29 02:22:02.822377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8c362c0e-0c68-42bf-ae65-ac8a42437a4b req-a56e3c03-ab21-4cc1-9d57-795758335e99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041976 Mar 29 02:22:02.823231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1395/2958] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:02.840331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:02.842075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:02.850670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:02.851351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.852572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:02.853187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:02.935725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lazy-loading 'flavor' on Instance uuid 18fccd9e-363a-446e-8b19-eb469eee1129 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:22:03.007385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:03.019643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for user b0f52cb271964888a35b14a72a2a6760 and project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:03.054462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:22:03.061220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:22:03.061220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:22:03.061220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:22:03.061220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:22:03.061600 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'suspend' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state suspended Mar 29 02:22:03.061600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'suspend' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state suspended {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:03.061600 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af7af1cb-d17f-434d-a6d1-1df00dacd6e1 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 148 microversion: 2.1 time: 0.236865 Mar 29 02:22:03.067648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1396/2959] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:02 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 148 bytes in 243 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:22:03.072607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:03.073417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:03.079521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.080899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.083222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.083827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.093409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.097464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.099089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.101778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.121012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:03.135882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Getting quotas for user b0f52cb271964888a35b14a72a2a6760 and project 26991bf8ca704b6ea1fbb4fffb74d369. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:03.165006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:22:03.167742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:03.334624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b818d520-2982-4de2-b844-65fe341dcc12 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.921969 Mar 29 02:22:03.335457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1564/2960] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 2924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:22:03.340589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:03.355107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:03.385866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.387518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.389396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.390033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.807501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:03.834209 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a37ffa18-2129-4cb8-82fb-2583c8c128fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.765430 Mar 29 02:22:03.834803 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1397/2961] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:03 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:03.841184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:03.841414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:03.868430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.869212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:03.870540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:03.871258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:04.591159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:04.605235 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c7c0e3c-6f19-4613-82bb-b8212e1bb7e8 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1698 microversion: 2.1 time: 1.267560 Mar 29 02:22:04.606160 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1565/2962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:03 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1698 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:04.626082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:04.635398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:04.636948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:04.638318 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e23ca7ac-349f-43d9-9fdd-4afad22c301e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.802446 Mar 29 02:22:04.646599 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1398/2963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:03 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:04.661074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:04.662082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:04.663213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:04.663495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:04.664117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:04.664719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:04.671896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:04.672341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:04.673134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:04.673566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.082976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:05.083408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f68a28a5-5714-46b8-b5fc-fd6c2ff8787e tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 202 len: 0 microversion: 2.1 time: 0.473833 Mar 29 02:22:05.084775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1566/2964] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:04 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:22:05.097743 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d1c052c-1449-45e7-bec7-0504200ae67b tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1281 microversion: 2.1 time: 0.449895 Mar 29 02:22:05.104932 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1399/2965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:04 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:05.105794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:05.108208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:05.115567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c3b06b69-e42c-4897-86c1-bbc7285c940b req-8c79f09d-ee0f-42e1-a632-801acb8fc189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a274f0e4-8009-4256-bc94-d2b2d1cf590c", "tag": "3a4b24ac-7211-4859-b32c-8f4bbdffd372"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:05.117605 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:05.117605 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:05.123890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.123890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.125065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.125520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.131421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c3b06b69-e42c-4897-86c1-bbc7285c940b req-8c79f09d-ee0f-42e1-a632-801acb8fc189 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.132138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c3b06b69-e42c-4897-86c1-bbc7285c940b req-8c79f09d-ee0f-42e1-a632-801acb8fc189 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.148880 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c3b06b69-e42c-4897-86c1-bbc7285c940b req-8c79f09d-ee0f-42e1-a632-801acb8fc189 service nova] Creating event network-changed:3a4b24ac-7211-4859-b32c-8f4bbdffd372 for instance a274f0e4-8009-4256-bc94-d2b2d1cf590c on n-h2-828148-1 Mar 29 02:22:05.154088 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c3b06b69-e42c-4897-86c1-bbc7285c940b req-8c79f09d-ee0f-42e1-a632-801acb8fc189 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051173 Mar 29 02:22:05.155262 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1400/2966] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:05.161483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:05.162713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:05.170686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.171263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.172453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.173039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.583018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:05.591385 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72a47fcd-5ae1-478c-8351-9e4a8a71d007 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.434795 Mar 29 02:22:05.592991 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1401/2967] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:05 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:05.598333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:05.598949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:05.615684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.615684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:05.615684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:05.615684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:06.320184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:06.331713 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62ad193e-42ca-44fb-921d-885ee561eefe tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1503 microversion: 2.1 time: 0.737862 Mar 29 02:22:06.345588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1402/2968] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:05 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1503 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:06.352896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:06.353860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:06.364013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:06.365883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:06.366937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:06.367532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:06.480338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:06.493461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80851a0a-7e42-4625-b4d8-64d0d6be9862 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 1.404416 Mar 29 02:22:06.495315 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1567/2969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:05 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:06.508802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:06.511377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:06.536317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:06.536779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:06.539944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:06.540416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:06.597091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68a1ad4d3f7646beb994d9195bc58c2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31bfe204d0b546f88575e1d38a708577', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:06.622828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9bb7566-4084-488f-b90f-03000d03bbb1 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 200 len: 1631 microversion: 2.1 time: 0.271728 Mar 29 02:22:06.637200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1403/2970] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:06 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 1631 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:06.647690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1472750903", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9222f6f3-d189-4e16-8c8f-3078bec78258"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:06.802942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] validate_networks() for [('9222f6f3-d189-4e16-8c8f-3078bec78258', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:07.288557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:07.302495 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-37dba8bc-c44e-4591-8b10-dec4eff6abbe tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.805804 Mar 29 02:22:07.312080 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1568/2971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:06 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:07.315043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-77fc7a60-210a-47eb-8958-607ac3e870c9 req-a912c9ef-ecc7-4db4-8a50-982f74ac4e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b146b08d-d840-4086-a4ef-f0bb38b32cec", "name": "network-vif-deleted", "tag": "d70e5afb-00e3-4338-97ac-f191b56be8c0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:07.316710 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:07.316710 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:07.331348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-77fc7a60-210a-47eb-8958-607ac3e870c9 req-a912c9ef-ecc7-4db4-8a50-982f74ac4e42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:07.332735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-77fc7a60-210a-47eb-8958-607ac3e870c9 req-a912c9ef-ecc7-4db4-8a50-982f74ac4e42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:07.354486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-77fc7a60-210a-47eb-8958-607ac3e870c9 req-a912c9ef-ecc7-4db4-8a50-982f74ac4e42 service nova] Creating event network-vif-deleted:d70e5afb-00e3-4338-97ac-f191b56be8c0 for instance b146b08d-d840-4086-a4ef-f0bb38b32cec on n-h2-828148-1 Mar 29 02:22:07.361223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-77fc7a60-210a-47eb-8958-607ac3e870c9 req-a912c9ef-ecc7-4db4-8a50-982f74ac4e42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056895 Mar 29 02:22:07.362531 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1569/2972] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:07.376350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:07.377641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:07.387285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:07.388285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:07.389333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:07.390036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:07.568227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:07.578789 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d2c64b5-e009-4428-8375-80a4247697f3 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1335 microversion: 2.1 time: 0.214435 Mar 29 02:22:07.588551 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1570/2973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:07 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1335 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:07.588551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:07.588551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:07.598097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:07.598985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:07.600235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:07.601275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.134271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:08.147806 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f04ea6d-2025-4bbf-8fc1-8dd42099b6d9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1503 microversion: 2.1 time: 0.565849 Mar 29 02:22:08.149180 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1571/2974] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:07 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1503 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:08.154046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:08.154864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:08.169913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.170816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.171804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.172399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.232082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:22:08.235413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:22:08.237012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:22:08.237547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:22:08.238074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:22:08.248461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.249151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.250054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.250557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.273264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:08.278891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Getting quotas for user defab0990da34b4e83db3da9d7834fa2 and project 08f809798f734833b6638b438d109ff3. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:08.295549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:22:08.297888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:08.504491 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-add1b5f2-3bb5-4bd2-9f3a-18a840aea17f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864832 Mar 29 02:22:08.510437 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1404/2975] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:22:08.514546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:08.523542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] [instance: b146b08d-d840-4086-a4ef-f0bb38b32cec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:08.537520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.537979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.538949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.539438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.642610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:08.658461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0c2dd88-8441-4373-bd82-6f10072b7343 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.503829 Mar 29 02:22:08.662173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1572/2976] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:08 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:08.679846 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] HTTP exception thrown: Instance b146b08d-d840-4086-a4ef-f0bb38b32cec could not be found. Mar 29 02:22:08.681234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Returning 404 to user: Instance b146b08d-d840-4086-a4ef-f0bb38b32cec could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:08.682039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1946533b-6e2e-4f7c-a067-f392cffcb8dd req-76d40bd5-e6a9-40b3-8005-3505e931dcda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-plugged", "status": "completed", "tag": "0a804ae2-f197-428c-85f0-c28a4ec12fa6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:08.682174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41dbb984-0ea4-408e-9b24-19ad063d2270 tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec" status: 404 len: 111 microversion: 2.1 time: 0.174607 Mar 29 02:22:08.686243 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1405/2977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:08 2022] GET /compute/v2.1/servers/b146b08d-d840-4086-a4ef-f0bb38b32cec => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:08.686803 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:08.686803 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:08.696673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:08.698570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:08.711994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1946533b-6e2e-4f7c-a067-f392cffcb8dd req-76d40bd5-e6a9-40b3-8005-3505e931dcda service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.712613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1946533b-6e2e-4f7c-a067-f392cffcb8dd req-76d40bd5-e6a9-40b3-8005-3505e931dcda service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.716537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.718392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.719496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.720828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.742523 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1946533b-6e2e-4f7c-a067-f392cffcb8dd req-76d40bd5-e6a9-40b3-8005-3505e931dcda service nova] Creating event network-vif-plugged:0a804ae2-f197-428c-85f0-c28a4ec12fa6 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:08.748049 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1946533b-6e2e-4f7c-a067-f392cffcb8dd req-76d40bd5-e6a9-40b3-8005-3505e931dcda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081503 Mar 29 02:22:08.749397 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1573/2978] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:08.755375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93590f07-344c-4385-b772-5c2498da202c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:08.756338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93590f07-344c-4385-b772-5c2498da202c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:08.842243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-93590f07-344c-4385-b772-5c2498da202c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:08.858547 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93590f07-344c-4385-b772-5c2498da202c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1215 microversion: 2.1 time: 0.107558 Mar 29 02:22:08.859536 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1574/2979] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:08 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:08.873185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:08.873945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:08.887431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.888015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:08.888979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:08.889561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.114116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:09.132669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:09.142853 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-708cb958-7cb1-492b-92ed-7dff99965435 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.455212 Mar 29 02:22:09.153775 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1406/2980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:08 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:09.153775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72ebaf1f-e5a4-496a-a0ed-e27d288d2e0d tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] Calling method '.version_select at 0x7f8717e7c790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:09.154052 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56e5af0e-8d80-4082-843b-cb5dc9fec6c5 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.291178 Mar 29 02:22:09.154052 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1575/2981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:08 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:09.167185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:09.168138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:09.177148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.177603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.178376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.178862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.379709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72ebaf1f-e5a4-496a-a0ed-e27d288d2e0d tempest-ServersTestJSON-1397314556 tempest-ServersTestJSON-1397314556-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896366402" status: 202 len: 0 microversion: 2.1 time: 0.234119 Mar 29 02:22:09.383923 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1407/2982] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896366402 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:22:09.392999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:09.403603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48c943fa-37b2-4280-a7a0-2d179f149bd9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.242624 Mar 29 02:22:09.417260 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1576/2983] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:09 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:09.424639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:09.425502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:09.434405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.435146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.436186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.437759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.450651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f92339da-b53d-4410-a24d-16c7cc71dabc req-1e007af5-f162-4b85-a966-4a4e96d9bd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90d84e3d-ddfc-476d-8c6d-83aa4dcaa705", "tag": "09a91905-ac3c-4ca4-bbe5-9867accd1b46"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:09.453001 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:09.453001 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:09.467377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f92339da-b53d-4410-a24d-16c7cc71dabc req-1e007af5-f162-4b85-a966-4a4e96d9bd91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.473492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f92339da-b53d-4410-a24d-16c7cc71dabc req-1e007af5-f162-4b85-a966-4a4e96d9bd91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.514228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f92339da-b53d-4410-a24d-16c7cc71dabc req-1e007af5-f162-4b85-a966-4a4e96d9bd91 service nova] Creating event network-changed:09a91905-ac3c-4ca4-bbe5-9867accd1b46 for instance 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 on n-h2-828148-1 Mar 29 02:22:09.531686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f92339da-b53d-4410-a24d-16c7cc71dabc req-1e007af5-f162-4b85-a966-4a4e96d9bd91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086511 Mar 29 02:22:09.532464 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1577/2984] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:09.679804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:09.680515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:09.691428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.691428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.691428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.691428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.760786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:09.776145 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adfff8a1-60fd-4609-84e3-6ec5f7540af0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.349920 Mar 29 02:22:09.776145 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1408/2985] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:09 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:09.787348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd6fbda5-09a6-46f5-8973-a1f341a6f432 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:09.788016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd6fbda5-09a6-46f5-8973-a1f341a6f432 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 7c74b37e-f671-4cdb-861a-83a4299200f4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:09.795760 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-cd6fbda5-09a6-46f5-8973-a1f341a6f432 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 7c74b37e-f671-4cdb-861a-83a4299200f4 could not be found. Mar 29 02:22:09.796455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd6fbda5-09a6-46f5-8973-a1f341a6f432 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 7c74b37e-f671-4cdb-861a-83a4299200f4 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:09.797520 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd6fbda5-09a6-46f5-8973-a1f341a6f432 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/7c74b37e-f671-4cdb-861a-83a4299200f4/action" status: 404 len: 111 microversion: 2.1 time: 0.014798 Mar 29 02:22:09.800896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1409/2986] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:09 2022] POST /compute/v2.1/servers/7c74b37e-f671-4cdb-861a-83a4299200f4/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:22:09.807531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:09.808175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:09.819287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.819741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:09.820578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:09.821056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.156474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:10.168023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d75f22b-f3eb-472c-acc0-4de9a2489032 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.493006 Mar 29 02:22:10.169226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1578/2987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:09 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:10.174326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:10.174936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:10.182746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.187464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.187464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.187464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.282786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:10.292153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d1b0b0e8-7b11-4b98-a7b1-81c77a88830a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.489371 Mar 29 02:22:10.305329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1410/2988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:09 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:10.305329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:10.305329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:10.309496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.309657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.310330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.310764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.352364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:10.362932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a49dd79a-7a64-4122-8cb7-ed6296c647c7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1219 microversion: 2.1 time: 0.191030 Mar 29 02:22:10.371186 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1579/2989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:10 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:10.375902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:10.376594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:10.384201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.384855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.385757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.386253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.671188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:10.684285 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-00748109-f132-43ef-b0d4-275a91d12937 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 0.387805 Mar 29 02:22:10.685501 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1411/2990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:10 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:10.696444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:10.697527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:10.714266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.714717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:10.715497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:10.715932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.063233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:11.074809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-47c0ea6a-259c-4aba-a3f3-279702f09bf2 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.702407 Mar 29 02:22:11.084370 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1580/2991] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:10 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:11.089306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8abc30bf-e438-48d5-bd92-d57a8ab8607f req-500dfeb4-514e-4eae-8f95-6977484fab0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3aa2f3-0ae2-4a47-91e6-352b1d1308df", "tag": "12694fe8-e9b2-4f21-abde-c0d8354a4a3c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:11.091099 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:11.091099 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:11.101850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8abc30bf-e438-48d5-bd92-d57a8ab8607f req-500dfeb4-514e-4eae-8f95-6977484fab0b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.102819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8abc30bf-e438-48d5-bd92-d57a8ab8607f req-500dfeb4-514e-4eae-8f95-6977484fab0b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.130342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8abc30bf-e438-48d5-bd92-d57a8ab8607f req-500dfeb4-514e-4eae-8f95-6977484fab0b service nova] Creating event network-changed:12694fe8-e9b2-4f21-abde-c0d8354a4a3c for instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df on n-h1-828148-1 Mar 29 02:22:11.138527 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8abc30bf-e438-48d5-bd92-d57a8ab8607f req-500dfeb4-514e-4eae-8f95-6977484fab0b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050626 Mar 29 02:22:11.138527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1581/2992] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:11.146898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-plugged", "status": "completed", "tag": "3e3dfe60-0670-4352-bb20-41dfa90fe33c"}, {"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-plugged", "status": "completed", "tag": "00790bdb-0d71-439a-ba86-8fc5bfc14e40"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:11.149118 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:11.149118 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:11.162502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.163156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.193566 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] Creating event network-vif-plugged:3e3dfe60-0670-4352-bb20-41dfa90fe33c for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:11.194590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] Creating event network-vif-plugged:00790bdb-0d71-439a-ba86-8fc5bfc14e40 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:11.201312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:11.212189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a93a6971-e260-474c-9a2c-a6a80477eb4d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.522314 Mar 29 02:22:11.223839 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1412/2993] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:10 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:11.229100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:11.230170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:11.234649 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-637930b4-e4f7-48c0-82fa-4b057b9583b5 req-cfe261ff-9882-4fc0-85cc-485bd9063ff8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092990 Mar 29 02:22:11.236881 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1582/2994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:11.241979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.242530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.243416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.247115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.253213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:11.258949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:11.278619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.279373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.281674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.283003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.406432 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'unpause' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active Mar 29 02:22:11.407021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'unpause' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:11.408080 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae9bcfd3-c953-478e-bc29-a5fda6990cab tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 145 microversion: 2.1 time: 0.169657 Mar 29 02:22:11.409227 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1583/2995] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:11 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 145 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:22:11.414215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:11.415184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:11.424621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.425280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.426306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.426734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.614982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:11.626958 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fed637df-3438-4a11-ac20-61efea761ab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1275 microversion: 2.1 time: 0.216071 Mar 29 02:22:11.635569 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1584/2996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:11 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1275 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:11.643457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:11.644197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:11.655126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.655583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:11.656418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:11.657135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.032527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.046476 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30a9f511-917a-429c-b2e8-5432de7c7430 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.817723 Mar 29 02:22:12.049529 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1413/2997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:11 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:12.058307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.067352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.079312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.079719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.080848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.080986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.099092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.107652 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-831e54bb-fcba-4fe5-8c51-5dc8f4d25508 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.476367 Mar 29 02:22:12.113062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1585/2998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:11 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:12.118128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.120172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.127764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.127764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.128692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.129338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.333557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.341752 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db374c8c-1cf8-447d-92dc-f03423a0195c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.232182 Mar 29 02:22:12.342315 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1586/2999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:12.346515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.347129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.354738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.355200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.355963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.356395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.556197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.564490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32c7389f-f6f9-428e-8ea9-648dd154d904 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.221224 Mar 29 02:22:12.565077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1587/3000] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:12.582479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-312c45a0-2933-4114-b0f0-c8aab2e0429b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:12.583013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-312c45a0-2933-4114-b0f0-c8aab2e0429b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: b5f8876e-96dc-462c-bb29-4e4ff6b7cd4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.589865 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-312c45a0-2933-4114-b0f0-c8aab2e0429b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance b5f8876e-96dc-462c-bb29-4e4ff6b7cd4f could not be found. Mar 29 02:22:12.590434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-312c45a0-2933-4114-b0f0-c8aab2e0429b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance b5f8876e-96dc-462c-bb29-4e4ff6b7cd4f could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:12.591223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-312c45a0-2933-4114-b0f0-c8aab2e0429b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/b5f8876e-96dc-462c-bb29-4e4ff6b7cd4f/action" status: 404 len: 111 microversion: 2.1 time: 0.013032 Mar 29 02:22:12.591744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1588/3001] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:12 2022] POST /compute/v2.1/servers/b5f8876e-96dc-462c-bb29-4e4ff6b7cd4f/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:22:12.599689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.600295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.607851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.608299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.609086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.609519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.819417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.827766 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e60ec62c-873d-4db1-abef-870b6d448a70 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.231947 Mar 29 02:22:12.840481 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1589/3002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:12.840481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.840481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.843059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.843578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.844722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.845107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.969226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:12.978828 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e9df91d-3eae-4ebd-bb89-06ff0beabc6d tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1273 microversion: 2.1 time: 0.148156 Mar 29 02:22:12.979614 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1590/3003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:12.983821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:12.984436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:12.991881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.992322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:12.993190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:12.993637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.064881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:13.080951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d19f2ba0-2258-4b81-9c10-5b8ea276927f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1355 microversion: 2.1 time: 1.029651 Mar 29 02:22:13.092115 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1414/3004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1355 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:13.093355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:13.093972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:13.107190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.107634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.108401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.108827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.230199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:13.240166 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be6a1e2f-5f2b-4486-9aca-6bb06b5a7c32 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.259684 Mar 29 02:22:13.241079 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1591/3005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:12 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:13.256594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:13.257200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:13.264593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.265088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.265943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.266308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.338817 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Cannot 'unshelve' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active Mar 29 02:22:13.339481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 409 to user: Cannot 'unshelve' instance 18fccd9e-363a-446e-8b19-eb469eee1129 while it is in vm_state active {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:13.341140 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e44ad8c-073f-48aa-bf33-5103cdd09561 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action" status: 409 len: 146 microversion: 2.1 time: 0.088062 Mar 29 02:22:13.344355 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1592/3006] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:13 2022] POST /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129/action => generated 146 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:22:13.349060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a274f0e4-8009-4256-bc94-d2b2d1cf590c", "name": "network-vif-plugged", "status": "completed", "tag": "3a4b24ac-7211-4859-b32c-8f4bbdffd372"}, {"server_uuid": "90d84e3d-ddfc-476d-8c6d-83aa4dcaa705", "name": "network-vif-plugged", "status": "completed", "tag": "09a91905-ac3c-4ca4-bbe5-9867accd1b46"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:13.350751 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:13.350751 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:13.360074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.360509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.378468 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] Creating event network-vif-plugged:3a4b24ac-7211-4859-b32c-8f4bbdffd372 for instance a274f0e4-8009-4256-bc94-d2b2d1cf590c on n-h2-828148-1 Mar 29 02:22:13.379642 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] Creating event network-vif-plugged:09a91905-ac3c-4ca4-bbe5-9867accd1b46 for instance 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 on n-h2-828148-1 Mar 29 02:22:13.386380 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-34ea6ce5-876c-44e6-b0e1-0895ac6d99d9 req-6fc8c3d7-ac60-4949-92a1-b08c5a26151b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040770 Mar 29 02:22:13.387030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1593/3007] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:13.392325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:13.393106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:13.401207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.401658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.402450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.402939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.756792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:13.766999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0bbd75e4-c1dd-481a-a4e6-0d10f6438894 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.678891 Mar 29 02:22:13.776718 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1415/3008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:13 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:13.776718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:13.776718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:13.781951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.782690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.783316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.783747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.937149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:13.946200 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90c0dc04-6a69-474d-9d86-db429654c249 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.557741 Mar 29 02:22:13.948907 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1594/3009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:13 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:13.964810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:13.965516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:13.973666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.974114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:13.974911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:13.975353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.223269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:14.233028 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-adb10930-5c0a-475c-adf5-201fccd28aee tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.272845 Mar 29 02:22:14.234620 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1595/3010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:13 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:14.239521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:14.240363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.248780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.249271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.250041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.250641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.456334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:14.466678 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c2f40f4-5018-4e48-a2bc-e0200141b08a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.230623 Mar 29 02:22:14.476281 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1596/3011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:14 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:14.481135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:14.481834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.489834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.490051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.490914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.491422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.714815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:14.723318 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0176cb3f-3f56-4232-943b-c54ebdd8caf7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1804 microversion: 2.1 time: 0.245821 Mar 29 02:22:14.723826 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1597/3012] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:14 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1804 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:14.728592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1bbadca-7fa6-4e20-88a7-7f4b62f83084 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-738957622_updated"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:14.729781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1bbadca-7fa6-4e20-88a7-7f4b62f83084 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 3a70adbc-2cef-4665-b97d-2d64b7f8d30d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.739514 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b1bbadca-7fa6-4e20-88a7-7f4b62f83084 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 3a70adbc-2cef-4665-b97d-2d64b7f8d30d could not be found. Mar 29 02:22:14.740108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1bbadca-7fa6-4e20-88a7-7f4b62f83084 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 3a70adbc-2cef-4665-b97d-2d64b7f8d30d could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:14.740956 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1bbadca-7fa6-4e20-88a7-7f4b62f83084 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "PUT /compute/v2.1/servers/3a70adbc-2cef-4665-b97d-2d64b7f8d30d" status: 404 len: 111 microversion: 2.1 time: 0.016191 Mar 29 02:22:14.741515 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1598/3013] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:22:14 2022] PUT /compute/v2.1/servers/3a70adbc-2cef-4665-b97d-2d64b7f8d30d => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:14.746058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:14.746550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.754981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.755427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.756183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.756618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.819057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61b288a8-3290-48ac-a87c-a2a552e8d711 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6/ips" status: 200 len: 217 microversion: 2.1 time: 0.076488 Mar 29 02:22:14.819721 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1599/3014] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:22:14 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6/ips => generated 217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:14.823882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:14.824489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.831859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.832299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.833090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.833516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.888785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:14.897724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7dcfa8d-c8c7-4c5f-be63-a98fe442164c tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 1.129051 Mar 29 02:22:14.898588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1416/3015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:13 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:14.921455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:14.922070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:14.930226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.930791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:14.931665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:14.932324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.039292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:15.047860 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57cb0251-dd2a-46ac-a376-dce019427558 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.227195 Mar 29 02:22:15.048502 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1600/3016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:14 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:15.053371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:15.053935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:15.061929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.062553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.063360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.063796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.130977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:22:15.448386 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c9b24d90-1112-40e8-9b3f-c1e2e0bcff44 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 204 len: 0 microversion: 2.1 time: 0.398510 Mar 29 02:22:15.449410 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1601/3017] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:22:15 2022] DELETE /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:22:15.454900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:15.455591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:15.463406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.463847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.464624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.465087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.648525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:15.659581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-04e1d5f2-c603-453b-beff-58cb5157d128 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1319 microversion: 2.1 time: 0.759827 Mar 29 02:22:15.662824 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1417/3018] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:14 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1319 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:15.669130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:15.669921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:15.676676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:15.688472 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2015e7e-722e-4064-bae3-6912fa1601a4 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.236217 Mar 29 02:22:15.699771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1602/3019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:15 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:15.699771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:15.699771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:15.701928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.702378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.703219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.703646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.721374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.721818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.723153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.723585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.954248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:15.963478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4bcdee87-bb79-49f8-993f-304ad60aff19 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.271406 Mar 29 02:22:15.964043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1603/3020] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:15 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:15.968477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c12b8e8-4255-4d59-927b-8866f187c5e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:15.969869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c12b8e8-4255-4d59-927b-8866f187c5e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:15.970641 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c12b8e8-4255-4d59-927b-8866f187c5e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "PUT /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 400 len: 619 microversion: 2.1 time: 0.005701 Mar 29 02:22:15.974256 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1604/3021] 10.222.0.36 () {60 vars in 1256 bytes} [Tue Mar 29 02:22:15 2022] PUT /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:22:15.976077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:15.976077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:15.984048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.985882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:15.985882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:15.985882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.186666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:16.195590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac8881bd-559c-4a27-8b41-e57930903684 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.223175 Mar 29 02:22:16.196152 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1605/3022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:15 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:16.200508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:16.201147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:16.209694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.210164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.211149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.211578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.395416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:16.408966 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d81a9388-9056-40b9-b504-d6eefb305514 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1810 microversion: 2.1 time: 0.744405 Mar 29 02:22:16.410370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1418/3023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:15 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1810 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:16.432680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:16.443992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4204c824-de10-4de7-91f6-4e77ac1c2ec9 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.246757 Mar 29 02:22:16.444888 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1606/3024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:16 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:16.463435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:16.464986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:16.473018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.473827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.475222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.475880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.679672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:16.681831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:16.700525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.700900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.701691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.702139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.783209 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:22:16.938201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:16.949193 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5df2e7fb-a9da-4d8e-b1d8-711dc8008b51 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1469 microversion: 2.1 time: 0.274743 Mar 29 02:22:16.949714 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1607/3025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:16 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:16.965445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:16.966054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:16.973787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.974240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:16.975005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:16.975518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.137588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:17.146655 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49c79ccd-35e7-40d3-921d-8d58ccf781ae tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.687107 Mar 29 02:22:17.147343 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1419/3026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:16 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:17.151949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:17.152739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:17.163857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.164564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.165388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.165828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.177402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:17.186145 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e5bb908-0cfe-4385-99e9-aaae50f346c2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c" status: 200 len: 1469 microversion: 2.1 time: 0.224220 Mar 29 02:22:17.187008 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1608/3027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:16 2022] GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:17.191619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b943de94-9877-449e-832b-683560f60ac3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:17.192868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b943de94-9877-449e-832b-683560f60ac3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:17.193703 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b943de94-9877-449e-832b-683560f60ac3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "PUT /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 400 len: 108 microversion: 2.1 time: 0.005914 Mar 29 02:22:17.196913 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1609/3028] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:22:17 2022] PUT /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:22:17.202729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:17.207927 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:17.207927 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:17.209612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:17.210642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Searching by: {'reservation_id': 'r-f6ug52pq', 'deleted': False, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:22:17.217216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.218069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.219404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.220005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.341326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:22:17.524390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:17.537030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.537030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.793291 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33876. Mar 29 02:22:17.879630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01d98157-e090-4bd5-849c-0ff4b9ede6e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-f6ug52pq" status: 200 len: 2931 microversion: 2.1 time: 0.681138 Mar 29 02:22:17.881165 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1610/3029] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Mar 29 02:22:17 2022] GET /compute/v2.1/servers/detail?reservation_id=r-f6ug52pq => generated 2931 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:17.885282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:17.885897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:17.893350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.893794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:17.894774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:17.895203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.058562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:18.067922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5f7a440-244c-47b3-963d-910d65b5fd78 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.919412 Mar 29 02:22:18.068694 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1420/3030] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:17 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:18.073557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:18.074356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:18.081828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.082270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.083034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.083520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.446759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:18.460964 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9e5584a-a483-40f4-8ee5-4de4966d535d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1506 microversion: 2.1 time: 0.578899 Mar 29 02:22:18.462707 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1611/3031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:17 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1506 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:18.469168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8a87cbcc-0c70-4119-abf9-722183223317 req-f3f6b041-63f2-409a-9e71-10531589a763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88d8eec-fccf-451e-91af-95d09426c4ce", "tag": "175edd8d-0b34-4f3e-9762-68390802471d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:18.481156 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:18.481156 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:18.483666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a87cbcc-0c70-4119-abf9-722183223317 req-f3f6b041-63f2-409a-9e71-10531589a763 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.484466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a87cbcc-0c70-4119-abf9-722183223317 req-f3f6b041-63f2-409a-9e71-10531589a763 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.502462 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8a87cbcc-0c70-4119-abf9-722183223317 req-f3f6b041-63f2-409a-9e71-10531589a763 service nova] Creating event network-changed:175edd8d-0b34-4f3e-9762-68390802471d for instance a88d8eec-fccf-451e-91af-95d09426c4ce on n-h1-828148-1 Mar 29 02:22:18.509040 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8a87cbcc-0c70-4119-abf9-722183223317 req-f3f6b041-63f2-409a-9e71-10531589a763 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043857 Mar 29 02:22:18.510577 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1612/3032] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:18.516401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:18.517302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:18.526508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.527175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.528653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.529312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.662923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:18.680867 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-384f9512-dcf1-4f45-b9cd-8f465c3d2e62 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.604916 Mar 29 02:22:18.681598 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1421/3033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:18 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:18.686622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a395da89-d7af-4d25-b22a-e33bb0636537 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:18.758298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_groups [None req-a395da89-d7af-4d25-b22a-e33bb0636537 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Querying cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) for 2 instances {{(pid=103514) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Mar 29 02:22:18.760904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a395da89-d7af-4d25-b22a-e33bb0636537 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.761383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a395da89-d7af-4d25-b22a-e33bb0636537 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.831998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a395da89-d7af-4d25-b22a-e33bb0636537 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/00b1ed25-5174-4132-a26b-80eeebe4f451" status: 200 len: 264 microversion: 2.1 time: 0.147250 Mar 29 02:22:18.837308 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1422/3034] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:22:18 2022] GET /compute/v2.1/os-server-groups/00b1ed25-5174-4132-a26b-80eeebe4f451 => generated 264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:18.843415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:18.845224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:18.863151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.864232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.865330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:18.865958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:18.963915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:22:19.202845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:19.218119 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f81ee56-7553-4ad7-8668-638d95619245 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1789 microversion: 2.1 time: 0.706575 Mar 29 02:22:19.219009 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1613/3035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:18 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1789 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:19.223208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-10f88d5b-6d8c-4f71-a67c-b393ee30a993 req-d0a51e75-44c8-407a-9844-9664604d3f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-deleted", "tag": "0a804ae2-f197-428c-85f0-c28a4ec12fa6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:19.227306 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:19.227306 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:19.249215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-10f88d5b-6d8c-4f71-a67c-b393ee30a993 req-d0a51e75-44c8-407a-9844-9664604d3f03 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:19.251090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-10f88d5b-6d8c-4f71-a67c-b393ee30a993 req-d0a51e75-44c8-407a-9844-9664604d3f03 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:19.296136 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-10f88d5b-6d8c-4f71-a67c-b393ee30a993 req-d0a51e75-44c8-407a-9844-9664604d3f03 service nova] Creating event network-vif-deleted:0a804ae2-f197-428c-85f0-c28a4ec12fa6 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:19.302419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-10f88d5b-6d8c-4f71-a67c-b393ee30a993 req-d0a51e75-44c8-407a-9844-9664604d3f03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082345 Mar 29 02:22:19.305858 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1614/3036] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:19.317012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:19.323934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:19.335243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:19.336154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:19.336486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:19.349195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:19.422147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a52caeb-83a9-4834-b67f-5085f746a9aa tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 204 len: 0 microversion: 2.32 time: 0.583410 Mar 29 02:22:19.423370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1423/3037] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:22:18 2022] DELETE /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:22:19.429207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:19.430229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:19.438773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:19.439576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:19.440576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:19.441303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:20.146531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa075e90-cfe9-4022-bab3-e5e0dbf6f174 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1620 microversion: 2.1 time: 0.839404 Mar 29 02:22:20.156960 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1615/3038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:19 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1620 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:20.156960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:20.156960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:20.164970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:20.165424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:20.166569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:20.167006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:20.458915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:20.488045 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce42b341-2e73-49ac-aa4c-7cf481f3f32b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 1.061756 Mar 29 02:22:20.502514 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1424/3039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:19 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:20.508270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:20.509052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:20.518097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:20.525279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:20.536101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:20.536608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:20.956950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:20.977052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:20.979847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:20.979847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51e9bcc7-5c85-4a05-b10d-054371adf407 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2956 microversion: 2.32 time: 0.830176 Mar 29 02:22:20.993340 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1616/3040] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:20 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2956 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:20.998844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:21.000756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:21.014150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.014858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.015817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.016400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.468187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:21.479635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4dad9533-4f9f-4da6-b49d-b16eee2da287 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.975246 Mar 29 02:22:21.486388 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1425/3041] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:20 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:21.494190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:21.496396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:21.511041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dda95f30-1130-4c76-bccd-fd1491e71c93 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c" status: 200 len: 1620 microversion: 2.1 time: 0.516127 Mar 29 02:22:21.513959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.514457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.515397 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1617/3042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:20 2022] GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c => generated 1620 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:21.520333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2e748b10-9d9e-4497-883e-6bdd7a72a319 req-9795ab68-29d8-447b-8c06-3f884686f6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3aa2f3-0ae2-4a47-91e6-352b1d1308df", "name": "network-vif-plugged", "status": "completed", "tag": "12694fe8-e9b2-4f21-abde-c0d8354a4a3c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:21.530823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.532100 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:21.532100 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:21.533380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.547530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2e748b10-9d9e-4497-883e-6bdd7a72a319 req-9795ab68-29d8-447b-8c06-3f884686f6f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.549282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2e748b10-9d9e-4497-883e-6bdd7a72a319 req-9795ab68-29d8-447b-8c06-3f884686f6f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.574784 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2e748b10-9d9e-4497-883e-6bdd7a72a319 req-9795ab68-29d8-447b-8c06-3f884686f6f3 service nova] Creating event network-vif-plugged:12694fe8-e9b2-4f21-abde-c0d8354a4a3c for instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df on n-h1-828148-1 Mar 29 02:22:21.586226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2e748b10-9d9e-4497-883e-6bdd7a72a319 req-9795ab68-29d8-447b-8c06-3f884686f6f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068909 Mar 29 02:22:21.587556 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1618/3043] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:21.594904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9fe35696-767d-4ad8-a83d-b173bdb68f9a req-171b95e2-f69f-40c8-99a1-21a5b6fc0936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-deleted", "tag": "3e3dfe60-0670-4352-bb20-41dfa90fe33c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:21.597071 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:21.597071 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:21.608309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9fe35696-767d-4ad8-a83d-b173bdb68f9a req-171b95e2-f69f-40c8-99a1-21a5b6fc0936 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.609631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9fe35696-767d-4ad8-a83d-b173bdb68f9a req-171b95e2-f69f-40c8-99a1-21a5b6fc0936 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.632035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9fe35696-767d-4ad8-a83d-b173bdb68f9a req-171b95e2-f69f-40c8-99a1-21a5b6fc0936 service nova] Creating event network-vif-deleted:3e3dfe60-0670-4352-bb20-41dfa90fe33c for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:21.637565 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9fe35696-767d-4ad8-a83d-b173bdb68f9a req-171b95e2-f69f-40c8-99a1-21a5b6fc0936 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048126 Mar 29 02:22:21.651591 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1619/3044] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:21.658673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:21.659708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:21.669996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.671209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:21.672726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:21.673349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:22.368511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:22.381073 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56e9149f-4125-4208-98ae-6671701f9d8a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.727741 Mar 29 02:22:22.382480 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1620/3045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:21 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:22.394203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: .version_select at 0x7f8717ed65e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1223955426", "policies": ["anti-affinity"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:22.422588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:22.430810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:22.494331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:22.510336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-85a6707a-0c44-4c7b-a247-4093b2d36a8f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 200 len: 1654 microversion: 2.1 time: 1.022336 Mar 29 02:22:22.510850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1426/3046] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:21 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 1654 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:22.530502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:22.531128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:22.554642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:22.555161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:22.558340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:22.561301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:22.661993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:22.685113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:22.723491 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-84abfc58-2f89-4ebd-8dd8-e79a3bf3d28b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.339843 Mar 29 02:22:22.724756 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1621/3047] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Mar 29 02:22:22 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:22.733151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:22.736476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:22.745322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:22.746300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:22.747526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:22.748350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:23.294315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:23.305394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:23.307187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:23.309362 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0b1f2b0-f3be-457e-b13e-4652538ec8da tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2956 microversion: 2.32 time: 0.791356 Mar 29 02:22:23.317119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:23.323278 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1427/3048] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:22 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2956 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:23.333733 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce144469-8cae-4ef1-a986-7a00f86b87f4 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1403 microversion: 2.1 time: 0.606781 Mar 29 02:22:23.334590 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1622/3049] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:22 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1403 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:23.336564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1119052740", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9b986077-cdc0-4840-bc30-7dcb2a9972ee"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:23.401695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:23.406486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:23.413396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:23.414090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:23.415839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:23.416432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:23.434490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:23.986014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:22:23.986701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:22:23.987950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:22:23.988245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:22:23.988767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:22:24.009457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.010321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.011226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.011901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.032433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:24.042092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:24.072337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 2 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:22:24.075608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:24.338386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=103514) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Mar 29 02:22:24.375013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:24.381402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:24.475383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:24.485377 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e80a38d-83a7-4296-a078-cf17f064504b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 1.089979 Mar 29 02:22:24.489854 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1623/3050] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:23 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:24.498103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:24.504282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:24.517046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.517722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.518718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.519302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.530418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:24.545627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:24.578494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. Mar 29 02:22:24.579394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:24.580430 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c4527b1-2590-4d2a-9604-5438d613d6a7 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 404 len: 111 microversion: 2.1 time: 0.089400 Mar 29 02:22:24.581574 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1624/3051] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:24 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:24.586631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-bf31c55a-419d-4159-9011-9085af91ce53 req-aba2bdda-45ae-4e33-af9c-e0affbefca8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755b4b67-445d-4e8b-91ba-22f4d7052de6", "name": "network-vif-deleted", "tag": "00790bdb-0d71-439a-ba86-8fc5bfc14e40"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:24.588612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=6f414f7b-6392-47fd-9fb5-0728104e2e78,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:24.589357 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:24.589357 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:24.598448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bf31c55a-419d-4159-9011-9085af91ce53 req-aba2bdda-45ae-4e33-af9c-e0affbefca8f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.606141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-bf31c55a-419d-4159-9011-9085af91ce53 req-aba2bdda-45ae-4e33-af9c-e0affbefca8f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.618771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-bf31c55a-419d-4159-9011-9085af91ce53 req-aba2bdda-45ae-4e33-af9c-e0affbefca8f service nova] Creating event network-vif-deleted:00790bdb-0d71-439a-ba86-8fc5bfc14e40 for instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 on n-h2-828148-1 Mar 29 02:22:24.625466 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-bf31c55a-419d-4159-9011-9085af91ce53 req-aba2bdda-45ae-4e33-af9c-e0affbefca8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042294 Mar 29 02:22:24.626060 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1625/3052] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:24.631718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:24.635046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:24.644686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.645178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.645958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:24.646384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:24.878959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:24.890736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:25.078671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:25.089475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'server_group_members'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:25.141462 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-00e7716d-6325-4679-8d14-bd87cfcd7ba8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.816404 Mar 29 02:22:25.144903 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1428/3053] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1821 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 29 02:22:25.154241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:25.154948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:25.171258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.177340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.178270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.182089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.461816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:25.473983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:25.475564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:25.477567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e202e064-64d3-430f-88ce-d545f8bfa160 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2935 microversion: 2.32 time: 0.850421 Mar 29 02:22:25.478613 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1626/3054] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:24 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2935 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:25.491533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:25.492282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:25.501817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.502520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.503968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.504768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.569068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. Mar 29 02:22:25.569940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:25.571081 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f20581d3-1602-4ed2-b783-38886c7d20cd tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 404 len: 111 microversion: 2.1 time: 0.091117 Mar 29 02:22:25.572111 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1627/3055] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:22:25 2022] DELETE /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:25.577634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8deeea48-3a12-483f-bd65-21e7c4a6ed4c req-d71e185b-d29d-4104-bc38-d2f17dbbcd33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-unplugged", "status": "completed", "tag": "69740a4c-20a8-4f28-90fa-dcfaf5563c5b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:25.579887 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:25.579887 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:25.589438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8deeea48-3a12-483f-bd65-21e7c4a6ed4c req-d71e185b-d29d-4104-bc38-d2f17dbbcd33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.590109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8deeea48-3a12-483f-bd65-21e7c4a6ed4c req-d71e185b-d29d-4104-bc38-d2f17dbbcd33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.617755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8deeea48-3a12-483f-bd65-21e7c4a6ed4c req-d71e185b-d29d-4104-bc38-d2f17dbbcd33 service nova] Creating event network-vif-unplugged:69740a4c-20a8-4f28-90fa-dcfaf5563c5b for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:25.624114 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8deeea48-3a12-483f-bd65-21e7c4a6ed4c req-d71e185b-d29d-4104-bc38-d2f17dbbcd33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050533 Mar 29 02:22:25.625099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1628/3056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:25.631217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:25.634432 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:25.634432 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:25.635419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:25.636149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Searching by: {'deleted': False, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:22:25.654323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.654788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.655582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.656009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.962422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:25.965385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ea27831-9564-45e4-b668-ca77386b6358 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1591 microversion: 2.1 time: 0.731863 Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1429/3057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:25 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1591 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:25.966122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.015584 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9873211c-5fce-4f42-a928-83c921664202 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.389102 Mar 29 02:22:26.016539 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1629/3058] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:22:25 2022] GET /compute/v2.1/servers => generated 1665 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:26.021866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:26.022766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: bc334912-d1f4-4de6-b1e3-df37062ffc27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:26.031473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.034924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.034924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.034924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.097415 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. Mar 29 02:22:26.098034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance bc334912-d1f4-4de6-b1e3-df37062ffc27 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:26.098859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-35cba654-3f1d-4d7f-883d-102017466d2a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27" status: 404 len: 111 microversion: 2.1 time: 0.081303 Mar 29 02:22:26.099770 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1630/3059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:26 2022] GET /compute/v2.1/servers/bc334912-d1f4-4de6-b1e3-df37062ffc27 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:26.104718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:26.105240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:26.123419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.123668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.124698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.125163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.372068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1da043a9-cdb5-4e67-ab57-b0860c9577cd tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271109 Mar 29 02:22:26.372950 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1631/3060] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:22:26 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:26.379530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80b48a57-d545-4cc3-8eb4-1fd93e6c8508 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:26.381529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80b48a57-d545-4cc3-8eb4-1fd93e6c8508 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:26.560425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80b48a57-d545-4cc3-8eb4-1fd93e6c8508 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:26.576223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80b48a57-d545-4cc3-8eb4-1fd93e6c8508 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1219 microversion: 2.1 time: 0.200767 Mar 29 02:22:26.579419 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1632/3061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:26 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1219 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:26.590051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:26.602594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:26.607765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.608931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.609926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.610505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.623966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:26.635075 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9b4f078c-2cb7-45a2-8b21-7fd12403da3e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.754467 Mar 29 02:22:26.635662 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1430/3062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:25 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:26.639970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:26.640584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:26.672186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.672641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.689850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:26.690836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:26.708662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:22:27.106596 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65aaf407-f575-43a5-8921-2af7575c16e0 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "DELETE /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 204 len: 0 microversion: 2.1 time: 0.525782 Mar 29 02:22:27.108751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1633/3063] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:22:26 2022] DELETE /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:22:27.119295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:27.120430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:27.134785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.138009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:27.141379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.142895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:27.827410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:27.838959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:27.840512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:27.841735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63237766-dee0-405c-a9be-65a02b2fda11 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2914 microversion: 2.32 time: 1.205138 Mar 29 02:22:27.842597 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1431/3064] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:26 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2914 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:27.847762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:27.848390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:27.855800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.856473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:27.857127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.857549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:27.915825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:27.926182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d366539b-2583-43e6-92c0-355be3676a0b tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 0.812895 Mar 29 02:22:27.936769 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1634/3065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:27 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:27.950350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:27.953794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:27.969517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.970020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:27.970799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:27.971263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:28.010104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:28.022639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f195cac8-bf35-4705-ac24-26562be478bf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1223 microversion: 2.1 time: 0.178363 Mar 29 02:22:28.023368 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1432/3066] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:27 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:28.029682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-unplugged", "status": "completed", "tag": "7aeea8a6-cd6f-4214-8003-4d69af2e4528"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-unplugged", "status": "completed", "tag": "a390c429-528d-446a-8b2f-5aff166b3a60"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-unplugged", "status": "completed", "tag": "17bfdecc-f15d-409d-afb7-2f1f77be3567"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:28.032258 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:28.032258 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:28.043542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:28.044810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:28.069149 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Creating event network-vif-unplugged:7aeea8a6-cd6f-4214-8003-4d69af2e4528 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:28.070277 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Creating event network-vif-unplugged:a390c429-528d-446a-8b2f-5aff166b3a60 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:28.071479 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] Creating event network-vif-unplugged:17bfdecc-f15d-409d-afb7-2f1f77be3567 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:28.077618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3fb8655b-f878-4a45-9320-019387be15a7 req-6cb07014-2b0a-484b-97e5-b7c334c41b11 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.052653 Mar 29 02:22:28.079014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1433/3067] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:28.522091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:28.546553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-567c54de-0fc1-43e8-89e6-f42ee07ae4b6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.610328 Mar 29 02:22:28.547237 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1635/3068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:27 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:28.868081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:28.868771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:28.883357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:28.883357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:28.883357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:28.883357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:28.952579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:28.954150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:28.974528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:28.975148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:28.976041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:28.976785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:29.962615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:29.976048 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-35cedd43-a7e8-434e-aced-d1bb27f28d9a tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1512 microversion: 2.1 time: 1.027003 Mar 29 02:22:29.987920 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1636/3069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:28 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1512 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:29.993289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:29.997241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:30.004163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.004879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.005884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.006517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.049170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:30.071930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:30.075739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:30.080762 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86e704cf-9d58-4f0c-9642-f709320040b3 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2914 microversion: 2.32 time: 1.218442 Mar 29 02:22:30.093064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1434/3070] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:28 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2914 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:30.093064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:30.093788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:30.107791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.108435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.109501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.110114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.215991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:30.224746 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-527517b3-6adf-4a64-a4ef-3a338ef40c03 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1277 microversion: 2.1 time: 0.235383 Mar 29 02:22:30.235274 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1637/3071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:29 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:30.240290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-736d80f9-25bf-4071-b555-a6b3ca70176a req-780813bd-81b9-4769-a602-6815d62490bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3aa2f3-0ae2-4a47-91e6-352b1d1308df", "tag": "12694fe8-e9b2-4f21-abde-c0d8354a4a3c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:30.242158 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:30.242158 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:30.251382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-736d80f9-25bf-4071-b555-a6b3ca70176a req-780813bd-81b9-4769-a602-6815d62490bb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.254563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-736d80f9-25bf-4071-b555-a6b3ca70176a req-780813bd-81b9-4769-a602-6815d62490bb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.269984 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-736d80f9-25bf-4071-b555-a6b3ca70176a req-780813bd-81b9-4769-a602-6815d62490bb service nova] Creating event network-changed:12694fe8-e9b2-4f21-abde-c0d8354a4a3c for instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df on n-h1-828148-1 Mar 29 02:22:30.275466 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-736d80f9-25bf-4071-b555-a6b3ca70176a req-780813bd-81b9-4769-a602-6815d62490bb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038724 Mar 29 02:22:30.276578 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1638/3072] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:30.281892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:30.283087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:30.291166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.291874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.293418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.294019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.834305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:30.843431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a6bb86c-740d-4164-83d8-d18f0cf70589 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1591 microversion: 2.1 time: 0.760581 Mar 29 02:22:30.869385 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1435/3073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:30 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1591 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:30.874609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-unplugged", "status": "completed", "tag": "f513d80e-5a27-42e8-94fa-8a78a33d2a64"}, {"server_uuid": "a88d8eec-fccf-451e-91af-95d09426c4ce", "name": "network-vif-plugged", "status": "completed", "tag": "175edd8d-0b34-4f3e-9762-68390802471d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:30.876544 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:30.876544 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:30.886670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.887516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.911931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] Creating event network-vif-unplugged:f513d80e-5a27-42e8-94fa-8a78a33d2a64 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:30.913005 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] Creating event network-vif-plugged:175edd8d-0b34-4f3e-9762-68390802471d for instance a88d8eec-fccf-451e-91af-95d09426c4ce on n-h1-828148-1 Mar 29 02:22:30.920871 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b51f4496-13ae-4120-8398-433449bc5592 req-d3419902-7821-41be-aeb5-784cd9a77a74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049868 Mar 29 02:22:30.921678 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1436/3074] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:30.931950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c720bb4b-b6bb-41c6-bb41-57efed97b4c2 req-a39b35b0-1c4d-4e28-86e2-085eaf26bf8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-deleted", "tag": "17bfdecc-f15d-409d-afb7-2f1f77be3567"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:30.934332 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:30.934332 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:30.945280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c720bb4b-b6bb-41c6-bb41-57efed97b4c2 req-a39b35b0-1c4d-4e28-86e2-085eaf26bf8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:30.945911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c720bb4b-b6bb-41c6-bb41-57efed97b4c2 req-a39b35b0-1c4d-4e28-86e2-085eaf26bf8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:30.966482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c720bb4b-b6bb-41c6-bb41-57efed97b4c2 req-a39b35b0-1c4d-4e28-86e2-085eaf26bf8d service nova] Creating event network-vif-deleted:17bfdecc-f15d-409d-afb7-2f1f77be3567 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:30.973065 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c720bb4b-b6bb-41c6-bb41-57efed97b4c2 req-a39b35b0-1c4d-4e28-86e2-085eaf26bf8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045539 Mar 29 02:22:30.975227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1437/3075] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:30.996827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:30.998298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:31.007063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.008066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.009094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.009684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.102721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.107782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-278b9445-3664-4a1e-b96b-3b174a3223e3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 0.829638 Mar 29 02:22:31.108987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1639/3076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:30 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:31.113934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:31.114686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:31.124199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.124923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.126043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.126628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.426136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.438587 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d08ba7c-1517-42cd-9d68-6383a5e7e532 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1470 microversion: 2.1 time: 0.447233 Mar 29 02:22:31.450756 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1438/3077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:30 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1470 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:31.456393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:31.461939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:31.466752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.467387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.468462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:31.469090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:31.737154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.755457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b653c3e-25b5-4c70-a3c3-0ab6b5b42346 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1277 microversion: 2.1 time: 0.303247 Mar 29 02:22:31.760238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1439/3078] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:31 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1277 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:31.777923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.788371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.789896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:31.791143 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6402221c-3dd4-41cd-a782-501ed73cd71f tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2754 microversion: 2.32 time: 0.680718 Mar 29 02:22:31.791673 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1640/3079] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:31 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2754 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:32.124808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:32.125664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:32.136231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.136684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.137552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.137994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.329320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-12afc4bd-6ba8-4c33-908c-11ee2aebc2f3 req-1f19ae6b-3589-40f4-9bec-0963c6265e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fccd9e-363a-446e-8b19-eb469eee1129", "name": "network-vif-deleted", "tag": "5faa6732-f151-4e2d-ae92-94ace19df2b9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:32.331053 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:32.331053 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:32.339945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-12afc4bd-6ba8-4c33-908c-11ee2aebc2f3 req-1f19ae6b-3589-40f4-9bec-0963c6265e39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.340708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-12afc4bd-6ba8-4c33-908c-11ee2aebc2f3 req-1f19ae6b-3589-40f4-9bec-0963c6265e39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.368597 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-12afc4bd-6ba8-4c33-908c-11ee2aebc2f3 req-1f19ae6b-3589-40f4-9bec-0963c6265e39 service nova] Creating event network-vif-deleted:5faa6732-f151-4e2d-ae92-94ace19df2b9 for instance 18fccd9e-363a-446e-8b19-eb469eee1129 on n-h2-828148-1 Mar 29 02:22:32.376187 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-12afc4bd-6ba8-4c33-908c-11ee2aebc2f3 req-1f19ae6b-3589-40f4-9bec-0963c6265e39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050462 Mar 29 02:22:32.377766 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1641/3080] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:32.459501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:32.460743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:32.474654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.475034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.475820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.476262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.545515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.545966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.546420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lazy-loading 'fault' on Instance uuid 18fccd9e-363a-446e-8b19-eb469eee1129 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:22:32.687618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e5bfd6ac15433cb4a2c5a7a7baf151', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9259b000e39e4a079e12cdec39b1c31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:32.696636 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c9d361f-5651-4f51-a127-2dff0916912d tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 200 len: 1306 microversion: 2.1 time: 0.244628 Mar 29 02:22:32.697227 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1642/3081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:32 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 1306 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:32.776684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:32.777368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:32.785605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.786177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.786945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:32.787452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:32.990598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:32.998541 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f575209c-6a28-45dd-8f0e-ce74414dd6cf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1277 microversion: 2.1 time: 0.225730 Mar 29 02:22:32.999090 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1643/3082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:32 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:33.003696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:33.004805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:33.012313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:33.012757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:33.013565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:33.013994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:33.363514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:33.373255 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23dec4ba-56fa-49b2-ac95-365829a7b685 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1315 microversion: 2.1 time: 1.252233 Mar 29 02:22:33.374182 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1440/3083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:32 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1315 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:33.420192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:33.430516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:33.432346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:33.433746 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9badc311-20ad-46d6-ba8e-90537e3c4262 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2754 microversion: 2.32 time: 0.433717 Mar 29 02:22:33.434289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1644/3084] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:32 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2754 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:33.714987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:33.715685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] [instance: 18fccd9e-363a-446e-8b19-eb469eee1129] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:33.721961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-009e08e0-7096-439a-bd85-9ee059a55785 req-41a72816-1351-4dc7-a7e0-00f3a1e780f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-deleted", "tag": "a390c429-528d-446a-8b2f-5aff166b3a60"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:33.727419 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:33.727419 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:33.735577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:33.736032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:33.747827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:33.750387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:33.755178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-009e08e0-7096-439a-bd85-9ee059a55785 req-41a72816-1351-4dc7-a7e0-00f3a1e780f0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:33.758861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-009e08e0-7096-439a-bd85-9ee059a55785 req-41a72816-1351-4dc7-a7e0-00f3a1e780f0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:33.814329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-009e08e0-7096-439a-bd85-9ee059a55785 req-41a72816-1351-4dc7-a7e0-00f3a1e780f0 service nova] Creating event network-vif-deleted:a390c429-528d-446a-8b2f-5aff166b3a60 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:33.838888 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-009e08e0-7096-439a-bd85-9ee059a55785 req-41a72816-1351-4dc7-a7e0-00f3a1e780f0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112459 Mar 29 02:22:33.839988 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1645/3085] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:33.889139 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] HTTP exception thrown: Instance 18fccd9e-363a-446e-8b19-eb469eee1129 could not be found. Mar 29 02:22:33.894569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] Returning 404 to user: Instance 18fccd9e-363a-446e-8b19-eb469eee1129 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:33.895825 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a37722e6-8c9a-441d-bd06-8a9de70b61f3 tempest-ServersNegativeTestJSON-1876619171 tempest-ServersNegativeTestJSON-1876619171-project] 10.222.0.36 "GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129" status: 404 len: 111 microversion: 2.1 time: 0.184797 Mar 29 02:22:33.901660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1441/3086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:33 2022] GET /compute/v2.1/servers/18fccd9e-363a-446e-8b19-eb469eee1129 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:34.016256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:34.017009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:34.029788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.030247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:34.031022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.031448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:34.390981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:34.391629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:34.406229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.406887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:34.407819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.408399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:34.780742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:34.793545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42465476-e2ea-4fce-a736-93560ed66211 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.781419 Mar 29 02:22:34.795008 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1646/3087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:34 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:34.804995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:34.806041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:34.818237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.819508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:34.820512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:34.821755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:35.620092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:35.637726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:35.639932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:35.641713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e04504cc-03be-4201-a934-bbad43c23d7d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2593 microversion: 2.32 time: 0.844776 Mar 29 02:22:35.642798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1647/3088] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:34 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2593 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:35.779646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:35.797146 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9022663a-88f1-45f3-b730-feecf31c15cb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1502 microversion: 2.1 time: 1.409942 Mar 29 02:22:35.808549 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1442/3089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:34 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1502 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:35.812916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:35.813618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:35.832974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:35.833429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:35.834266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:35.834706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:35.836233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-167491615", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:35.946291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:37.034157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:22:37.034786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:22:37.035068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:22:37.035828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:22:37.036222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:22:37.046728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.047182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.048114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.048407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.069653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:37.076603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:37.093184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:22:37.095953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:37.159671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:37.169527 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba5bee38-c7f3-4a20-85d8-c343d68b266c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 1.361756 Mar 29 02:22:37.179401 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1443/3090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:35 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:37.184431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:37.185118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:37.193100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.193553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.194327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.194762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.216189 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-471903d3-82f8-4379-8fae-50685057a231 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571489 Mar 29 02:22:37.222833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1648/3091] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:22:37.229327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4efbdd44-8108-44f2-bcd2-9862847dbe58 req-65833410-f457-4f65-9b95-cc1c9c29f0cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f414f7b-6392-47fd-9fb5-0728104e2e78", "tag": "7373f9f8-fca1-4609-a765-76aa5df00902"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:37.231350 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:37.231350 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:37.254302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4efbdd44-8108-44f2-bcd2-9862847dbe58 req-65833410-f457-4f65-9b95-cc1c9c29f0cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.255294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4efbdd44-8108-44f2-bcd2-9862847dbe58 req-65833410-f457-4f65-9b95-cc1c9c29f0cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.275940 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4efbdd44-8108-44f2-bcd2-9862847dbe58 req-65833410-f457-4f65-9b95-cc1c9c29f0cb service nova] Creating event network-changed:7373f9f8-fca1-4609-a765-76aa5df00902 for instance 6f414f7b-6392-47fd-9fb5-0728104e2e78 on n-h2-828148-1 Mar 29 02:22:37.281057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4efbdd44-8108-44f2-bcd2-9862847dbe58 req-65833410-f457-4f65-9b95-cc1c9c29f0cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056659 Mar 29 02:22:37.282463 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1649/3092] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:37.288386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:37.289351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:37.299712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.308023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.308023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.308023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.634926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f332dd0-6161-435a-b600-2ddebe1c8840 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce/action" status: 202 len: 0 microversion: 2.1 time: 0.453928 Mar 29 02:22:37.636348 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1444/3093] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:37 2022] POST /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:22:37.671285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e44f22b-3f43-4346-9827-4e0576911f99 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:37.675369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e44f22b-3f43-4346-9827-4e0576911f99 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:37.894055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:37.913244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:37.918544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:37.921416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3edad448-448c-4dbd-b3fb-b8654ed32e70 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2546 microversion: 2.32 time: 0.637523 Mar 29 02:22:37.923755 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1650/3094] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:37 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2546 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:37.934477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:37.935112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:37.957439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.957889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:37.959351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:37.963306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:38.051911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e44f22b-3f43-4346-9827-4e0576911f99 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:38.062761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e44f22b-3f43-4346-9827-4e0576911f99 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1192 microversion: 2.1 time: 0.424814 Mar 29 02:22:38.071705 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1445/3095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:37 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1192 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:38.080612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e5cec1a1-c8b5-4929-bd49-f64e8cf06133 req-093ba982-dc15-46dd-a14d-48f8cb5f9488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-deleted", "tag": "f513d80e-5a27-42e8-94fa-8a78a33d2a64"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:38.096399 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:38.096399 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:38.111219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e5cec1a1-c8b5-4929-bd49-f64e8cf06133 req-093ba982-dc15-46dd-a14d-48f8cb5f9488 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:38.117261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e5cec1a1-c8b5-4929-bd49-f64e8cf06133 req-093ba982-dc15-46dd-a14d-48f8cb5f9488 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:38.144689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e5cec1a1-c8b5-4929-bd49-f64e8cf06133 req-093ba982-dc15-46dd-a14d-48f8cb5f9488 service nova] Creating event network-vif-deleted:f513d80e-5a27-42e8-94fa-8a78a33d2a64 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:38.159091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e5cec1a1-c8b5-4929-bd49-f64e8cf06133 req-093ba982-dc15-46dd-a14d-48f8cb5f9488 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085786 Mar 29 02:22:38.166320 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1446/3096] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:38.187582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:38.188682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:38.202947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:38.203635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:38.209484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:38.210165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:38.707427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:38.718704 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-add22009-97b8-4293-8e1a-502cb14df399 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1507 microversion: 2.1 time: 0.793096 Mar 29 02:22:38.730861 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1651/3097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:37 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1507 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:38.943821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:38.944621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:38.952534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:38.953355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:38.956623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:38.958968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:39.356741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:39.369396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b226b8d8-6ef9-4387-ae29-a5628a52dbf2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 1.185023 Mar 29 02:22:39.369396 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1447/3098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:38 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:39.393392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:39.393392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:39.413730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:39.414804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:39.417820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:39.418841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:39.602595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:39.646399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffc88eb1-f5ce-43fb-a9aa-aaac77f1422b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1188 microversion: 2.1 time: 0.276028 Mar 29 02:22:39.661651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1448/3099] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:39 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:39.695930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:39.715556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:39.717102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:39.718313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a05f0bb-9579-4fa3-9121-bf10b38ca774 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2258 microversion: 2.32 time: 0.778297 Mar 29 02:22:39.718940 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1652/3100] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:38 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2258 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:39.740098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:39.741178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:39.758244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:39.758495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:39.759648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:39.760241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.203442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4873d387-bf57-4641-96cc-99305bd75c5a", "tag": "fd05a781-de17-477f-b6bf-feb3ac844297"}, {"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-deleted", "tag": "7aeea8a6-cd6f-4214-8003-4d69af2e4528"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:40.206369 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:40.206369 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:40.225852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:40.226389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.263546 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] Creating event network-changed:fd05a781-de17-477f-b6bf-feb3ac844297 for instance 4873d387-bf57-4641-96cc-99305bd75c5a on n-h1-828148-1 Mar 29 02:22:40.269364 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] Creating event network-vif-deleted:7aeea8a6-cd6f-4214-8003-4d69af2e4528 for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:40.279930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f82dfccd-cc4c-42c4-8180-79a289f44a58 req-f863c9eb-714a-4d64-bdac-87dcb9202b31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.079925 Mar 29 02:22:40.286390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1653/3101] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:40.386546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:40.387469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:40.402909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:40.406415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.409481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:40.413699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.604523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:40.623531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77274422-ffa1-45c8-9f84-ba8c5b1b5a15 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1487 microversion: 2.1 time: 0.891558 Mar 29 02:22:40.624500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1449/3102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:39 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1487 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:40.639863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:40.640635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:40.656212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:40.656978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.658983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:40.659580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:40.760176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lazy-loading 'flavor' on Instance uuid a88d8eec-fccf-451e-91af-95d09426c4ce {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:22:41.488700 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d831be5b-c9c6-46ff-ac34-8cf4c4be8cda tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce/action" status: 202 len: 0 microversion: 2.1 time: 0.852130 Mar 29 02:22:41.493132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1450/3103] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:22:40 2022] POST /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce/action => generated 0 bytes in 857 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:22:41.511713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:41.512918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:41.523404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:41.527141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:41.527141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:41.527141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:41.724639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:41.733348 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-545935cd-bf09-42af-b8df-bb609e659a31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 1.351285 Mar 29 02:22:41.734024 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1654/3104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:40 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:41.739222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:41.740044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:41.747780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:41.748238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:41.749037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:41.749467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:41.795783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:41.822125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-689a3f43-77c8-4461-8aa2-5ec35e90b399 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1250 microversion: 2.1 time: 0.314081 Mar 29 02:22:41.825942 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1451/3105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:41 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1250 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:42.033685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d57e8ae2-8bfd-4c7d-9f84-aa88ece3c550 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] Calling method '.version_select at 0x7f87241dc790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.112930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d57e8ae2-8bfd-4c7d-9f84-aa88ece3c550 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.285230 Mar 29 02:22:42.114885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1452/3106] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:22:41 2022] GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd/defaults => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:42.119596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.121151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:42.131134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:42.131386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:42.138579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:42.139041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:42.415587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:42.429443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:42.431283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:42.432771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b10a1283-8de6-443c-b418-e7831c3fbbb5 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2211 microversion: 2.32 time: 0.697637 Mar 29 02:22:42.433971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1655/3107] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:41 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2211 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:42.440289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d249fa1-f7a0-4fa6-8aa2-a1a201d4732b tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] Calling method '.version_select at 0x7f87240cfaf0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.535184 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d249fa1-f7a0-4fa6-8aa2-a1a201d4732b tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd" status: 200 len: 371 microversion: 2.1 time: 0.098163 Mar 29 02:22:42.535184 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1656/3108] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd => generated 371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:42.547057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0106a491-243d-48a6-8c9f-af4036315699 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] Calling method '.version_select at 0x7f8724b990d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.609890 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0106a491-243d-48a6-8c9f-af4036315699 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.066404 Mar 29 02:22:42.612928 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1657/3109] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd/defaults => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:42.635249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-69ecc3c2-bc1b-49c4-8dca-36ef3fabe269 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] Calling method '.version_select at 0x7f8724b99ee0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.739182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-69ecc3c2-bc1b-49c4-8dca-36ef3fabe269 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd" status: 200 len: 371 microversion: 2.1 time: 0.107826 Mar 29 02:22:42.740404 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1658/3110] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:42.745727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c5e6f68c-b4cf-48b3-a192-9a59a891a87b req-064100ca-b133-417d-8f0a-098609ecfe7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bb0fada-7203-4f8f-be58-93149c12eee1", "name": "network-vif-deleted", "tag": "69740a4c-20a8-4f28-90fa-dcfaf5563c5b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:42.747712 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:42.747712 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:42.757641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c5e6f68c-b4cf-48b3-a192-9a59a891a87b req-064100ca-b133-417d-8f0a-098609ecfe7d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:42.758229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c5e6f68c-b4cf-48b3-a192-9a59a891a87b req-064100ca-b133-417d-8f0a-098609ecfe7d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:42.777652 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c5e6f68c-b4cf-48b3-a192-9a59a891a87b req-064100ca-b133-417d-8f0a-098609ecfe7d service nova] Creating event network-vif-deleted:69740a4c-20a8-4f28-90fa-dcfaf5563c5b for instance 0bb0fada-7203-4f8f-be58-93149c12eee1 on n-h1-828148-1 Mar 29 02:22:42.791296 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c5e6f68c-b4cf-48b3-a192-9a59a891a87b req-064100ca-b133-417d-8f0a-098609ecfe7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043960 Mar 29 02:22:42.791296 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1659/3111] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:42.795915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b71d0999-7127-40c7-b18e-7b77ae04e414 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] Calling method '.version_select at 0x7f8724badb80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.917108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b71d0999-7127-40c7-b18e-7b77ae04e414 tempest-QuotasTestJSON-1013379436 tempest-QuotasTestJSON-1013379436-project] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd?user_id=7b574c15d7b541a8be282172f33e3bb3" status: 200 len: 371 microversion: 2.1 time: 0.127869 Mar 29 02:22:42.918299 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1660/3112] 10.222.0.36 () {58 vars in 1322 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/os-quota-sets/74134a2a8234403f9c00987e7366f3cd?user_id=7b574c15d7b541a8be282172f33e3bb3 => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:42.923751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:42.939579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:42.956364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:42.959149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:42.964684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:42.966229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:43.220770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:43.234656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8cdaf510-5a44-4db0-9b02-9675ea26b6fd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1493 microversion: 2.1 time: 1.118523 Mar 29 02:22:43.235218 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1453/3113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1493 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:43.240329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:43.241178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:43.254647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:43.255331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:43.260774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:43.260774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:43.827128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:43.842878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbcddf00-179f-4542-9145-be7ac2ba226f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.921731 Mar 29 02:22:43.843479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1661/3114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:42 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:43.867315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:43.871960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:43.889232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:43.894065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:43.895070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:43.895823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:44.166753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:44.181072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:44.184804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:44.190506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75fa99a7-cce5-424f-a103-df44e4554093 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1604 microversion: 2.32 time: 0.344636 Mar 29 02:22:44.191286 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1662/3115] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:43 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:44.225333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d11d4d65-d915-4399-baee-242b166fa147 req-be69ea53-568e-4d72-b2ef-fda7472e099b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f414f7b-6392-47fd-9fb5-0728104e2e78", "name": "network-vif-plugged", "status": "completed", "tag": "7373f9f8-fca1-4609-a765-76aa5df00902"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:44.230109 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:44.230109 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:44.257287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d11d4d65-d915-4399-baee-242b166fa147 req-be69ea53-568e-4d72-b2ef-fda7472e099b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:44.264527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d11d4d65-d915-4399-baee-242b166fa147 req-be69ea53-568e-4d72-b2ef-fda7472e099b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:44.291288 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d11d4d65-d915-4399-baee-242b166fa147 req-be69ea53-568e-4d72-b2ef-fda7472e099b service nova] Creating event network-vif-plugged:7373f9f8-fca1-4609-a765-76aa5df00902 for instance 6f414f7b-6392-47fd-9fb5-0728104e2e78 on n-h2-828148-1 Mar 29 02:22:44.303069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:44.309493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d11d4d65-d915-4399-baee-242b166fa147 req-be69ea53-568e-4d72-b2ef-fda7472e099b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088706 Mar 29 02:22:44.311378 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1663/3116] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:22:44.328425 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c397e3c6-92e2-44fd-82a8-404c598fa11d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 1.079579 Mar 29 02:22:44.328425 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1454/3117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:43 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:44.331454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:44.331454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:44.339725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:44.340387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:44.341384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:44.341970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:44.511100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1075683363", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "6cef30e5-ed34-4b01-b655-419acf1d77ab"}, {"uuid": "c804cf5f-5166-4702-85c8-214852269701"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:44.634524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] validate_networks() for [('6cef30e5-ed34-4b01-b655-419acf1d77ab', None, None, None), ('c804cf5f-5166-4702-85c8-214852269701', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:44.955550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:44.964407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-282f51fb-a6fd-4fa6-9bdd-36e30de929a0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1514 microversion: 2.1 time: 0.643745 Mar 29 02:22:44.965642 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1664/3118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:44 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:44.970898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:44.971658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:44.982332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:44.982332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:44.982332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:44.982707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:45.427947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:45.442548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bbe9b00a-4bcd-4158-8c14-8e46ca6f40d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.475355 Mar 29 02:22:45.445832 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1665/3119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:44 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:45.464477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:45.465615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:45.490615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:45.493351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:45.494429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:45.495022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:45.765100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:45.785662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:45.786174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:45.787579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-738aaef3-5015-4a7b-83e8-2c8a6fef6572 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 2029 microversion: 2.32 time: 0.340720 Mar 29 02:22:45.789925 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1666/3120] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:45 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 2029 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:45.802778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:45.820139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:45.830074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:45.832969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:45.833908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:45.835658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:46.394728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:22:46.399728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:22:46.399728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:22:46.399728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:22:46.399728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:22:46.414341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:46.415167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:46.418831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:46.419541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:46.467078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Getting quotas for project 4d93ba3926564c87b6059d8e20f556e1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:22:46.473969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Getting quotas for user 28a74618b933442cb404c2732a31d4c0 and project 4d93ba3926564c87b6059d8e20f556e1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:22:46.489846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:22:46.493141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:22:46.647241 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bfa467af-e616-412d-9197-ad1462938f85 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140598 Mar 29 02:22:46.655651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1455/3121] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:22:46.678142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:46.685392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:46.714230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:46.721592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:46.725060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:46.727346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.072515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.082308 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a398e9ae-d193-49ed-9de0-ed3e15f67d00 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1514 microversion: 2.1 time: 0.423299 Mar 29 02:22:47.083522 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1456/3122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:46 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1514 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:47.088376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cf504665-9727-4e2a-a3b7-6077f3feffbe req-4de2717d-0548-4d9c-aef5-4c3378d7a00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2337d514-cf06-40a1-9234-0cd27ead41f7", "tag": "457b5f5b-ce5f-4030-9a74-0ebf3133fce0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:47.090212 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:47.090212 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:47.099630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf504665-9727-4e2a-a3b7-6077f3feffbe req-4de2717d-0548-4d9c-aef5-4c3378d7a00f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.102150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf504665-9727-4e2a-a3b7-6077f3feffbe req-4de2717d-0548-4d9c-aef5-4c3378d7a00f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.121146 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cf504665-9727-4e2a-a3b7-6077f3feffbe req-4de2717d-0548-4d9c-aef5-4c3378d7a00f service nova] Creating event network-changed:457b5f5b-ce5f-4030-9a74-0ebf3133fce0 for instance 2337d514-cf06-40a1-9234-0cd27ead41f7 on n-h2-828148-1 Mar 29 02:22:47.128820 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cf504665-9727-4e2a-a3b7-6077f3feffbe req-4de2717d-0548-4d9c-aef5-4c3378d7a00f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043755 Mar 29 02:22:47.130746 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1457/3123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:47.135765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:47.136468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:47.144613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.145255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.146168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.146552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.187000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.202338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb2fb92a-25d4-499c-9494-f2b634aafdae tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 1.410460 Mar 29 02:22:47.203123 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1667/3124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:45 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:47.207805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f39f5b59-d24c-4ec4-86c2-654fe88024dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:47.214034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f39f5b59-d24c-4ec4-86c2-654fe88024dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:47.439047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.457196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b3abb99b-6de5-4bd2-bf65-0ad4bd4ebbda tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.315400 Mar 29 02:22:47.457934 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1458/3125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:47 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:47.470186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:47.471689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:47.481686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.482444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.483373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.484563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.499059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f39f5b59-d24c-4ec4-86c2-654fe88024dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.507259 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f39f5b59-d24c-4ec4-86c2-654fe88024dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1213 microversion: 2.1 time: 0.302741 Mar 29 02:22:47.509347 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1668/3126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:47 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1213 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:47.652470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:47.653537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:47.654488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lazy-loading 'fault' on Instance uuid 0bb0fada-7203-4f8f-be58-93149c12eee1 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:22:47.707202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5d26042-b960-413f-ab5c-283ff7cd6f60 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Action: 'create', calling method: .version_select at 0x7f8724b993a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2107881055", "metadata": {"Type": "work"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:47.708597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5d26042-b960-413f-ab5c-283ff7cd6f60 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:47.709500 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5d26042-b960-413f-ab5c-283ff7cd6f60 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.198620 Mar 29 02:22:47.716357 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1669/3127] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Mar 29 02:22:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:22:47.726395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ada0cb0-cceb-4ba4-a046-91f139a87e13 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Action: 'create', calling method: .version_select at 0x7f87241374c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2136631406", "metadata": {"Type": "work"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:47.727560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ada0cb0-cceb-4ba4-a046-91f139a87e13 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:47.728338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ada0cb0-cceb-4ba4-a046-91f139a87e13 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006469 Mar 29 02:22:47.728854 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1670/3128] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Mar 29 02:22:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:22:47.744607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87ee5185-ce6c-450c-92bc-4e580c64ef87 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Action: 'create', calling method: .version_select at 0x7f8724d0ee50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2129582168", "metadata": {"Type": "work"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:47.745822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87ee5185-ce6c-450c-92bc-4e580c64ef87 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:47.746609 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87ee5185-ce6c-450c-92bc-4e580c64ef87 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005852 Mar 29 02:22:47.757125 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1671/3129] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Mar 29 02:22:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:22:47.762421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f26a63c4-f086-4a6c-883c-16b8ec340c63 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Calling method '.version_select at 0x7f8724cf6700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:47.842410 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f26a63c4-f086-4a6c-883c-16b8ec340c63 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] HTTP exception thrown: Volume tempest-invalid-464607089 could not be found. Mar 29 02:22:47.843017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f26a63c4-f086-4a6c-883c-16b8ec340c63 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 404 to user: Volume tempest-invalid-464607089 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:47.843828 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f26a63c4-f086-4a6c-883c-16b8ec340c63 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-464607089" status: 404 len: 98 microversion: 2.1 time: 0.085655 Mar 29 02:22:47.844364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1672/3130] 10.222.0.36 () {58 vars in 1214 bytes} [Tue Mar 29 02:22:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-464607089 => generated 98 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:22:47.854075 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58256f40-d002-41f5-8abe-a1df655e3816 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003815 Mar 29 02:22:47.856137 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1673/3131] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Mar 29 02:22:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 29 02:22:47.866494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46580dc4-7d10-4a3b-b629-358abfcdbc63 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004452 Mar 29 02:22:47.881699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.891286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.894147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f44f15c99fa3407c8d95b7c99783b70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c614c9fa0e294c13b291d76d98e4e350', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:47.896161 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed4c1a35-0841-407d-b040-e53f0255121e tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 200 len: 1796 microversion: 2.32 time: 0.437205 Mar 29 02:22:47.896942 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1459/3133] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:47 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 1796 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:22:47.897390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1674/3133] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:22:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 29 02:22:47.902907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fcb4ab61-eb07-4095-bf48-73c488640b68 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Calling method '.version_select at 0x7f8717d579d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.018204 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fcb4ab61-eb07-4095-bf48-73c488640b68 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] HTTP exception thrown: Volume 8858bb37-7090-4804-bdd0-ae38e4e3f8c0 could not be found. Mar 29 02:22:48.019065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fcb4ab61-eb07-4095-bf48-73c488640b68 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 404 to user: Volume 8858bb37-7090-4804-bdd0-ae38e4e3f8c0 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:48.020149 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fcb4ab61-eb07-4095-bf48-73c488640b68 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/8858bb37-7090-4804-bdd0-ae38e4e3f8c0" status: 404 len: 109 microversion: 2.1 time: 0.121305 Mar 29 02:22:48.020881 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1460/3134] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:22:47 2022] DELETE /compute/v2.1/os-volumes/8858bb37-7090-4804-bdd0-ae38e4e3f8c0 => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:48.030688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fb3d629-819f-4f77-aed7-e888dc9dd260 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Calling method '.version_select at 0x7f87241724c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.101794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.103329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:48.117890 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-3fb3d629-819f-4f77-aed7-e888dc9dd260 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] HTTP exception thrown: Volume dcea8bd5-00fc-4690-b767-e22fc8d7c5c5 could not be found. Mar 29 02:22:48.118895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fb3d629-819f-4f77-aed7-e888dc9dd260 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] Returning 404 to user: Volume dcea8bd5-00fc-4690-b767-e22fc8d7c5c5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:48.119931 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fb3d629-819f-4f77-aed7-e888dc9dd260 tempest-VolumesNegativeTest-1016227419 tempest-VolumesNegativeTest-1016227419-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/dcea8bd5-00fc-4690-b767-e22fc8d7c5c5" status: 404 len: 109 microversion: 2.1 time: 0.093221 Mar 29 02:22:48.120072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.120629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.121408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1675/3135] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/os-volumes/dcea8bd5-00fc-4690-b767-e22fc8d7c5c5 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:22:48.122861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.125015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.219686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.220554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:48.245410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.246147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.249431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.250171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.450989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:48.462561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58d1fef6-db5e-4052-8c85-884f29f27e87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.366365 Mar 29 02:22:48.463576 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1461/3136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:48.474605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.475266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:48.483061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.483499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.484288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.484715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.846748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:48.859384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5b0da4c-3c71-43cd-b19d-15541468aa15 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.389101 Mar 29 02:22:48.859969 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1462/3137] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:48.874577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.876058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:48.888690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.889174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.890874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:48.894039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:48.938330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:48.959004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b64339d2-bc06-4b5d-a6ae-9a39541c7736 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 0.743508 Mar 29 02:22:48.971708 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1676/3138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:48.978056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:48.978758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:49.005513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.008396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.009315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.009751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.183146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] HTTP exception thrown: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. Mar 29 02:22:49.183762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Returning 404 to user: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:22:49.188790 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f1af8dd-95a1-4bdf-a892-3652c441a7ad tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 404 len: 111 microversion: 2.32 time: 0.213608 Mar 29 02:22:49.194413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1677/3139] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:22:49.203480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8a5bd251-8b76-4a3d-a7ee-e225c9455f90 req-500635bc-b791-49b7-b81c-bcf0040967c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88d8eec-fccf-451e-91af-95d09426c4ce", "name": "network-vif-plugged", "status": "completed", "tag": "175edd8d-0b34-4f3e-9762-68390802471d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:49.205759 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:49.205759 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:49.213192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:49.217683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a5bd251-8b76-4a3d-a7ee-e225c9455f90 req-500635bc-b791-49b7-b81c-bcf0040967c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.218125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a5bd251-8b76-4a3d-a7ee-e225c9455f90 req-500635bc-b791-49b7-b81c-bcf0040967c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.222225 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7048572-7bc5-4e36-b0b1-c8c6c31b2565 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1265 microversion: 2.1 time: 0.354981 Mar 29 02:22:49.230042 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1463/3140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:48 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:49.239089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41c3fe64-bfd8-4ef2-a979-a6ef51a6b8e8 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '.version_select at 0x7f8717f5c1f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:49.266844 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8a5bd251-8b76-4a3d-a7ee-e225c9455f90 req-500635bc-b791-49b7-b81c-bcf0040967c0 service nova] Creating event network-vif-plugged:175edd8d-0b34-4f3e-9762-68390802471d for instance a88d8eec-fccf-451e-91af-95d09426c4ce on n-h1-828148-1 Mar 29 02:22:49.283155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8a5bd251-8b76-4a3d-a7ee-e225c9455f90 req-500635bc-b791-49b7-b81c-bcf0040967c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087322 Mar 29 02:22:49.289119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1678/3141] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:49.341439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41c3fe64-bfd8-4ef2-a979-a6ef51a6b8e8 tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653102392" status: 204 len: 0 microversion: 2.32 time: 0.107541 Mar 29 02:22:49.342020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1464/3142] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Mar 29 02:22:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653102392 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:22:49.480431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:49.481513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:49.496210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.497188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.498375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.499029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.877480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:49.878815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:49.899689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.899689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:49.904401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:49.905120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:50.503570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:50.522662 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af7b16ff-f213-433f-a6ca-a417fdf36219 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 0.649467 Mar 29 02:22:50.523250 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1465/3143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:49 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:50.536146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:50.538369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:50.563088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:50.570231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:50.570684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:50.574856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:50.575812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df7c2fd2-9bc4-4b5a-ad35-35607f9bbc29 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 1.099642 Mar 29 02:22:50.577858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:50.584942 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1679/3144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:49 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:50.595645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:50.599573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:50.629378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:50.633598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:50.634594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:50.635188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:51.053570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:51.065195 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-352897df-0da0-4367-b3f9-6bdb02c7a50c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 0.540605 Mar 29 02:22:51.077010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1466/3145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:50 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:51.164362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:51.176799 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa7c641b-e317-47f4-83d1-2e46d8dc9e05 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1271 microversion: 2.1 time: 0.590659 Mar 29 02:22:51.181520 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1680/3146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:50 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1271 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:51.495215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-36453ba0-060d-4701-b095-38b04faf4682 req-480a47f3-d813-4f58-a1b7-8e853cff7d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4873d387-bf57-4641-96cc-99305bd75c5a", "name": "network-vif-plugged", "status": "completed", "tag": "fd05a781-de17-477f-b6bf-feb3ac844297"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:51.498063 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:51.498063 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:22:51.512774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-36453ba0-060d-4701-b095-38b04faf4682 req-480a47f3-d813-4f58-a1b7-8e853cff7d91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:51.513938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-36453ba0-060d-4701-b095-38b04faf4682 req-480a47f3-d813-4f58-a1b7-8e853cff7d91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:51.534493 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-36453ba0-060d-4701-b095-38b04faf4682 req-480a47f3-d813-4f58-a1b7-8e853cff7d91 service nova] Creating event network-vif-plugged:fd05a781-de17-477f-b6bf-feb3ac844297 for instance 4873d387-bf57-4641-96cc-99305bd75c5a on n-h1-828148-1 Mar 29 02:22:51.542087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:51.542710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:51.543895 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-36453ba0-060d-4701-b095-38b04faf4682 req-480a47f3-d813-4f58-a1b7-8e853cff7d91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053247 Mar 29 02:22:51.545992 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1467/3147] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:51.567414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:51.567982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:51.568693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:51.576124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:51.607837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:51.629134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:51.646893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:51.647393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:51.648469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:51.650651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:52.073206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:52.087689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aacd0bbe-5fbf-4a60-b6a7-7a4f5b69e1e4 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.498029 Mar 29 02:22:52.089651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1468/3148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:51 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:52.107715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:52.108723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:52.119999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:52.124057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:52.125370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:52.126149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:52.449940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:52.462822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aa1f2b5d-9c8d-44bb-808f-794e4d5132cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 0.371836 Mar 29 02:22:52.463950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1469/3149] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:52 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:52.468484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:52.469332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:52.478623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:52.480657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:52.485156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:52.486516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:52.558328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:52.567748 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-662fded5-e8fb-4ab7-a761-d0a0b5d8f91c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1319 microversion: 2.1 time: 1.029709 Mar 29 02:22:52.578776 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1681/3150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:51 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1319 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:52.693893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:52.705688 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16ae3c0f-70e5-4ae7-aa3b-1b5af83fb81a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1271 microversion: 2.1 time: 0.239831 Mar 29 02:22:52.706632 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1470/3151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:52 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:53.106260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:53.107032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:53.130323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.131046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:53.132084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.132750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:53.479523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:53.480153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:53.493220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.498162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:53.504705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.505521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:53.804343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:53.834734 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d0cbf6b-8c14-46fa-8b8b-b10bde701a9f tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.727217 Mar 29 02:22:53.835360 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1682/3152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:53 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:53.863111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:53.864371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:53.893811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.914655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:53.917250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:53.920189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.270932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:54.282879 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16bfac73-e31b-4db3-bf59-1046e9f61e28 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 0.807021 Mar 29 02:22:54.292217 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1471/3153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:53 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:54.298129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:54.298911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:54.308139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.308653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.309551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.310099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.344068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:54.358402 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29826475-661a-44fd-8660-6dc00e3637ab tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1468 microversion: 2.1 time: 0.519110 Mar 29 02:22:54.359786 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1683/3154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:53 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1468 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:54.364907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9c9553f4-2f5c-4d97-a116-b0918412d96e req-fb51c989-ed7c-40a6-96bc-340af3e06c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2337d514-cf06-40a1-9234-0cd27ead41f7", "name": "network-vif-plugged", "status": "completed", "tag": "457b5f5b-ce5f-4030-9a74-0ebf3133fce0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:54.370708 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:54.370708 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:54.375403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9c9553f4-2f5c-4d97-a116-b0918412d96e req-fb51c989-ed7c-40a6-96bc-340af3e06c92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.375883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9c9553f4-2f5c-4d97-a116-b0918412d96e req-fb51c989-ed7c-40a6-96bc-340af3e06c92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.411231 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9c9553f4-2f5c-4d97-a116-b0918412d96e req-fb51c989-ed7c-40a6-96bc-340af3e06c92 service nova] Creating event network-vif-plugged:457b5f5b-ce5f-4030-9a74-0ebf3133fce0 for instance 2337d514-cf06-40a1-9234-0cd27ead41f7 on n-h2-828148-1 Mar 29 02:22:54.428807 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9c9553f4-2f5c-4d97-a116-b0918412d96e req-fb51c989-ed7c-40a6-96bc-340af3e06c92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066613 Mar 29 02:22:54.429690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1684/3155] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:54.437337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:54.437881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:54.476202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.478040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.482492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.484666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.851101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:54.861992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62545581-2fe5-4c81-8959-e0e9be6668ac tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1313 microversion: 2.1 time: 0.575705 Mar 29 02:22:54.870333 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1472/3156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:54 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:54.875156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:54.876035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:54.885488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.886160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:54.887198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:54.887896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:55.190323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:55.199814 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b936cc3-b0d9-4138-b37d-a5658c096e2e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 200 len: 1468 microversion: 2.1 time: 0.767038 Mar 29 02:22:55.203655 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1685/3157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:54 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 1468 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:55.220497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:55.224343 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:22:55.224343 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:22:55.228387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:55.229439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Searching by: {'reservation_id': 'r-3fpyalxv', 'deleted': False, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:22:55.255590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:55.257472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:55.259131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:55.260772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:55.403386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:22:55.646527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:55.749525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:55.749525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:55.840506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d48d809f-292b-4470-bc0f-513eb5229402 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?reservation_id=r-3fpyalxv" status: 200 len: 2929 microversion: 2.1 time: 0.623806 Mar 29 02:22:55.848927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1686/3158] 10.222.0.36 () {58 vars in 1196 bytes} [Tue Mar 29 02:22:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-3fpyalxv => generated 2929 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:55.848927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:55.848927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:55.859782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:55.859782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:55.859782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:55.859782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.008190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:56.018745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dee41a5c-0d22-4d6f-8863-11a02db3b398 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 1.146976 Mar 29 02:22:56.022189 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1473/3159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:54 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:56.027898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4128f65-9e55-4f92-bb87-b23c64a77cff tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:56.076539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_groups [None req-b4128f65-9e55-4f92-bb87-b23c64a77cff tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Querying cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) for 2 instances {{(pid=103514) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Mar 29 02:22:56.077273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4128f65-9e55-4f92-bb87-b23c64a77cff tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:56.077727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4128f65-9e55-4f92-bb87-b23c64a77cff tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.143059 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4128f65-9e55-4f92-bb87-b23c64a77cff tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/9b986077-cdc0-4840-bc30-7dcb2a9972ee" status: 200 len: 271 microversion: 2.1 time: 0.119496 Mar 29 02:22:56.143651 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1474/3160] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:22:56 2022] GET /compute/v2.1/os-server-groups/9b986077-cdc0-4840-bc30-7dcb2a9972ee => generated 271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:22:56.157152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:56.160115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:56.171651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:56.172334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.173371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:56.173980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.535744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:56.545667 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef4f93c3-a112-4dcd-ab62-dfd9abd9a265 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1292 microversion: 2.1 time: 0.703275 Mar 29 02:22:56.552159 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1687/3161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:55 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1292 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:56.557092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:56.578501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:56.604910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:56.608177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.608177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:56.608177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:56.618639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:56.631681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-887f4b0f-c916-4bd0-9090-55b071429cf1 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.485205 Mar 29 02:22:56.634199 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1475/3162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:56 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:57.038560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:57.039572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:57.050353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.051125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:57.052305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.052874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:57.360129 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31bd205f-9868-472f-933a-3196cdaf961d tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 200 len: 1619 microversion: 2.1 time: 0.802420 Mar 29 02:22:57.360129 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1688/3163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:56 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 1619 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:57.386369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:57.395881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:57.409990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.410450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:57.411597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.412035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:57.547217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:57.556967 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-48e51610-5e6b-44e9-bda0-276f74404ac2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.523948 Mar 29 02:22:57.573192 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1476/3164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:57 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:22:57.573192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:57.573192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:57.597529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.598905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:57.600718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:57.601683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:58.183308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:58.196457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ca98b29-aa16-4b3c-8173-97d47e5ca9cf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1474 microversion: 2.1 time: 0.630603 Mar 29 02:22:58.201129 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1477/3165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:57 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1474 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:58.209440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:58.210301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:58.248424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:58.252063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:58.258147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:58.261338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:58.519218 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0463042f-6cc4-413e-a229-cf304b27bbad tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 200 len: 1619 microversion: 2.1 time: 1.142642 Mar 29 02:22:58.530122 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1689/3166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:57 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 1619 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:58.556457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1080024740", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:58.701313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:22:59.209252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:59.222575 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-822b5896-1cfc-4a75-82fe-2bf55594776b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 1.019881 Mar 29 02:22:59.223934 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1478/3167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:58 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:59.230558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:22:59.231599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:22:59.242651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:59.243782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:59.245077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:22:59.245863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:22:59.523592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:22:59.535050 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-566e26a4-9366-4783-bfdd-da07eb43f16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.309190 Mar 29 02:22:59.536190 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1479/3168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:22:59 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:22:59.541654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-413320661", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "f861d750-c866-4f2d-ac1b-26bd1b476195"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:22:59.683964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:23:00.339353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:00.339948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:00.342163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:00.342819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:00.347797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:00.366614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.367600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.368884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.369885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.400865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:00.411186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:00.425414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:00.428283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:00.619950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4afbc602-8346-4678-856d-1b7a0f6c90e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082249 Mar 29 02:23:00.632389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1480/3169] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:00.643969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:00.644634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:00.661922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.664028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.672740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.673654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.798381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9bfed71e-29b7-42e7-bedf-f3add541f7fc tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/ips" status: 200 len: 149 microversion: 2.1 time: 0.163558 Mar 29 02:23:00.799011 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1481/3170] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:23:00 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/ips => generated 149 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:00.808132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-58ed2c62-1ed4-4434-95b6-3677f0c521e6 req-8be789bb-42a3-4c76-8a00-bc4651696959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "tag": "adaedfe8-baa5-42c6-acf9-1d7c6803d3f4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:00.810131 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:00.810131 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:00.839536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-58ed2c62-1ed4-4434-95b6-3677f0c521e6 req-8be789bb-42a3-4c76-8a00-bc4651696959 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.839968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-58ed2c62-1ed4-4434-95b6-3677f0c521e6 req-8be789bb-42a3-4c76-8a00-bc4651696959 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.882808 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-58ed2c62-1ed4-4434-95b6-3677f0c521e6 req-8be789bb-42a3-4c76-8a00-bc4651696959 service nova] Creating event network-changed:adaedfe8-baa5-42c6-acf9-1d7c6803d3f4 for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:00.887707 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-58ed2c62-1ed4-4434-95b6-3677f0c521e6 req-8be789bb-42a3-4c76-8a00-bc4651696959 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087521 Mar 29 02:23:00.888662 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1482/3171] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:00.901984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:00.902690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:00.910887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.911353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:00.912112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:00.912538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:01.541703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:01.555948 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53ea7ca8-11a9-4554-a5a0-6f4239b7e921 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.665927 Mar 29 02:23:01.556530 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1483/3172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:00 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:01.569528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:01.570338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:01.590939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:01.591390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:01.592179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:01.592773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.002406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:02.018623 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d0d63fa-2f6c-472e-b7cc-f900ce217650 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.450500 Mar 29 02:23:02.019277 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1484/3173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:01 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:02.037618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:02.038240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:02.050033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.050674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.051612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.055265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.190671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:02.191883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:02.193169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:02.193864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:02.194471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:02.217087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.217968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.219242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.221354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.224688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:02.235153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f41cecfd-f65b-4b58-81d3-8398cb793738 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1220 microversion: 2.1 time: 0.201863 Mar 29 02:23:02.236066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1485/3174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:02 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1220 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:02.260829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b83c03eb-37f2-4640-93c8-8dbde5746891"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:02.264721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:02.281344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:02.287856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:02.290050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.290519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.291566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.293914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.309939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:02.309939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:02.507813 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Invalid volume: volume b83c03eb-37f2-4640-93c8-8dbde5746891 is already attached to instances: 51a4869d-3270-4784-ba92-e6dd6f6c5908 Mar 29 02:23:02.516658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 400 to user: Invalid volume: volume b83c03eb-37f2-4640-93c8-8dbde5746891 is already attached to instances: 51a4869d-3270-4784-ba92-e6dd6f6c5908 {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:02.527042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-330b4fb0-de42-4e5c-a3c1-67083e5549b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.995672 Mar 29 02:23:02.530174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ded2010-bff9-4b96-897b-27395d2497e9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.289680 Mar 29 02:23:02.530763 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1486/3175] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:23:02 2022] POST /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81/os-volume_attachments => generated 174 bytes in 292 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:23:02.536479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1690/3176] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:02.561463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:02.564212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:02.577290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:02.578166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:02.590562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.591033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.591958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:02.596114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:02.622046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:02.677541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:03.202567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c22f0274-0c71-4dc2-b5be-49e0e57c9d32 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 204 len: 0 microversion: 2.1 time: 0.649628 Mar 29 02:23:03.208075 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1691/3177] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:02 2022] DELETE /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:23:03.213697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:03.214414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:03.237818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:03.238441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:03.243059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:03.245797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:03.814596 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.scheduler.client.report [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Deleted allocation for instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec Mar 29 02:23:03.830778 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.compute.api [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Instance Mapping does not exist while attempting local delete cleanup. Mar 29 02:23:03.834791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12333c18-df21-4a36-8978-5ede3fe7249f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec" status: 204 len: 0 microversion: 2.1 time: 1.279863 Mar 29 02:23:03.837539 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1487/3178] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:02 2022] DELETE /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec => generated 0 bytes in 1284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:23:03.849398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:03.861744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:03.894850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:03.895449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:03.896254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:03.896699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:04.373165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:04.395394 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f9d3df1-3f6f-4264-b6e4-5e0326362fbd tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 1.175496 Mar 29 02:23:04.395394 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1692/3179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:03 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:04.399073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:04.399676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:04.427029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:04.427616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:04.428265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:04.428694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:04.851598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:04.866730 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06f69c15-b380-4bc4-a7b7-bd558541f7fb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 1.023615 Mar 29 02:23:04.869183 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1488/3180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:03 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:04.882505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:04.885462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:04.895242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:04.897760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:04.897760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:04.898099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.138200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:05.148268 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8225a7b2-6cf7-4cf7-a099-7bbf0d8ce492 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1682 microversion: 2.1 time: 0.761087 Mar 29 02:23:05.149278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1693/3181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:04 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1682 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:05.154367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1a57d06-0042-495c-967c-05f7ca3dcbd8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:05.155297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1a57d06-0042-495c-967c-05f7ca3dcbd8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:05.163905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c1a57d06-0042-495c-967c-05f7ca3dcbd8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. Mar 29 02:23:05.165184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1a57d06-0042-495c-967c-05f7ca3dcbd8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:05.166561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1a57d06-0042-495c-967c-05f7ca3dcbd8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec" status: 404 len: 111 microversion: 2.1 time: 0.016094 Mar 29 02:23:05.167440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1694/3182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:05 2022] GET /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:05.175432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4d150fce-30cd-48ff-a563-cb7dd3d7d519 req-ef9b8373-07a4-4c45-af16-70366c6c96a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "tag": "0842c0bf-da7f-4516-8d48-8de89e87e2da"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:05.178236 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:05.178236 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:05.215597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4d150fce-30cd-48ff-a563-cb7dd3d7d519 req-ef9b8373-07a4-4c45-af16-70366c6c96a7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:05.217159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4d150fce-30cd-48ff-a563-cb7dd3d7d519 req-ef9b8373-07a4-4c45-af16-70366c6c96a7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.265407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4d150fce-30cd-48ff-a563-cb7dd3d7d519 req-ef9b8373-07a4-4c45-af16-70366c6c96a7 service nova] Creating event network-changed:0842c0bf-da7f-4516-8d48-8de89e87e2da for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:05.283600 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4d150fce-30cd-48ff-a563-cb7dd3d7d519 req-ef9b8373-07a4-4c45-af16-70366c6c96a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114200 Mar 29 02:23:05.284218 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1695/3183] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:05.296860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:05.298102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:05.329641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:05.330170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.330979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:05.331417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.424930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] HTTP exception thrown: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. Mar 29 02:23:05.425628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Returning 404 to user: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:05.426363 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3337b746-7b7d-4685-a7d2-9e96602d113c tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 404 len: 111 microversion: 2.32 time: 0.141029 Mar 29 02:23:05.428575 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1696/3184] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:23:05 2022] DELETE /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:23:05.435011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:05.435628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:05.457781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:05.458777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.459853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:05.460599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:05.949125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:05.958908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91876de6-5053-4db9-8e5c-acb0b87d1c1a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.530637 Mar 29 02:23:05.964055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1697/3185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:05 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:05.973962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-250402227", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:05.988727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:06.022659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c6368f4-21c6-40cb-8e18-5143bbafb1ac tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1274 microversion: 2.1 time: 1.149268 Mar 29 02:23:06.023275 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1489/3186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:04 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1274 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:06.041186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:06.042070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] [instance: 0bb0fada-7203-4f8f-be58-93149c12eee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:06.052248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:06.054409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:06.055445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:06.056515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:06.070690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:23:06.134312 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] HTTP exception thrown: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. Mar 29 02:23:06.135374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] Returning 404 to user: Instance 0bb0fada-7203-4f8f-be58-93149c12eee1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:06.136784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9abfe17-6193-4557-b06d-7b5a14e1123d tempest-TaggedBootDevicesTest-1185196412 tempest-TaggedBootDevicesTest-1185196412-project] 10.222.0.36 "GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1" status: 404 len: 111 microversion: 2.32 time: 0.111220 Mar 29 02:23:06.140853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1490/3187] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:23:06 2022] GET /compute/v2.1/servers/0bb0fada-7203-4f8f-be58-93149c12eee1 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:23:06.148367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:06.149198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:06.158063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:06.158657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:06.159535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:06.160077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.055578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:07.069578 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b19093ad-6e12-444f-bc95-313435dafef1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.926579 Mar 29 02:23:07.070493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1491/3188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:06 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:07.075109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:07.075716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:07.098387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.098835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.099624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.100061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.442621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:07.455092 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59fac00c-d6fa-44e9-adf8-dead3f9588d9 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1682 microversion: 2.1 time: 0.383434 Mar 29 02:23:07.457020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1492/3189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:07 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1682 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:07.480597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:07.481241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:07.498944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.499426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.500202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.500824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.503114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:07.503669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:07.504396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:07.504889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:07.505313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:07.527473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.527916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.528720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.529189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.579932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:07.586386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:07.608248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:07.610991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:07.785841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b68926a6-e9ee-4c1b-8b64-e89cb238f571 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820354 Mar 29 02:23:07.790955 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1698/3190] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:07.803060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:07.803902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:07.833175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.841906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:07.842786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:07.843230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:08.492766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:08.506346 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4443d27e-8947-4f58-96bd-d8b0a502fbe2 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 1.038478 Mar 29 02:23:08.513373 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1493/3191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:07 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:08.525820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-28261dbc-b456-4442-b890-c6054a670394 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:08.526832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28261dbc-b456-4442-b890-c6054a670394 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:08.801563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-28261dbc-b456-4442-b890-c6054a670394 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:08.815160 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-28261dbc-b456-4442-b890-c6054a670394 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1220 microversion: 2.1 time: 0.296828 Mar 29 02:23:08.828976 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1494/3192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:08 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1220 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:08.834965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:08.835923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:08.855064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:08.855522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:08.863223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:08.863715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:08.864492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:08.873266 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-012bdca5-e609-43ed-a1a8-457b941d7b5d tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 1.074464 Mar 29 02:23:08.874131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1699/3193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:07 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:08.890520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:08.891634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:08.913716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:08.918293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:08.921028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:08.924929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:09.251626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:09.260785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c2ee446-0212-4f04-a97e-bfa3bafca3c3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1614 microversion: 2.1 time: 0.385923 Mar 29 02:23:09.267639 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1700/3194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:08 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1614 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:09.530136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:09.531341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:09.546603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:09.547981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:09.549009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:09.549648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:09.981454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:09.992276 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00d09b39-6bbd-4d7f-a0c2-94e155bd7b00 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.466147 Mar 29 02:23:10.010333 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1701/3195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:09 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:10.015212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:10.025731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:10.034063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.034884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.035937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.044221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.274694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:10.305109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-33403fc9-7f0c-4eb3-913e-8b9f9337dda1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 1.486581 Mar 29 02:23:10.306382 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1495/3196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:08 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:10.319655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:10.320581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:10.335206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:10.338217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.338904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.339908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.342705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.347493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1000875-ef4a-42aa-9dcd-c256bcd86187 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1216 microversion: 2.1 time: 0.335784 Mar 29 02:23:10.349004 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1702/3197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:10 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1216 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:10.367645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:10.370906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:10.388969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.389867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.391028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.391699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.562505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:10.579029 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60c2207f-a5c4-4684-adc0-950be7e0b47b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1614 microversion: 2.1 time: 0.227707 Mar 29 02:23:10.579609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1703/3198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:10 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1614 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:10.593767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ef219fa5-e72f-4b78-baac-13d9866a6aa0 req-39f964b2-d4d7-4860-bc9f-53badd13401b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed3eebc6-e934-4947-9eec-edd26d59cb81", "name": "network-vif-deleted", "tag": "3a1e5442-44cf-4860-9688-fdc391fe8d90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:10.597168 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:10.597168 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:10.616169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ef219fa5-e72f-4b78-baac-13d9866a6aa0 req-39f964b2-d4d7-4860-bc9f-53badd13401b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:10.626171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ef219fa5-e72f-4b78-baac-13d9866a6aa0 req-39f964b2-d4d7-4860-bc9f-53badd13401b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:10.663042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ef219fa5-e72f-4b78-baac-13d9866a6aa0 req-39f964b2-d4d7-4860-bc9f-53badd13401b service nova] Creating event network-vif-deleted:3a1e5442-44cf-4860-9688-fdc391fe8d90 for instance ed3eebc6-e934-4947-9eec-edd26d59cb81 on n-h1-828148-1 Mar 29 02:23:10.675144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ef219fa5-e72f-4b78-baac-13d9866a6aa0 req-39f964b2-d4d7-4860-bc9f-53badd13401b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084925 Mar 29 02:23:10.678127 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1704/3199] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:11.028752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:11.029508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:11.068243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.070602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.073459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.076208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.242512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:11.252222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf066e2d-797f-4338-ba36-e686acb69652 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.944487 Mar 29 02:23:11.252712 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1496/3200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:10 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:11.325614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:11.326837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:11.342859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.345186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.350820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.351365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.435701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:11.449685 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c42c3bb1-4147-442b-a5fc-0ea680baefef tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.435394 Mar 29 02:23:11.458906 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1705/3201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:11 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:11.458906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:11.459526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:11.479443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.482146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.483108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.483695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.712332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:11.740343 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29815b62-e93e-4ae5-afcc-7df2b7538342 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1280 microversion: 2.1 time: 0.287962 Mar 29 02:23:11.742030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1706/3202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:11 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:11.754749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:11.755772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:11.776527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.777021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:11.777822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:11.778264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:12.108748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:12.109416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:12.113493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lazy-loading 'fault' on Instance uuid ed3eebc6-e934-4947-9eec-edd26d59cb81 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:12.277233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:12.294815 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed3f52ef-d8f1-44d9-a22a-1ffd2e9e1766 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 200 len: 1332 microversion: 2.1 time: 0.547444 Mar 29 02:23:12.295787 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1707/3203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:11 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 1332 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:12.300391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:12.301311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:12.310810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:12.311757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:12.314344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:12.315213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:12.871316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:12.882318 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-901b8931-53dc-43b5-8869-2fe4dee246b1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.584891 Mar 29 02:23:12.883466 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1708/3204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:12 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:12.898665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:12.899734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:12.910097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:12.910786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:12.911856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:12.912513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.130842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:13.157380 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fe73fb95-8660-4cf7-b751-441db772caf8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 1.835367 Mar 29 02:23:13.159414 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1497/3205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:11 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:13.170829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:13.173328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:13.201243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.201243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.201243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.201243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.273740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:13.286228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f03e3422-d0f6-4a9c-976f-339ce7ab2e16 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.391384 Mar 29 02:23:13.299273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1709/3206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:12 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:13.315736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ecbc2ba0-0794-4b06-a0da-ac788416010b req-b4e441a7-1528-4651-a8bb-d6e06413fbf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63339d2a-2be7-407e-afea-3172124a1cc0", "tag": "bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:13.320929 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:13.320929 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:13.340622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ecbc2ba0-0794-4b06-a0da-ac788416010b req-b4e441a7-1528-4651-a8bb-d6e06413fbf5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.346700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ecbc2ba0-0794-4b06-a0da-ac788416010b req-b4e441a7-1528-4651-a8bb-d6e06413fbf5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.352475 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:23:13.377539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ecbc2ba0-0794-4b06-a0da-ac788416010b req-b4e441a7-1528-4651-a8bb-d6e06413fbf5 service nova] Creating event network-changed:bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02 for instance 63339d2a-2be7-407e-afea-3172124a1cc0 on n-h1-828148-1 Mar 29 02:23:13.382607 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ecbc2ba0-0794-4b06-a0da-ac788416010b req-b4e441a7-1528-4651-a8bb-d6e06413fbf5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081995 Mar 29 02:23:13.383462 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1710/3207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:13.393644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:13.394627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:13.402423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.404239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.405442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.406036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.468109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. Mar 29 02:23:13.468879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:13.470188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-262e3cc8-31e9-4e2b-a536-1537980c84d1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 404 len: 111 microversion: 2.1 time: 0.082341 Mar 29 02:23:13.470739 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1711/3208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:13 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:13.482002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e033daa9-f1dc-4547-8d63-bd8d3e56336f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '.version_select at 0x7f8717ea8310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:13.540264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:13.557195 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fa3ecf8-2b9d-4aac-870a-e846975e542e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1278 microversion: 2.1 time: 0.396341 Mar 29 02:23:13.557766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1498/3209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:13 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1278 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:13.571708 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e033daa9-f1dc-4547-8d63-bd8d3e56336f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828834910" status: 202 len: 0 microversion: 2.1 time: 0.096372 Mar 29 02:23:13.576363 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1712/3210] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828834910 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:13.899539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:13.900156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:13.916515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.917738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:13.918787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:13.919287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:14.175581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:14.176857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:14.185104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:14.186055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:14.187990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:14.190795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:14.362753 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35026. Mar 29 02:23:14.895822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:14.910689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b02a8f2-2070-4823-918f-f23c49073cfd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 1.013999 Mar 29 02:23:14.911453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1499/3211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:13 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:14.925004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:14.928084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:14.944291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:14.948960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:14.948960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:14.948960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:15.488803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:15.499096 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3cd0418d-4978-48dd-adb8-28ae4b8ae674 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.585129 Mar 29 02:23:15.504811 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1500/3212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:14 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:15.516107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:15.518284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:15.529474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:15.533716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:15.538508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:15.541123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:15.541748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:15.543360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27b41b58-6d33-4154-8f84-f1662ada1dc6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1506 microversion: 2.1 time: 1.371946 Mar 29 02:23:15.545239 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1713/3213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:14 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1506 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:15.566658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-985cf09c-d85f-4fa8-b00a-03eab81f2ec4 req-6cfda221-59a4-4de5-8f5e-7b48361645c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88d8eec-fccf-451e-91af-95d09426c4ce", "name": "network-vif-unplugged", "status": "completed", "tag": "175edd8d-0b34-4f3e-9762-68390802471d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:15.573291 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:15.573291 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:15.591101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-985cf09c-d85f-4fa8-b00a-03eab81f2ec4 req-6cfda221-59a4-4de5-8f5e-7b48361645c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:15.591551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-985cf09c-d85f-4fa8-b00a-03eab81f2ec4 req-6cfda221-59a4-4de5-8f5e-7b48361645c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:15.655870 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-985cf09c-d85f-4fa8-b00a-03eab81f2ec4 req-6cfda221-59a4-4de5-8f5e-7b48361645c8 service nova] Creating event network-vif-unplugged:175edd8d-0b34-4f3e-9762-68390802471d for instance a88d8eec-fccf-451e-91af-95d09426c4ce on n-h1-828148-1 Mar 29 02:23:15.673038 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-985cf09c-d85f-4fa8-b00a-03eab81f2ec4 req-6cfda221-59a4-4de5-8f5e-7b48361645c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116192 Mar 29 02:23:15.681502 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1714/3214] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:15.930322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:15.931101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:15.955725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:15.956186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:15.966513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:15.966513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.269618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:16.279362 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a906dd2-bd77-440c-9829-5098e2f976ce tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.354413 Mar 29 02:23:16.280706 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1715/3215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:15 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:16.292946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:16.293731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:16.305428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.305870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.306712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.307071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.555254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lazy-loading 'services' on Instance uuid 51a4869d-3270-4784-ba92-e6dd6f6c5908 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:16.559864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:16.580056 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05ef1d1f-b737-4154-bee4-9c3763016374 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 1.073926 Mar 29 02:23:16.580643 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1501/3216] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:15 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:16.594064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:16.594064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:16.612931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.613383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.614167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.614600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.880003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-680fca47-4190-422d-83a7-d0fe11fe67f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments/b83c03eb-37f2-4640-93c8-8dbde5746891" status: 202 len: 0 microversion: 2.1 time: 0.597364 Mar 29 02:23:16.880624 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1716/3217] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:23:16 2022] DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments/b83c03eb-37f2-4640-93c8-8dbde5746891 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:16.889957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:16.890996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:16.902693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.903091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:16.904092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:16.904830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.190426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:17.201715 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e84123f6-1941-4424-903c-1995c7a432bb tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1506 microversion: 2.1 time: 0.316045 Mar 29 02:23:17.203399 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1717/3218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:16 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:17.208159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:17.209139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:17.218198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.219527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.220450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.221088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.273976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:17.289164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b47d011d-186b-499b-bb06-a8ef85098627 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.707327 Mar 29 02:23:17.291283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1502/3219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:16 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:17.297439 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b3ae7c1-21ad-48e9-b11a-78d3048ce0e1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091849 Mar 29 02:23:17.298228 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1718/3220] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:23:17 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:17.311417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:17.312045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:17.328777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.329254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.330040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.330471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.598832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:17.600344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:17.611272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.612061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.613158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.613712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.855164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:17.864629 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a514eed5-c887-46f0-8564-39db2762e9e3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.559803 Mar 29 02:23:17.871660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1503/3221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:17 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:17.880334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "name": "network-vif-plugged", "status": "completed", "tag": "0842c0bf-da7f-4516-8d48-8de89e87e2da"}, {"server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "name": "network-vif-plugged", "status": "completed", "tag": "adaedfe8-baa5-42c6-acf9-1d7c6803d3f4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:17.882105 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:17.882105 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:17.897313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:17.901767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:17.902212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:17.911143 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29d2e37e-d8d0-4380-b4e2-cf5f332193b9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.317953 Mar 29 02:23:17.912442 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1719/3222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:17 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:17.934995 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] Creating event network-vif-plugged:0842c0bf-da7f-4516-8d48-8de89e87e2da for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:17.935694 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] Creating event network-vif-plugged:adaedfe8-baa5-42c6-acf9-1d7c6803d3f4 for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:17.943078 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8958946f-11cd-419b-b0e3-afb5d2ca1bbf req-a42bf987-95c1-433a-a787-ddd03e2c315f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069757 Mar 29 02:23:17.944334 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1504/3223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:18.219543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:18.220273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:18.233172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.235795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.236716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.239017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.310605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:18.311386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:18.326665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.327208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.328538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.329004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.485095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:18.495090 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c8af556-54ce-4f25-b9d6-9ea7be3aab41 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 200 len: 1509 microversion: 2.1 time: 0.280040 Mar 29 02:23:18.496182 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1720/3224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:18 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:18.503783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:18.504982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:18.516549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.517681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.518710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.519264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.600100 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5f06584-98b8-4b0f-8551-1d3e881f9944 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102387 Mar 29 02:23:18.601803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1721/3225] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:23:18 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:18.606625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:18.607499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:18.631353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.632194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.633268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.633923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.939855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:18.939855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef3225bc-c0c7-4473-a7ad-a5d160c16a46 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.333581 Mar 29 02:23:18.939855 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1722/3226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:18 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:18.945369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4dc1c48a-9470-468d-b193-77981ce189fd req-7c35f92b-44d1-4f7f-bab4-3f483c4390d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f1e724-6f07-435a-8fc7-8dd2d218eb12", "tag": "d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:18.947078 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:18.947078 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:18.961071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4dc1c48a-9470-468d-b193-77981ce189fd req-7c35f92b-44d1-4f7f-bab4-3f483c4390d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:18.961719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4dc1c48a-9470-468d-b193-77981ce189fd req-7c35f92b-44d1-4f7f-bab4-3f483c4390d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:18.981367 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4dc1c48a-9470-468d-b193-77981ce189fd req-7c35f92b-44d1-4f7f-bab4-3f483c4390d5 service nova] Creating event network-changed:d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c for instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 on n-h1-828148-1 Mar 29 02:23:18.988277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4dc1c48a-9470-468d-b193-77981ce189fd req-7c35f92b-44d1-4f7f-bab4-3f483c4390d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048726 Mar 29 02:23:18.989271 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1723/3227] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:18.996476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:18.997216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.005729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.006182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.006967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.007584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.166986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:19.181121 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b16bb6f2-a277-438e-a072-361506a77d6b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1334 microversion: 2.1 time: 0.876146 Mar 29 02:23:19.181747 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1505/3228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:18 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1334 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:19.190159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:19.191561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.204052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.204720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.205734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.206178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.325327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:19.335236 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-255e16c0-4c3f-4845-a108-e2acc2b997d6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.344473 Mar 29 02:23:19.335822 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1724/3229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:18 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:19.341570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:19.342442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.353600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.354309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.356145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.356145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.784769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:19.793474 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c8ef266-aa73-434d-81f2-108097e0a9ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.609806 Mar 29 02:23:19.794326 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1506/3230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:19 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:19.807668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:19.810705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.818998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.819775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.820745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.821414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.857259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:19.866749 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-416bef2a-3172-4547-88d5-550b2447a342 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.529707 Mar 29 02:23:19.867460 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1725/3231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:19 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:19.882705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:19.883577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.887960 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03ddc933-32cd-4e42-966f-68a01c0b283b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084001 Mar 29 02:23:19.888529 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1507/3232] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:23:19 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:23:19.891449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.891898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.892663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.893180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.981209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:19.982260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:19.991135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.991795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:19.992716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:19.993358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.070624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:20.128937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:20.137604 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b4e2513-a5e7-4cca-a373-aec10b7b669c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.258357 Mar 29 02:23:20.149065 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1726/3233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:19 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:20.155940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:20.158296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:20.166388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.166825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.167775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.168204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.397107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:20.406624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6cde13cb-7447-4e49-a313-57a054606aaf tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.255579 Mar 29 02:23:20.407336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1727/3234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:20 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:20.412238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:20.413041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:20.421092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.422270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.423216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.424073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.457176 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41ab4d96-7d77-4dfb-a361-4e3d36db3c8b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 204 len: 0 microversion: 2.1 time: 0.479060 Mar 29 02:23:20.466074 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1508/3235] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:19 2022] DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:23:20.474714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:20.475896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:20.486711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.487545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.488473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.489286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.645750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:20.654725 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d019da09-7f7a-4cd9-a886-222e423e2f7a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1670 microversion: 2.1 time: 0.245856 Mar 29 02:23:20.655510 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1728/3236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:20 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1670 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:20.660334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dda1329a-a28b-4773-8853-1be443a6d05c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:20.668660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda1329a-a28b-4773-8853-1be443a6d05c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.669150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dda1329a-a28b-4773-8853-1be443a6d05c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.752293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dda1329a-a28b-4773-8853-1be443a6d05c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:23:20.947504 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dda1329a-a28b-4773-8853-1be443a6d05c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.290602 Mar 29 02:23:20.948689 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1729/3237] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:23:20 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:20.955160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:20.956126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:20.965633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.966288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:20.967420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:20.967859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.329664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:21.338280 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1400fe45-94e5-4f9d-870d-3a136ed07b9f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1682 microversion: 2.1 time: 0.388079 Mar 29 02:23:21.338842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1730/3238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:20 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1682 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:21.343847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:21.344340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:21.353433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.353887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.354656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.355087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.357055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:21.367683 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb29796a-38e8-415f-9673-4c022e129a00 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.899721 Mar 29 02:23:21.376983 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1509/3239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:20 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:21.376983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:21.376983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:21.381890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.382333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.383096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.383524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.416116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-555e18b6-0b41-4189-a577-a4a0dd9f9897 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185/ips" status: 200 len: 180 microversion: 2.1 time: 0.075850 Mar 29 02:23:21.419442 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1731/3240] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:23:21 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185/ips => generated 180 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:21.422828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:21.423448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:21.434584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.435440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.436578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.437142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.669416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:21.678035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dabaf02c-1ab7-491b-8b08-c863b1c99bcd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.259862 Mar 29 02:23:21.683301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1732/3241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:21 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:21.694270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:21.696254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:21.711533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.712265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.713472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:21.714181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:21.778859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:21.857074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:21.866089 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e2efedd-5ab6-42ab-aa0d-567931b2f07f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.496393 Mar 29 02:23:21.866665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1510/3242] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:21 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:22.064448 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-950bfbf2-24fc-4363-94d6-360d2be6332a tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 204 len: 0 microversion: 2.1 time: 0.379693 Mar 29 02:23:22.065157 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1733/3243] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:21 2022] DELETE /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:23:22.073775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:22.075458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:22.084291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.085032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.086185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.086782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.355838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:22.356544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:22.376254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.376788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.379096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.379534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.542104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:22.551242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4ed3364d-0853-4e54-8f72-89a861c64017 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1676 microversion: 2.1 time: 0.481638 Mar 29 02:23:22.561303 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1511/3244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:22 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1676 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:22.565989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:22.566776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:22.574533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.575421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.576349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.577036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.772881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:22.785632 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a270e64-994c-49cb-b541-f13f4dfd6ebd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1682 microversion: 2.1 time: 0.432668 Mar 29 02:23:22.786537 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1734/3245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:22 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1682 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:22.806049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:22.806706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:22.820668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.821144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:22.824876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:22.826451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:23.179756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:23.192298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-824e4753-05b5-4e1f-a34c-055d62232375 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 0.629585 Mar 29 02:23:23.193815 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1512/3246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:22 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:23.219791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:23.220688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:23.233508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:23.234344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:23.236106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:23.236995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:23.601731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:23.612365 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6488a9f9-3887-4b44-a10b-760c049fcdbc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.825003 Mar 29 02:23:23.613665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1735/3247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:22 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:23.619294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f6ec794a-5e3d-4f0e-b8eb-2103ba6bd5ee req-53c7aeaa-cad1-460b-8bb0-819bc7c13152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63339d2a-2be7-407e-afea-3172124a1cc0", "name": "network-vif-plugged", "status": "completed", "tag": "bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:23.621011 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:23.621011 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:23.629698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6ec794a-5e3d-4f0e-b8eb-2103ba6bd5ee req-53c7aeaa-cad1-460b-8bb0-819bc7c13152 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:23.630250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6ec794a-5e3d-4f0e-b8eb-2103ba6bd5ee req-53c7aeaa-cad1-460b-8bb0-819bc7c13152 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:23.647264 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f6ec794a-5e3d-4f0e-b8eb-2103ba6bd5ee req-53c7aeaa-cad1-460b-8bb0-819bc7c13152 service nova] Creating event network-vif-plugged:bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02 for instance 63339d2a-2be7-407e-afea-3172124a1cc0 on n-h1-828148-1 Mar 29 02:23:23.653313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f6ec794a-5e3d-4f0e-b8eb-2103ba6bd5ee req-53c7aeaa-cad1-460b-8bb0-819bc7c13152 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037535 Mar 29 02:23:23.654534 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1736/3248] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:23.660606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:23.661525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:23.697748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:23.698342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:23.699244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:23.699755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.147637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:24.163537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7fcbc34f-e4df-4e8d-95b4-1ef866bb5d85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.957003 Mar 29 02:23:24.174952 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1513/3249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:23 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:24.181053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:24.182454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:24.190771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.191434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.192367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.193026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.552296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:24.561464 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-149d7024-9eef-4b53-8ba7-79991c83b1dc tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1676 microversion: 2.1 time: 0.905535 Mar 29 02:23:24.562648 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1737/3250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:23 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1676 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:24.567628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:24.568443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:24.577680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.578391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.579166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.579589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.714822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:24.728113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bd86a316-8e76-48f6-9f1b-56fe830d0356 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1614 microversion: 2.1 time: 0.551777 Mar 29 02:23:24.729540 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1514/3251] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:24 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1614 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:24.736692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:24.738276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:24.749150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.750409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:24.756268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:24.757106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.161447 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:23:25.299572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:25.319331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c5e38c7-7cab-4d65-8ee3-88db3ac64fdd tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.588209 Mar 29 02:23:25.319925 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1515/3252] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:24 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:25.328120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:25.329062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:25.337619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:25.338136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.338884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:25.339372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.678457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:25.693038 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bff3bf53-573c-4e89-b621-50a0b03d3d30 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1316 microversion: 2.1 time: 1.127428 Mar 29 02:23:25.693879 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1738/3253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:24 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1316 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:25.718867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f9e89972-c338-426a-9663-545954aea650 req-3defde25-4ba7-4cc6-879b-76de4887d5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a4869d-3270-4784-ba92-e6dd6f6c5908", "name": "network-vif-deleted", "tag": "03378b5b-21ef-45f5-9b97-31e714be8b0b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:25.728851 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:25.728851 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:25.740995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f9e89972-c338-426a-9663-545954aea650 req-3defde25-4ba7-4cc6-879b-76de4887d5e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:25.743373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f9e89972-c338-426a-9663-545954aea650 req-3defde25-4ba7-4cc6-879b-76de4887d5e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.797469 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f9e89972-c338-426a-9663-545954aea650 req-3defde25-4ba7-4cc6-879b-76de4887d5e6 service nova] Creating event network-vif-deleted:03378b5b-21ef-45f5-9b97-31e714be8b0b for instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 on n-h2-828148-1 Mar 29 02:23:25.803527 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f9e89972-c338-426a-9663-545954aea650 req-3defde25-4ba7-4cc6-879b-76de4887d5e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098258 Mar 29 02:23:25.804681 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1739/3254] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:25.809870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:25.810801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:25.827246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:25.828434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.833041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:25.833673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:25.984561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:26.000266 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-254a24fb-a27e-4fe3-91c0-ea9a5cc42c17 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.676412 Mar 29 02:23:26.009970 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1516/3255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:25 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:26.022492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:26.023123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:26.035039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.036608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.039184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.041403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.187595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.188316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.189442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lazy-loading 'fault' on Instance uuid 51a4869d-3270-4784-ba92-e6dd6f6c5908 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:26.195032 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35252. Mar 29 02:23:26.260153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:26.270803 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08bb0e19-6e50-4e24-b1c5-d7bdd573e10b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 200 len: 1332 microversion: 2.1 time: 0.257207 Mar 29 02:23:26.272112 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1517/3256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:26 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:26.337611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:26.338912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:26.356865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.357522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.358476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.359098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.613053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:26.625726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce0e6373-3b99-41b6-8c19-b89657b5d09e tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1655 microversion: 2.1 time: 0.819749 Mar 29 02:23:26.628560 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1740/3257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:25 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1655 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:26.711516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:26.712320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:26.728220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.728859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.729825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:26.730496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:26.731288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:26.748025 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22dfb6ec-e691-4920-8593-93d563f445db tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.412371 Mar 29 02:23:26.762138 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1518/3258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:26 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:27.022752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:27.024069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:27.030558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.031055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.031842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.032803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.243619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:27.252584 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6c6f3e0-ad97-4334-8d4b-1806fae994ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.234548 Mar 29 02:23:27.263029 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1519/3259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:27 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:27.287360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:27.288153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:27.297230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.297911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.298863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.299453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.352667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. Mar 29 02:23:27.353980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:27.354993 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41157213-ceb0-47f7-b93e-ebf9d6a52540 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 404 len: 111 microversion: 2.1 time: 0.071301 Mar 29 02:23:27.359599 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1520/3260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:27 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:27.364460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c86aa47-708e-4271-aa1c-aaafad969bea tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '.version_select at 0x7f87240d5b80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:27.477692 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c86aa47-708e-4271-aa1c-aaafad969bea tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142932223" status: 202 len: 0 microversion: 2.1 time: 0.116148 Mar 29 02:23:27.483281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1521/3261] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2142932223 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:27.646997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:27.647885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:27.663645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.665692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.669058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:27.669871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:27.957183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:27.979498 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-50740afd-149b-4562-8f14-74f2a43bcd42 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1466 microversion: 2.1 time: 1.271905 Mar 29 02:23:27.982768 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1741/3262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:26 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1466 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:28.008453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:28.025653 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31f116f2-810a-49b8-84f4-f262615c8dec tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1655 microversion: 2.1 time: 0.383149 Mar 29 02:23:28.029851 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1522/3263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:27 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1655 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:28.036562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d97fec52-59bd-416d-85aa-2f86a828388b req-44ba0c06-0833-4113-9bf6-86b1ff43fddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f1e724-6f07-435a-8fc7-8dd2d218eb12", "name": "network-vif-plugged", "status": "completed", "tag": "d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:28.039230 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:28.039230 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:28.059882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d97fec52-59bd-416d-85aa-2f86a828388b req-44ba0c06-0833-4113-9bf6-86b1ff43fddf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.060234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d97fec52-59bd-416d-85aa-2f86a828388b req-44ba0c06-0833-4113-9bf6-86b1ff43fddf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.103036 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d97fec52-59bd-416d-85aa-2f86a828388b req-44ba0c06-0833-4113-9bf6-86b1ff43fddf service nova] Creating event network-vif-plugged:d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c for instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 on n-h1-828148-1 Mar 29 02:23:28.120213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d97fec52-59bd-416d-85aa-2f86a828388b req-44ba0c06-0833-4113-9bf6-86b1ff43fddf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088947 Mar 29 02:23:28.121010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1523/3264] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:28.142901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fb97f5cd-7e94-4235-90d9-a49ff2bc21b4 req-8ec78e42-c004-4052-aad0-59ceeb6f0c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "name": "network-vif-deleted", "tag": "adaedfe8-baa5-42c6-acf9-1d7c6803d3f4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:28.144553 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:28.144553 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:28.160106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fb97f5cd-7e94-4235-90d9-a49ff2bc21b4 req-8ec78e42-c004-4052-aad0-59ceeb6f0c39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.164022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fb97f5cd-7e94-4235-90d9-a49ff2bc21b4 req-8ec78e42-c004-4052-aad0-59ceeb6f0c39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.206145 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fb97f5cd-7e94-4235-90d9-a49ff2bc21b4 req-8ec78e42-c004-4052-aad0-59ceeb6f0c39 service nova] Creating event network-vif-deleted:adaedfe8-baa5-42c6-acf9-1d7c6803d3f4 for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:28.215363 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fb97f5cd-7e94-4235-90d9-a49ff2bc21b4 req-8ec78e42-c004-4052-aad0-59ceeb6f0c39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086110 Mar 29 02:23:28.219297 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1524/3265] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:28.229752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:28.231844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:28.251417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.254925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.254925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.254925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.516794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:28.517826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:28.528868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.529805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.530912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.531575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.943913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50ed7294-9766-4905-8bc6-96f2a33e7c52 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1617 microversion: 2.1 time: 0.722934 Mar 29 02:23:28.945866 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1525/3266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:28 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1617 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:28.950935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:28.951793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:28.967111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.967697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:28.968504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:28.968963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:29.157372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:29.166965 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-519a5133-3821-44a7-95a6-da2dd63962c1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 1.180846 Mar 29 02:23:29.167769 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1742/3267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:27 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:29.182958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:29.186358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:29.197092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:29.197717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:29.198773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:29.199341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:29.271242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:29.282120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b50d7ce5-24af-4cff-a657-00834e53aeac tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1320 microversion: 2.1 time: 0.334755 Mar 29 02:23:29.285317 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1526/3268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:28 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1320 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:29.291926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2011141522", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["f861d750-c866-4f2d-ac1b-26bd1b476195"]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:29.369981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:23:29.824232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:29.824756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:29.825423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:29.825926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:29.826433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:29.836349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:29.836912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:29.838382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:29.838915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:29.866230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:29.866517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:29.879005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:29.881492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:30.011759 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d38ffe7-3f29-4e23-ac42-cd984795644c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724987 Mar 29 02:23:30.012535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1527/3269] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:23:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:30.014613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:30.017630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: .version_select at 0x7f87241ca670>, body: {"keypair": {"name": "tempest-keypair-541343059"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:30.025215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c640849-8638-4cd5-9c83-8fe47507646b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1496 microversion: 2.1 time: 0.855935 Mar 29 02:23:30.038930 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1743/3270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:29 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1496 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:30.045255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d59d0d9-6275-441a-ac73-4ae13d1c3981 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:30.046141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d59d0d9-6275-441a-ac73-4ae13d1c3981 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:30.085015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:30.091926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:30.205290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d59d0d9-6275-441a-ac73-4ae13d1c3981 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:30.213782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d59d0d9-6275-441a-ac73-4ae13d1c3981 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1217 microversion: 2.1 time: 0.173376 Mar 29 02:23:30.216618 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1744/3271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:30 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:30.251224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-88195b01-4d7a-476a-9968-b72a72d7f52c req-7ebdff1b-152f-4481-9a6a-beb08a37588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "name": "network-vif-unplugged", "status": "completed", "tag": "0842c0bf-da7f-4516-8d48-8de89e87e2da"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:30.253425 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:30.253425 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:30.283665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-88195b01-4d7a-476a-9968-b72a72d7f52c req-7ebdff1b-152f-4481-9a6a-beb08a37588c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.283665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-88195b01-4d7a-476a-9968-b72a72d7f52c req-7ebdff1b-152f-4481-9a6a-beb08a37588c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.304130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-88195b01-4d7a-476a-9968-b72a72d7f52c req-7ebdff1b-152f-4481-9a6a-beb08a37588c service nova] Creating event network-vif-unplugged:0842c0bf-da7f-4516-8d48-8de89e87e2da for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:30.310068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-88195b01-4d7a-476a-9968-b72a72d7f52c req-7ebdff1b-152f-4481-9a6a-beb08a37588c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063167 Mar 29 02:23:30.311311 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1745/3272] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:30.319266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:30.320248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:30.335866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.340689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.340689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.340689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.462054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:30.462054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:30.474795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-314be904-72cd-41d4-b683-50a055f97ae1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.461208 Mar 29 02:23:30.475899 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1528/3273] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:23:30 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:30.488201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:30.488201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:30.503863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.504710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.505998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.506628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.810106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:30.830973 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-095a34a2-edc1-4b07-bbb7-e3f3de829401 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1680 microversion: 2.1 time: 0.516727 Mar 29 02:23:30.834029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1746/3274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:30 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1680 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:30.846873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8cf5d2e8-6e37-43b1-bb70-511878b59cb1 req-e34a0136-136d-4ee0-a6d5-adae081f0539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31d2f5ef-7832-4505-891d-61f915ca8185", "name": "network-vif-deleted", "tag": "0842c0bf-da7f-4516-8d48-8de89e87e2da"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:30.848754 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:30.848754 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:30.873538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8cf5d2e8-6e37-43b1-bb70-511878b59cb1 req-e34a0136-136d-4ee0-a6d5-adae081f0539 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:30.877997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8cf5d2e8-6e37-43b1-bb70-511878b59cb1 req-e34a0136-136d-4ee0-a6d5-adae081f0539 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:30.904205 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8cf5d2e8-6e37-43b1-bb70-511878b59cb1 req-e34a0136-136d-4ee0-a6d5-adae081f0539 service nova] Creating event network-vif-deleted:0842c0bf-da7f-4516-8d48-8de89e87e2da for instance 31d2f5ef-7832-4505-891d-61f915ca8185 on n-h2-828148-1 Mar 29 02:23:30.909172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8cf5d2e8-6e37-43b1-bb70-511878b59cb1 req-e34a0136-136d-4ee0-a6d5-adae081f0539 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073546 Mar 29 02:23:30.910275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1747/3275] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:30.970802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:30.979400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fd6247f-5f3a-45c8-8a29-8a38fb24e760 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1501 microversion: 2.1 time: 0.502176 Mar 29 02:23:30.980443 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1529/3276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:30 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1501 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:30.996500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:30.997298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:31.006491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.006936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.008267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.008729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.052604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:31.053393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:31.065646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.069451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.070386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.071548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.188902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.189460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.190023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lazy-loading 'fault' on Instance uuid 31d2f5ef-7832-4505-891d-61f915ca8185 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:31.263984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a74618b933442cb404c2732a31d4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d93ba3926564c87b6059d8e20f556e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:31.273755 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff9cf323-4891-4b8b-9c71-ec8aa78ead9b tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 200 len: 1303 microversion: 2.1 time: 0.228686 Mar 29 02:23:31.274796 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1530/3277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:31 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:31.280859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:31.281773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:31.289910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.290562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.291328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.291759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.428782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:31.450635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f30edd9-dc3d-4674-a4de-b678bb44c6b3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1221 microversion: 2.1 time: 0.174545 Mar 29 02:23:31.451968 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1531/3278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:31 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1221 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:31.752786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:31.761655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0924748-8c1d-467f-9265-93b011ee070a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1501 microversion: 2.1 time: 0.769312 Mar 29 02:23:31.762478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1748/3279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:30 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1501 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:31.785369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:31.786324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:31.803877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.803877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.803877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.803877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.850594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:31.851206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:31.865702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.866531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.867642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:31.868239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:31.875083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:32.318222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-129c84eb-c246-42fe-b9f0-00df4f568028 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 204 len: 0 microversion: 2.1 time: 0.537924 Mar 29 02:23:32.324538 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1532/3280] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:31 2022] DELETE /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:23:32.329938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:32.330641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:32.348996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.350131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.353356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.353356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.380584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:32.395144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7a13ccae-b79f-4504-ae32-90a722ed0998 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1657 microversion: 2.1 time: 0.548175 Mar 29 02:23:32.409359 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1749/3281] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:31 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1657 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:32.415143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:32.416103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:32.426006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.426827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.427828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.429564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.453192 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. Mar 29 02:23:32.454158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:32.455279 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc55e47b-1cc0-40d2-9db1-fc4d775bb822 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 404 len: 111 microversion: 2.1 time: 0.129944 Mar 29 02:23:32.456043 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1533/3282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:32 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:32.462360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b5999a8-d5d4-4b33-9683-f33cc77f11ef tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:32.474620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b5999a8-d5d4-4b33-9683-f33cc77f11ef tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.475203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b5999a8-d5d4-4b33-9683-f33cc77f11ef tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.540129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b5999a8-d5d4-4b33-9683-f33cc77f11ef tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Going to try to start instance {{(pid=103514) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 02:23:32.826531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b5999a8-d5d4-4b33-9683-f33cc77f11ef tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.368623 Mar 29 02:23:32.828954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1534/3283] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:23:32 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:32.834560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:32.835529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:32.846888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.847501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:32.848360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:32.848879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:33.042367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:33.055328 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f92a3c94-c156-408c-86b1-9f8d6b3abae6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1277 microversion: 2.1 time: 0.224965 Mar 29 02:23:33.066909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1535/3284] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:32 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:33.066909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:33.067346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:33.084776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:33.085619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:33.087277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:33.087845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:33.163523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:33.172934 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5b1a39d-e038-4dcd-a7bc-314573131ee0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1507 microversion: 2.1 time: 0.761171 Mar 29 02:23:33.174064 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1750/3285] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:32 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1507 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:34.074243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:34.074869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:34.094731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:34.098188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:34.098188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:34.098188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:34.109131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:34.121237 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37c3ed5c-ec5f-4a70-8868-18db19894812 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1666 microversion: 2.1 time: 1.060411 Mar 29 02:23:34.121823 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1536/3286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:33 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1666 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:34.189317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:34.190599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:34.204956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:34.205402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:34.206186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:34.206620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:34.446525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:34.462650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-116b839a-c2c5-48cf-bdd2-df4677e31670 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1275 microversion: 2.1 time: 0.390918 Mar 29 02:23:34.474503 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1751/3287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:34 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1275 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:35.138138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:35.139099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:35.147270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:35.148022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:35.149038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:35.149674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:35.456500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:35.465867 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03ebc1d2-f8b7-473a-9237-213d7a2e4f40 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1666 microversion: 2.1 time: 0.331522 Mar 29 02:23:35.477422 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1752/3288] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:35 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1666 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:35.482624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:35.483358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:35.491707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:35.492359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:35.493244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:35.493673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:35.629502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:35.642924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-424705b1-36b1-45f0-a43c-a5bf2bfc3cf5 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1275 microversion: 2.1 time: 0.163889 Mar 29 02:23:35.644123 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1753/3289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:35 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:35.788560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:35.797678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9655d15-ca3d-44bd-994f-150e6bbde178 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1507 microversion: 2.1 time: 1.611963 Mar 29 02:23:35.798885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1537/3290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:34 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1507 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:36.484283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:36.485565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:36.500341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.500811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:36.506319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.506777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:36.660906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:36.662232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:36.678531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.681674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:36.691086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.692077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:36.926940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:36.943211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d58d4615-09a4-473e-a124-16ff84adca60 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1275 microversion: 2.1 time: 0.286873 Mar 29 02:23:36.943789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1538/3291] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:36 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:36.947973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:36.948571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:36.965493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.965937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:36.966708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:36.967133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:37.353736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:37.363160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a3a0fb82-6592-4ff0-894c-c90b7aef1cb1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1666 microversion: 2.1 time: 0.883499 Mar 29 02:23:37.378279 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1754/3292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:36 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1666 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:38.282871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a1cbb9de-660a-4786-9e72-eb343c0a743b req-2da95eaf-83b7-44d8-a54e-6f327e58c670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f1e724-6f07-435a-8fc7-8dd2d218eb12", "name": "network-vif-deleted", "tag": "d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:38.284809 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:38.284809 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:38.300463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a1cbb9de-660a-4786-9e72-eb343c0a743b req-2da95eaf-83b7-44d8-a54e-6f327e58c670 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:38.300941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a1cbb9de-660a-4786-9e72-eb343c0a743b req-2da95eaf-83b7-44d8-a54e-6f327e58c670 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:38.325675 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a1cbb9de-660a-4786-9e72-eb343c0a743b req-2da95eaf-83b7-44d8-a54e-6f327e58c670 service nova] Creating event network-vif-deleted:d40fcdb3-f897-4463-bca6-5f2d4a1d3e4c for instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 on n-h1-828148-1 Mar 29 02:23:38.330848 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a1cbb9de-660a-4786-9e72-eb343c0a743b req-2da95eaf-83b7-44d8-a54e-6f327e58c670 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484508 Mar 29 02:23:38.332125 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1755/3293] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:38.337515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:38.338429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:38.350618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:38.350861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:38.352607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:38.353265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:38.445201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:38.454037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-563b280a-8a63-4a5c-ae5d-0cb21ba92946 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 200 len: 1507 microversion: 2.1 time: 1.509236 Mar 29 02:23:38.454606 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1539/3294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:36 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 1507 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:38.468820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:38.469468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:38.477742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:38.478528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:38.479462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:38.479898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:38.721080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:38.731357 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1936e52f-0894-44a1-966b-11ddb2d8dc6a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.396020 Mar 29 02:23:38.731357 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1756/3295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:38 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:39.399524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:39.426355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f56f760a-805b-47aa-aebb-b554f9ee0e8e tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.970246 Mar 29 02:23:39.429140 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1540/3296] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:38 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:39.448725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:39.450492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:39.469938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:39.471934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:39.472873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:39.474102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:39.475504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:39.475949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:39.495059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:39.495508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:39.496291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:39.496721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:39.571920 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. Mar 29 02:23:39.572667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:39.573532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8c06264-462d-457c-b224-aac83a7d4cd6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 404 len: 111 microversion: 2.1 time: 0.106533 Mar 29 02:23:39.583514 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1541/3297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:39 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:39.604226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1440032940", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff676c7f-9045-4fad-b565-a27f45650edb"}], "security_groups": [{"name": "tempest-securitygroup--1549505351"}], "key_name": "tempest-keypair-541343059", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:39.829242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:39.837822 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b7bb1f0c-49ac-49fe-b09b-4c7e3f0cedcc tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.393967 Mar 29 02:23:39.838923 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1757/3298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:39 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:39.856062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: .version_select at 0x7f8724172430>, body: {"keypair": {"name": "tempest-key-913870920"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:39.880350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:39.885688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:40.224568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] validate_networks() for [('ff676c7f-9045-4fad-b565-a27f45650edb', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:23:40.329330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:40.335646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:40.351799 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ed0e332-dca6-4280-a4de-70643785c0ea tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.511482 Mar 29 02:23:40.352388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1758/3299] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:23:39 2022] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:40.357374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:40.358055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:40.370645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.371386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:40.372502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.373140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:40.591836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:40.601020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4cdcfd6e-5220-4a8b-aa5c-e7a5f7af8d7a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.247187 Mar 29 02:23:40.601592 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1759/3300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:40 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:40.606135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:40.606784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:40.617384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.617844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:40.618634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.619072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:40.940261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:40.948981 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a442de8-cca9-49f6-ad3d-85c22af805e7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.346311 Mar 29 02:23:40.949788 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1760/3301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:40 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:40.954749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e237aef-9600-48e5-87f5-3be5d476763b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '.version_select at 0x7f87242e8700>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:40.957452 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-1e237aef-9600-48e5-87f5-3be5d476763b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:23:40.962566 n-d-828148-1 devstack@n-api.service[103513]: WARNING oslo_db.sqlalchemy.utils [None req-1e237aef-9600-48e5-87f5-3be5d476763b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Unique keys not in sort_keys. The sorting order may be unstable. Mar 29 02:23:40.967747 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e237aef-9600-48e5-87f5-3be5d476763b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.017220 Mar 29 02:23:40.976360 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1761/3302] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:23:40 2022] GET /compute/v2.1/os-keypairs => generated 544 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:40.976360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:40.976360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:40.986243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.986773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:40.987624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:40.989202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:41.293485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:41.302803 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e0522c27-be7f-4642-84ac-c9a62893974a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.333474 Mar 29 02:23:41.308941 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1762/3303] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:40 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:41.311892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2082617606", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-key-913870920", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:41.412252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:23:42.087330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:42.088785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:42.089742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:42.090580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:42.092742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:42.102084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.109863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.109863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.109863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.125125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:42.131606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:42.144658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:42.147446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:42.233780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:23:42.234226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:23:42.234658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:23:42.235121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:23:42.235445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:23:42.248069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.249476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.250469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.250902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.268875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:23:42.274597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:23:42.293055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:23:42.293225 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7ab0ff46-83f9-4e2e-94c7-ecec72f08130 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.695820 Mar 29 02:23:42.293323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:23:42.293436 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1542/3304] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:23:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:42.297376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:42.298314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:42.311314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.315350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.315350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.315350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.452945 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4f8bbae-3e92-4097-9d52-e6fd100f13d0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146889 Mar 29 02:23:42.453622 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1763/3305] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:23:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:23:42.465727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-915a82e1-1a1d-4600-8a11-9d25c6f4a833 req-3ded6466-89db-4f85-b021-d79ea2865078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0998d63-e2a2-4ea4-b29b-2af02357cb67", "tag": "ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:42.468457 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:42.468457 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:42.477251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-915a82e1-1a1d-4600-8a11-9d25c6f4a833 req-3ded6466-89db-4f85-b021-d79ea2865078 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.477690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-915a82e1-1a1d-4600-8a11-9d25c6f4a833 req-3ded6466-89db-4f85-b021-d79ea2865078 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.494894 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-915a82e1-1a1d-4600-8a11-9d25c6f4a833 req-3ded6466-89db-4f85-b021-d79ea2865078 service nova] Creating event network-changed:ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf for instance f0998d63-e2a2-4ea4-b29b-2af02357cb67 on n-h1-828148-1 Mar 29 02:23:42.501739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-915a82e1-1a1d-4600-8a11-9d25c6f4a833 req-3ded6466-89db-4f85-b021-d79ea2865078 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040916 Mar 29 02:23:42.501739 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1764/3306] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:42.506923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:42.507174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:42.515309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.515996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.516949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.517529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.695152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:42.719566 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b52201c2-bcf9-4392-a68d-b5d6ac11300c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.426368 Mar 29 02:23:42.726929 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1543/3307] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:42 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:42.754421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:42.756643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:42.781335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.782062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.783011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:42.784750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:42.809193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:42.831607 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae48f246-8559-4b72-9e55-aa4ff03f2f17 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.329062 Mar 29 02:23:42.859244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1765/3308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:42 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:42.882762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f82b985-078a-42d3-94b6-31b8f12c3319 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:42.883797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f82b985-078a-42d3-94b6-31b8f12c3319 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:42.902126 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. Mar 29 02:23:42.902738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:42.903561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c4b10b9-0a77-4c7e-afaa-307421ee5b45 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 404 len: 111 microversion: 2.1 time: 0.175473 Mar 29 02:23:42.908972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1544/3309] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:42 2022] DELETE /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:42.915671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5853290-66a9-4822-ba23-9cfdee2f3d41 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:42.916456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5853290-66a9-4822-ba23-9cfdee2f3d41 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:42.995436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5853290-66a9-4822-ba23-9cfdee2f3d41 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:43.004528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5853290-66a9-4822-ba23-9cfdee2f3d41 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1228 microversion: 2.1 time: 0.093829 Mar 29 02:23:43.017714 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1545/3310] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:42 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:43.029347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:43.032499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.047973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f82b985-078a-42d3-94b6-31b8f12c3319 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:43.056072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f82b985-078a-42d3-94b6-31b8f12c3319 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1241 microversion: 2.1 time: 0.195665 Mar 29 02:23:43.056641 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1766/3311] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:42 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:43.061371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.063412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.064592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.065275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.072301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:43.078384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 31d2f5ef-7832-4505-891d-61f915ca8185] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.101365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.102089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.103452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.104148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.204458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lazy-loading 'flavor' on Instance uuid c2a546b1-5d06-4e78-9a11-7e307db6ef2c {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:43.214863 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. Mar 29 02:23:43.215903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 31d2f5ef-7832-4505-891d-61f915ca8185 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:43.216933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8833ef81-9924-4385-8e4a-36f393829368 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185" status: 404 len: 111 microversion: 2.1 time: 0.154357 Mar 29 02:23:43.217982 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1767/3312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:43 2022] GET /compute/v2.1/servers/31d2f5ef-7832-4505-891d-61f915ca8185 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:43.227183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:43.229564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.249327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.254514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.256096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.256774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.351699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. Mar 29 02:23:43.352577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:43.353719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f17d1b6-8e4d-4756-8388-87b4514d622f tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "DELETE /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 404 len: 111 microversion: 2.1 time: 0.131651 Mar 29 02:23:43.354759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1768/3313] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:43 2022] DELETE /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:23:43.363402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:43.364357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] [instance: 755b4b67-445d-4e8b-91ba-22f4d7052de6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.377657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.381796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.385458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.385458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.508244 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] HTTP exception thrown: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. Mar 29 02:23:43.508887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] Returning 404 to user: Instance 755b4b67-445d-4e8b-91ba-22f4d7052de6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:23:43.509728 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f8086a9-59c9-45a3-a769-8f0190e70914 tempest-ServersTestMultiNic-1631368003 tempest-ServersTestMultiNic-1631368003-project] 10.222.0.36 "GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6" status: 404 len: 111 microversion: 2.1 time: 0.150474 Mar 29 02:23:43.511722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1769/3314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:43 2022] GET /compute/v2.1/servers/755b4b67-445d-4e8b-91ba-22f4d7052de6 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:23:43.665251 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09af4067-69f2-42f0-a959-43b77108ac42 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.645872 Mar 29 02:23:43.669431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1546/3315] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:23:43 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:23:43.678155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:43.678780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.688627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.701611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.702720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.703320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.875796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:43.876591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:43.890991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.896422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:43.897607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:43.898615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:44.277883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:44.286683 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1a0a7d2-b10f-457c-a7ca-31ba184304d0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1678 microversion: 2.1 time: 0.611995 Mar 29 02:23:44.287820 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1770/3316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:43 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1678 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:44.292522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:44.293361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:44.300828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:44.301537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:44.302480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:44.303070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:44.463379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:44.471526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b47802b-715a-407e-bff4-89b6addacc83 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1232 microversion: 2.1 time: 0.182285 Mar 29 02:23:44.472089 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1771/3317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:44 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:44.476744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:44.479194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:44.487493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:44.487948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:44.488753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:44.489287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:44.660431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:44.670156 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf140c02-eedd-400e-bdc7-d958dea1d8f2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.799146 Mar 29 02:23:44.680019 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1547/3318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:43 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:44.717005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:44.730235 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b32606d-fae3-457c-81e5-1ee66a1d6611 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1237 microversion: 2.1 time: 0.256711 Mar 29 02:23:44.731605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1772/3319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:44 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1237 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:45.304733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:45.305378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:45.312745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.313247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.314025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.314466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.490241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:45.490796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:45.503393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.504088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.509320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.509931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.618114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:45.633348 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a24ad84d-33be-4de3-862e-bd26f4a22705 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1661 microversion: 2.1 time: 0.329121 Mar 29 02:23:45.634076 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1548/3320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:45 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1661 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:45.659373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:45.660077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:45.671943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.677412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.677412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.677412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.830730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:45.857123 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60819bc8-7eac-44ed-b2d0-a8903d2887f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1280 microversion: 2.1 time: 0.366796 Mar 29 02:23:45.863074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1773/3321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:45 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1280 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:45.880252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:45.881693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:45.890918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.891588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:45.892529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:45.893145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.033477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a011cf28-0de4-4361-959c-29069df62186 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action" status: 202 len: 0 microversion: 2.1 time: 0.376421 Mar 29 02:23:46.034486 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1549/3322] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:23:45 2022] POST /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:23:46.041128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:46.041825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:46.051042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.051671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.052643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.053259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.228884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:46.258147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3987a17e-faa6-4da6-8e9b-1023b37765a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1299 microversion: 2.1 time: 0.221051 Mar 29 02:23:46.271889 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1550/3323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:46 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1299 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:46.291510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:46.296454 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:46.296454 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:46.303966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:46.304823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Searching by: {'deleted': False, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:23:46.320474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.323567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.323567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.323846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.438318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:23:46.609865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd8663e8-4480-4e21-b862-d456224255a0 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.336786 Mar 29 02:23:46.623889 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1551/3324] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:23:46 2022] GET /compute/v2.1/servers => generated 340 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:46.638490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:46.639938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:46.660295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.660788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.661723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.663269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.820677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:46.836315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ee7698e8-f57b-4be5-9a76-2b0f1a7b8d75 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.971845 Mar 29 02:23:46.837607 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1774/3325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:45 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:46.851438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:46.859185 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:46.859185 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:23:46.859697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:46.860959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Searching by: {'deleted': False, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:23:46.867182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.867880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.868812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:46.869448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:46.987920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:23:47.120677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:47.132191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:47.132698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:47.266897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:47.298313 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71898c2d-0c1f-40da-92eb-7748d970cbb8 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1667 microversion: 2.1 time: 0.673096 Mar 29 02:23:47.300199 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1552/3326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:46 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1667 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:47.324334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:47.328570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:47.345407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:47.347213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:47.348172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:47.349363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:47.696591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:47.713426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b86de5c7-d5dc-4dbf-b4f5-a92a9a532083 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1286 microversion: 2.1 time: 0.401819 Mar 29 02:23:47.714018 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1553/3327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:47 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1286 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:47.731821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:47.739439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:47.753957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:47.754410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:47.755200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:47.755635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.055487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:48.070956 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-57bd4ef4-5c2c-4932-8c0d-ff126244ab58 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1299 microversion: 2.1 time: 0.341830 Mar 29 02:23:48.079358 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1554/3328] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:47 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:48.096009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bc88b0f-9ecd-4797-a8d7-43a6572fae91 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 1.257093 Mar 29 02:23:48.096943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1775/3329] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:23:46 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:48.098142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:48.101163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:48.113040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ba40e98-c22c-452d-808e-2b6dee7a1c00 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:48.129357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.130139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.133412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.134729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.142438 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ba40e98-c22c-452d-808e-2b6dee7a1c00 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032899 Mar 29 02:23:48.143342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1776/3330] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Mar 29 02:23:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:23:48.317011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:48.317846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:48.329145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.329601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.338707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.339209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.932014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:48.944382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50c3b4dd-30e5-4c65-879c-ca834ae24fbe tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.862935 Mar 29 02:23:48.945648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1555/3331] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:48 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:48.950994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:48.953298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:48.962874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.963131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:48.970822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:48.971639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:49.120788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:49.428041 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:23:49.501915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:49.516322 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbbdeb22-98d4-48b2-850d-30e37be80c1a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1667 microversion: 2.1 time: 1.202519 Mar 29 02:23:49.517983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1777/3332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:48 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1667 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:23:49.533090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-531e78ef-91da-4bfb-bd84-8b9790b578e7 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 204 len: 0 microversion: 2.1 time: 0.584945 Mar 29 02:23:49.537806 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1556/3333] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:48 2022] DELETE /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 0 bytes in 588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:23:49.544745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:49.545964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:49.547360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:49.548007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:49.555978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:49.557934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:49.557934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:49.558841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:49.564281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:49.564745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:49.565561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:49.566000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:50.317894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:50.335937 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87ce6458-f939-4989-a26a-e3955c67a0b8 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 0.793405 Mar 29 02:23:50.336305 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1557/3334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:49 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:50.354042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:50.354919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:50.364909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:50.368206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:50.368206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:50.368206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:50.435207 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 35988. Mar 29 02:23:51.094875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:51.109201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ea1e221c-7131-49ed-b5d2-e5d7a21f5547 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1716 microversion: 2.1 time: 0.771050 Mar 29 02:23:51.109791 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1558/3335] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:50 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1716 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:51.125614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:51.126244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:51.143525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:51.145587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:51.146393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:51.146831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:52.097567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:52.105849 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e8f0cd3-04a8-4eed-a984-bff501a0bb14 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 0.994982 Mar 29 02:23:52.106431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1559/3336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:51 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:52.119593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:52.121826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:52.138494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:52.141408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:52.142409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:52.143007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:52.263953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:52.274201 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-009876be-08f1-4b94-8a3a-cfcf1dd216be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 2.739853 Mar 29 02:23:52.285560 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1778/3337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:49 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:52.291445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:52.292275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:52.303079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:52.305899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:52.305899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:52.305899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:53.092161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:53.106951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87027443-d782-4f3c-b04a-080d722d2dc2 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.999410 Mar 29 02:23:53.109665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1560/3338] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:52 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:53.387784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d4472a78-dce1-4b75-9036-0f57315a61ba req-d444ac56-51d8-4d7a-94f3-62f5407dbfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0998d63-e2a2-4ea4-b29b-2af02357cb67", "name": "network-vif-plugged", "status": "completed", "tag": "ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:53.390916 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:53.390916 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:53.414955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d4472a78-dce1-4b75-9036-0f57315a61ba req-d444ac56-51d8-4d7a-94f3-62f5407dbfe7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:53.416172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d4472a78-dce1-4b75-9036-0f57315a61ba req-d444ac56-51d8-4d7a-94f3-62f5407dbfe7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:53.448197 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d4472a78-dce1-4b75-9036-0f57315a61ba req-d444ac56-51d8-4d7a-94f3-62f5407dbfe7 service nova] Creating event network-vif-plugged:ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf for instance f0998d63-e2a2-4ea4-b29b-2af02357cb67 on n-h1-828148-1 Mar 29 02:23:53.469871 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d4472a78-dce1-4b75-9036-0f57315a61ba req-d444ac56-51d8-4d7a-94f3-62f5407dbfe7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.353227 Mar 29 02:23:53.469871 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1561/3339] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:53.487434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:53.489433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:53.499483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:53.500354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:53.501342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:53.501980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:53.682241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:53.699396 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dddc2ff6-5557-4b42-95ab-2b46c0f05f8a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 1.412394 Mar 29 02:23:53.713463 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1779/3340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:52 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:53.725399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:53.731626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:53.747081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:53.748429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:53.750607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:53.756596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:54.568789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:54.579608 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab461c35-a81c-4502-bae0-26b8195e2674 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1716 microversion: 2.1 time: 1.109890 Mar 29 02:23:54.590014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1562/3341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:53 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1716 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:54.593994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:54.596892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:54.613169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:54.620099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:54.620099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:54.620099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:54.707585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:54.723872 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d83c08bb-2dc6-44e1-bf7c-b1d97d5e03a3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1317 microversion: 2.1 time: 1.009091 Mar 29 02:23:54.724577 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1780/3342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:53 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1317 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:54.744258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:54.745353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:54.766086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:54.766622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:54.767647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:54.767761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:55.479992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:55.499022 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f091f7e9-d0e2-47db-967e-972be94617d7 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1670 microversion: 2.1 time: 0.908618 Mar 29 02:23:55.499993 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1563/3343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:54 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1670 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:55.755620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d9433ec1-7f63-477a-bba0-e003ed622d92 req-4d09f8da-235b-4525-8bb5-5954709f4430 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f947f40e-8500-48ed-b12c-7e32a8e8b4c6", "tag": "c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:55.759250 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:55.759250 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:55.771791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d9433ec1-7f63-477a-bba0-e003ed622d92 req-4d09f8da-235b-4525-8bb5-5954709f4430 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:55.772589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d9433ec1-7f63-477a-bba0-e003ed622d92 req-4d09f8da-235b-4525-8bb5-5954709f4430 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:55.815548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d9433ec1-7f63-477a-bba0-e003ed622d92 req-4d09f8da-235b-4525-8bb5-5954709f4430 service nova] Creating event network-changed:c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a for instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 on n-h2-828148-1 Mar 29 02:23:55.826087 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d9433ec1-7f63-477a-bba0-e003ed622d92 req-4d09f8da-235b-4525-8bb5-5954709f4430 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.320581 Mar 29 02:23:55.827424 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1564/3344] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:55.847481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:55.880208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:55.901930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:55.902722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:55.904958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:55.905566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:56.062633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:56.077544 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38647a84-8319-4c53-b0e3-200a5913a5af tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 1.341544 Mar 29 02:23:56.078981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1781/3345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:54 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:56.085934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:56.086871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:56.096566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:56.097164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:56.098730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:56.099243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:56.214346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:23:56.231671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Working on deleting snapshot 07cbe7c4-1833-47e0-ab9b-e5b57da67105 from shelved instance... Mar 29 02:23:56.867413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:56.880631 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db0d796a-ad86-479c-a8ff-28b06190216b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 1.048226 Mar 29 02:23:56.890198 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1565/3346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:55 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:56.890198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:56.890818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:56.913327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:56.914023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:56.915514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:56.916125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:57.061198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:57.062079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:57.062724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lazy-loading 'fault' on Instance uuid 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:23:57.494638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f52cb271964888a35b14a72a2a6760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26991bf8ca704b6ea1fbb4fffb74d369', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:57.504605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c231762f-8a33-469f-a7b2-d5ca145bb580 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 200 len: 1367 microversion: 2.1 time: 0.621861 Mar 29 02:23:57.509675 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1566/3347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:56 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 1367 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:57.523888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:57.524754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:57.534181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:57.535004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:57.536002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:57.536649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:58.243947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Doing local delete in cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103513) _delete /opt/stack/nova/nova/compute/api.py:2387}} Mar 29 02:23:58.244774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:58.245451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:58.248278 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 29 02:23:58.252597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] deallocate_for_instance() {{(pid=103513) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1655}} Mar 29 02:23:58.479486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:58.489573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05910aa6-a2c3-4e9d-b3de-4bf061dca98c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1466 microversion: 2.1 time: 0.977174 Mar 29 02:23:58.490438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1567/3348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:57 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1466 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:58.495902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2c78a75b-f781-4a05-92ce-20e6c0f72858 req-30a590c2-7339-4092-bc9c-88a816239b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3aa2f3-0ae2-4a47-91e6-352b1d1308df", "name": "network-vif-deleted", "tag": "12694fe8-e9b2-4f21-abde-c0d8354a4a3c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:58.498351 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:58.498351 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:23:58.508576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2c78a75b-f781-4a05-92ce-20e6c0f72858 req-30a590c2-7339-4092-bc9c-88a816239b62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:58.509841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2c78a75b-f781-4a05-92ce-20e6c0f72858 req-30a590c2-7339-4092-bc9c-88a816239b62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:58.539113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2c78a75b-f781-4a05-92ce-20e6c0f72858 req-30a590c2-7339-4092-bc9c-88a816239b62 service nova] Creating event network-vif-deleted:12694fe8-e9b2-4f21-abde-c0d8354a4a3c for instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df on n-h1-828148-1 Mar 29 02:23:58.545688 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2c78a75b-f781-4a05-92ce-20e6c0f72858 req-30a590c2-7339-4092-bc9c-88a816239b62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053636 Mar 29 02:23:58.546991 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1568/3349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:23:58.567619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:58.568690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:58.588240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:58.591906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:58.593145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:58.593752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:59.428586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:59.437774 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-604448a4-e0a8-4be8-9020-6e55983837c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 0.889172 Mar 29 02:23:59.446990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1569/3350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:58 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:59.452789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:23:59.453591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:23:59.463660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:59.464347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:59.465307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:23:59.467631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:23:59.942460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:23:59.952917 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83e1ce27-b9d3-4425-927f-22afec2fbe4c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 0.504551 Mar 29 02:23:59.957225 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1570/3351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:23:59 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:23:59.988025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9eb7f9b8-d469-4a7d-9a20-2e8a5b070eca req-0722c4fa-e616-490b-8a5c-46f44d8e6131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58040cdd-dbaa-4b7c-b436-ef0992f7e282", "tag": "8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:23:59.989793 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:23:59.989793 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:00.018455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9eb7f9b8-d469-4a7d-9a20-2e8a5b070eca req-0722c4fa-e616-490b-8a5c-46f44d8e6131 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.018579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9eb7f9b8-d469-4a7d-9a20-2e8a5b070eca req-0722c4fa-e616-490b-8a5c-46f44d8e6131 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.047454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9eb7f9b8-d469-4a7d-9a20-2e8a5b070eca req-0722c4fa-e616-490b-8a5c-46f44d8e6131 service nova] Creating event network-changed:8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58 for instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 on n-h2-828148-1 Mar 29 02:24:00.053728 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9eb7f9b8-d469-4a7d-9a20-2e8a5b070eca req-0722c4fa-e616-490b-8a5c-46f44d8e6131 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094315 Mar 29 02:24:00.055500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1571/3352] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:00.061612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:00.062552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:00.079456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.079863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.080650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.081115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.749694 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-281d5031-5d1a-4950-bb43-46f14d4d356b tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1617 microversion: 2.1 time: 0.692356 Mar 29 02:24:00.750708 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1572/3353] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:00 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1617 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:00.755569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:00.756283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] [instance: 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:00.764704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.765499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.766643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.767527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.826199 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] HTTP exception thrown: Instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df could not be found. Mar 29 02:24:00.827182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Returning 404 to user: Instance 3e3aa2f3-0ae2-4a47-91e6-352b1d1308df could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:00.828576 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4da38c4d-c2c5-4c8d-8930-387d1de152b9 tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df" status: 404 len: 111 microversion: 2.1 time: 0.076588 Mar 29 02:24:00.829860 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1573/3354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:00 2022] GET /compute/v2.1/servers/3e3aa2f3-0ae2-4a47-91e6-352b1d1308df => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:00.844339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:00.845002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:00.853051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.853724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:00.854684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:00.855256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:01.718179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Updating instance_info_cache with network_info: [] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:24:01.828481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:01.843376 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dab09989-ecf6-43c6-a5f6-0ed023359ef3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 1.012283 Mar 29 02:24:01.846369 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1574/3355] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:00 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:01.854588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5711adc2-b51a-4a73-a1d0-fc041a78505f tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] Calling method '.version_select at 0x7f87241caa60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:01.955551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5711adc2-b51a-4a73-a1d0-fc041a78505f tempest-ServersTestManualDisk-1407785977 tempest-ServersTestManualDisk-1407785977-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940028873" status: 202 len: 0 microversion: 2.1 time: 0.108065 Mar 29 02:24:01.956939 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1575/3356] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:24:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940028873 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:24:01.963378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:01.965325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:01.982339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:01.982967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:01.987312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:01.988069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:02.449601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:02.462097 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4a44feae-e53d-4217-8608-889750ced0e3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 0.503821 Mar 29 02:24:02.463374 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1576/3357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:01 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:02.471027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-321109618", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "f861d750-c866-4f2d-ac1b-26bd1b476195"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:02.622268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:24:03.289292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.scheduler.client.report [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Cannot delete allocation for a88d8eec-fccf-451e-91af-95d09426c4ce consumer in placement as consumer does not exist {{(pid=103513) delete_allocation_for_instance /opt/stack/nova/nova/scheduler/client/report.py:2100}} Mar 29 02:24:03.380581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:03.381178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:03.381495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:03.381902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:03.382327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:03.395218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.398233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.399110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.399551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.427193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:03.433157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Getting quotas for user 151d3793a3ad446cbd0716780ed91ee5 and project a7c1d2a34e994f17bc4dd4f66439fbf1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:03.456821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:03.465359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:03.612615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-991f4261-0cd9-4275-b4f7-9b000e15caad tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144608 Mar 29 02:24:03.618701 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1577/3358] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:24:03.648116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f9a0114b-3626-4861-b5f1-e7114e7b5fe1 req-b1404ce8-f0a0-4c6c-b32c-2629b1fe6e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88d8eec-fccf-451e-91af-95d09426c4ce", "name": "network-vif-deleted", "tag": "175edd8d-0b34-4f3e-9762-68390802471d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:03.656881 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:03.656881 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:03.687748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f9a0114b-3626-4861-b5f1-e7114e7b5fe1 req-b1404ce8-f0a0-4c6c-b32c-2629b1fe6e37 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.688469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f9a0114b-3626-4861-b5f1-e7114e7b5fe1 req-b1404ce8-f0a0-4c6c-b32c-2629b1fe6e37 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.718839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_external_events [req-f9a0114b-3626-4861-b5f1-e7114e7b5fe1 req-b1404ce8-f0a0-4c6c-b32c-2629b1fe6e37 service nova] Unable to find a host for instance a88d8eec-fccf-451e-91af-95d09426c4ce. Dropping event network-vif-deleted {{(pid=103514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Mar 29 02:24:03.720177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f9a0114b-3626-4861-b5f1-e7114e7b5fe1 req-b1404ce8-f0a0-4c6c-b32c-2629b1fe6e37 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.100114 Mar 29 02:24:03.721278 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1578/3359] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 102 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 29 02:24:03.729024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-17b88d7c-4657-46aa-a331-9ed7b0a879dc req-966caac3-d9d8-48e9-80b6-70b5e66c8c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947f40e-8500-48ed-b12c-7e32a8e8b4c6", "name": "network-vif-plugged", "status": "completed", "tag": "c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:03.733537 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:03.733537 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:03.745226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-17b88d7c-4657-46aa-a331-9ed7b0a879dc req-966caac3-d9d8-48e9-80b6-70b5e66c8c50 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.746403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-17b88d7c-4657-46aa-a331-9ed7b0a879dc req-966caac3-d9d8-48e9-80b6-70b5e66c8c50 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.771916 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-17b88d7c-4657-46aa-a331-9ed7b0a879dc req-966caac3-d9d8-48e9-80b6-70b5e66c8c50 service nova] Creating event network-vif-plugged:c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a for instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 on n-h2-828148-1 Mar 29 02:24:03.779186 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-17b88d7c-4657-46aa-a331-9ed7b0a879dc req-966caac3-d9d8-48e9-80b6-70b5e66c8c50 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055094 Mar 29 02:24:03.781872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1579/3360] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:03.806107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:03.807067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:03.819518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.822123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.842201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.844730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.953193 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ca2e1c4-d15c-4a91-9252-1d3dd9370df0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 204 len: 0 microversion: 2.1 time: 7.872674 Mar 29 02:24:03.954074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1782/3361] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:23:56 2022] DELETE /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 0 bytes in 7874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:03.966420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:03.970493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:03.993972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.994890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:03.998654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:03.999178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:04.425010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:04.437298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6493fd5-d5f2-4694-99d5-510bee152ef6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 0.652686 Mar 29 02:24:04.446431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1580/3362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:03 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:04.451573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f5a65bc6-8ae8-4865-9844-4c05e13fbe7f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:04.453172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f5a65bc6-8ae8-4865-9844-4c05e13fbe7f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:04.568953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f5a65bc6-8ae8-4865-9844-4c05e13fbe7f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:04.580277 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f5a65bc6-8ae8-4865-9844-4c05e13fbe7f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1216 microversion: 2.1 time: 0.139423 Mar 29 02:24:04.581597 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1581/3363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:04 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1216 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:04.585844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:04.586459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: a88d8eec-fccf-451e-91af-95d09426c4ce] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:04.609017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:04.613133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:04.613821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:04.613821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:04.613821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:04.620621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb64b4a2-f33e-4052-a577-664928d48c19 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1367 microversion: 2.1 time: 0.665066 Mar 29 02:24:04.622462 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1783/3364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:03 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1367 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:04.669557 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance a88d8eec-fccf-451e-91af-95d09426c4ce could not be found. Mar 29 02:24:04.670304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 404 to user: Instance a88d8eec-fccf-451e-91af-95d09426c4ce could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:04.671211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-54d1a099-6101-4a3a-9e00-f2c985c653d6 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce" status: 404 len: 111 microversion: 2.1 time: 0.088739 Mar 29 02:24:04.673161 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1582/3365] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:04 2022] GET /compute/v2.1/servers/a88d8eec-fccf-451e-91af-95d09426c4ce => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:04.681204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:04.682261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:04.690919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:04.691576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:04.692692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:04.693376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:04.759688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:05.092411 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96173b36-373c-4875-a429-452193d93e8c tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 204 len: 0 microversion: 2.1 time: 0.413437 Mar 29 02:24:05.093377 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1784/3366] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:04 2022] DELETE /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:05.101371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:05.102212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:05.120574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.121055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.121842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.123035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.594167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:05.604630 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1627c16-7879-4797-a503-fff7d58c6c99 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1466 microversion: 2.1 time: 0.506986 Mar 29 02:24:05.615082 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1583/3367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:05 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1466 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:05.633523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:05.636978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:05.657407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.658023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.658961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.669527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.759411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Calling method '.version_select at 0x7f8717ea8dc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:05.761120 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:05.761120 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:05.763040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.763867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.786437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.787163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.803346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.804047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.820454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7a66b7fe-2669-497b-b189-c8755100d3c9 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1742447745-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.614041 Mar 29 02:24:05.821380 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1785/3368] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:24:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:05.845570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:05.847319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:05.857985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.858701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:05.859852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:05.860499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.191976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:06.198821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:06.209067 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3828a52d-8a78-4321-a212-b164c4e224c1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 0.592555 Mar 29 02:24:06.209698 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1584/3369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:05 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:06.210087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-200dcd46-2e32-438c-99f4-cece1c039315 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1212 microversion: 2.1 time: 0.383443 Mar 29 02:24:06.225628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:06.226473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:06.227673 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1786/3370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:05 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1212 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:06.236680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.236800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.237806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.238576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.323278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc7c2612-6286-417d-bb39-7a442eea6fef tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-288596404", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.326272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-cc7c2612-6286-417d-bb39-7a442eea6fef tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] HTTP exception thrown: min_count must be <= max_count Mar 29 02:24:06.326904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc7c2612-6286-417d-bb39-7a442eea6fef tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Returning 400 to user: min_count must be <= max_count {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:06.327758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc7c2612-6286-417d-bb39-7a442eea6fef tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.098861 Mar 29 02:24:06.332453 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1787/3371] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/servers => generated 74 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:24:06.392782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dfe13ade-5df6-432b-a85e-7dbd9ffc338b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-983713159", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "max_count": 0}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.394275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dfe13ade-5df6-432b-a85e-7dbd9ffc338b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:06.395096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dfe13ade-5df6-432b-a85e-7dbd9ffc338b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.012923 Mar 29 02:24:06.395665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1788/3372] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:24:06.484761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6155a4c2-89cd-4722-bd46-f2ca8b1ab59b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-809897422", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "max_count": 2.5}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.486159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6155a4c2-89cd-4722-bd46-f2ca8b1ab59b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:06.486958 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6155a4c2-89cd-4722-bd46-f2ca8b1ab59b tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006597 Mar 29 02:24:06.496927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1789/3373] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:24:06.569096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-69f45ba6-793b-4be5-b54f-8857eb859a34 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1591697405", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 0}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.570584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-69f45ba6-793b-4be5-b54f-8857eb859a34 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:06.571792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-69f45ba6-793b-4be5-b54f-8857eb859a34 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007170 Mar 29 02:24:06.582001 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1790/3374] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:24:06.582368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:06.607133 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21373812-3dea-402b-9525-dbb1d96a59cd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1556 microversion: 2.1 time: 0.393652 Mar 29 02:24:06.610101 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1585/3375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:06 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1556 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:06.628120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:06.628730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:06.631252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:06.632049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:06.645477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.653847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.654295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.656605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.660323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.662129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.668398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.668398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:06.900157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:06.910181 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5588a6b-a74b-43c7-9e0c-2e09556dce1b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1466 microversion: 2.1 time: 0.283063 Mar 29 02:24:06.910993 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1586/3376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:06 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1466 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:06.927381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7220d112-d637-4641-9373-04a21a596b03 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-946748043", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 2.5}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.928960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7220d112-d637-4641-9373-04a21a596b03 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:06.929943 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7220d112-d637-4641-9373-04a21a596b03 tempest-MultipleCreateNegativeTestJSON-83254510 tempest-MultipleCreateNegativeTestJSON-83254510-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017672 Mar 29 02:24:06.930675 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1587/3377] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:24:06.943842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0de3dc15-892c-416f-b336-084a839dcfde req-8c130f35-8662-40b0-ab55-f669350d1955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58040cdd-dbaa-4b7c-b436-ef0992f7e282", "name": "network-vif-plugged", "status": "completed", "tag": "8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:06.945798 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:06.945798 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:06.967079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0de3dc15-892c-416f-b336-084a839dcfde req-8c130f35-8662-40b0-ab55-f669350d1955 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:06.971038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0de3dc15-892c-416f-b336-084a839dcfde req-8c130f35-8662-40b0-ab55-f669350d1955 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.003176 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0de3dc15-892c-416f-b336-084a839dcfde req-8c130f35-8662-40b0-ab55-f669350d1955 service nova] Creating event network-vif-plugged:8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58 for instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 on n-h2-828148-1 Mar 29 02:24:07.009068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0de3dc15-892c-416f-b336-084a839dcfde req-8c130f35-8662-40b0-ab55-f669350d1955 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076507 Mar 29 02:24:07.010162 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1588/3378] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:07.231334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:07.232295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:07.249265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.250450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.251417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.252045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.589416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4c1fbea-67a4-4aa5-93b3-d4bfbb59bdfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.967462 Mar 29 02:24:07.591469 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1791/3379] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:24:06 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-interface => generated 284 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:07.596720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:07.597346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:07.606349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.606349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.606349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.607267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.846760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:07.862738 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d01c22fd-55fe-41f9-bf5f-8c2c432d7beb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1274 microversion: 2.1 time: 0.269206 Mar 29 02:24:07.863944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1792/3380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:07 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:07.927189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:07.927998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:07.940941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.941688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:07.942663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:07.947641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:08.647112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:08.658715 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c4bc49c-b34f-4a34-8ac1-38bdccf833c0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1328 microversion: 2.1 time: 1.432547 Mar 29 02:24:08.671157 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1589/3381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:07 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1328 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:08.879749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:08.880356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:08.888016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:08.888689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:08.889636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:08.890223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:09.018886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:09.031103 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26efb024-07f8-459b-b4d2-be95249da4ce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1466 microversion: 2.1 time: 1.106882 Mar 29 02:24:09.032308 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1793/3382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:07 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1466 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:09.054991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:09.064888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbff623c-7286-40ba-a13a-05fbb597b4da tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1274 microversion: 2.1 time: 0.188658 Mar 29 02:24:09.076014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1590/3383] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:08 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:09.472642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-fff8387e-33a9-4a46-b751-24ef70a35f4b req-a611cdd2-0bac-400e-83dc-08e4be3198d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150eb6c6-0a7e-4a29-906f-1d86aaf95c08", "name": "network-vif-deleted", "tag": "5ab67be9-617b-4604-973b-85d4a5b92bb3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:09.476023 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:09.476023 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:09.500452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fff8387e-33a9-4a46-b751-24ef70a35f4b req-a611cdd2-0bac-400e-83dc-08e4be3198d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:09.501940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fff8387e-33a9-4a46-b751-24ef70a35f4b req-a611cdd2-0bac-400e-83dc-08e4be3198d5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:09.522416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-fff8387e-33a9-4a46-b751-24ef70a35f4b req-a611cdd2-0bac-400e-83dc-08e4be3198d5 service nova] Creating event network-vif-deleted:5ab67be9-617b-4604-973b-85d4a5b92bb3 for instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 on n-h1-828148-1 Mar 29 02:24:09.527367 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-fff8387e-33a9-4a46-b751-24ef70a35f4b req-a611cdd2-0bac-400e-83dc-08e4be3198d5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066506 Mar 29 02:24:09.532103 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1794/3384] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:09.676311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:09.677938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:09.698450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:09.699295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:09.700446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:09.701176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.063346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:10.064676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:10.078009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.078686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.079681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.081377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.196706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.197770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.199164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lazy-loading 'fault' on Instance uuid 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:10.333450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:10.347258 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-098ccafa-bd2a-47bb-becc-a93248b354fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1509 microversion: 2.1 time: 0.675152 Mar 29 02:24:10.351286 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1591/3385] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:09 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1509 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:10.358230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:10.365403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:10.379088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.379743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.382241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.383019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.555017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:10.571809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-898ff984-0079-4976-a811-b9376f949afe tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 200 len: 1305 microversion: 2.1 time: 0.525064 Mar 29 02:24:10.573629 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1795/3386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:10 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 1305 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:10.584316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:10.597470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8df3225e-202f-441e-8794-cd70824269c7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1274 microversion: 2.1 time: 0.244329 Mar 29 02:24:10.604876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:10.609010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1592/3387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:10 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1274 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:10.611062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:10.626316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.627148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:10.628375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:10.629638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.545239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ef151ada-3471-4c7e-bbe7-f6dbb7a076a9 req-b7c1286a-408e-4d74-8732-f5c4c105a43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f947f40e-8500-48ed-b12c-7e32a8e8b4c6", "tag": "c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:11.547301 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:11.547301 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:11.556735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ef151ada-3471-4c7e-bbe7-f6dbb7a076a9 req-b7c1286a-408e-4d74-8732-f5c4c105a43c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.557418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ef151ada-3471-4c7e-bbe7-f6dbb7a076a9 req-b7c1286a-408e-4d74-8732-f5c4c105a43c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.559503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:11.574326 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f007c72d-3c3b-42fd-b99e-ec109ac4309e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1509 microversion: 2.1 time: 0.988794 Mar 29 02:24:11.576385 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1796/3388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:10 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1509 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:11.576614 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ef151ada-3471-4c7e-bbe7-f6dbb7a076a9 req-b7c1286a-408e-4d74-8732-f5c4c105a43c service nova] Creating event network-changed:c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a for instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 on n-h2-828148-1 Mar 29 02:24:11.581965 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ef151ada-3471-4c7e-bbe7-f6dbb7a076a9 req-b7c1286a-408e-4d74-8732-f5c4c105a43c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041507 Mar 29 02:24:11.583259 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1593/3389] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:24:11.600768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:11.605513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:11.606866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:11.607538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 150eb6c6-0a7e-4a29-906f-1d86aaf95c08] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:11.617456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.618347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.619426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.620106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.629161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.629609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.630396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.634027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.698978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:11.725556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 could not be found. Mar 29 02:24:11.726552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 404 to user: Instance 150eb6c6-0a7e-4a29-906f-1d86aaf95c08 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:11.727677 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db7b6acf-8f1c-420c-803c-71e5ce0f4182 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08" status: 404 len: 111 microversion: 2.1 time: 0.131816 Mar 29 02:24:11.728530 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1797/3390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:11 2022] GET /compute/v2.1/servers/150eb6c6-0a7e-4a29-906f-1d86aaf95c08 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:11.733857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:11.735401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:11.746586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.748046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:11.749893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:11.750333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:12.204612 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c6e2e12-dc53-40d7-a9b6-87c2e6c650f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 204 len: 0 microversion: 2.1 time: 0.607385 Mar 29 02:24:12.205099 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1594/3391] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:11 2022] DELETE /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:12.211881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:12.212678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:12.234427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:12.235069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:12.236014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:12.236453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:12.343518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:12.823126 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb793c61-4460-46e7-94ac-8b25313645b5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 204 len: 0 microversion: 2.1 time: 0.616173 Mar 29 02:24:12.823954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1595/3392] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:12 2022] DELETE /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:12.831421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:12.834873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:12.858290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:12.859116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:12.860548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:12.861723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:13.136584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:13.151386 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f7cb09e-5dde-449e-9385-8eff91a831ba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1515 microversion: 2.1 time: 0.325737 Mar 29 02:24:13.152208 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1596/3393] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:12 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:13.163787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:13.164330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:13.184206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:13.184206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:13.184780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:13.185248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:13.440054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:13.450176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-678107d3-2763-45e2-8e57-b0aa81205bfb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 1.719845 Mar 29 02:24:13.461364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1798/3394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:11 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 1724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:13.636022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:13.644311 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-35d02161-b248-4dfb-ac61-794410c8d9c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1506 microversion: 2.1 time: 0.488294 Mar 29 02:24:13.651246 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1597/3395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:13 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1506 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:14.169497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:14.170396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:14.178373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:14.179051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:14.180111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:14.180753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:14.471409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:14.472080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:14.482519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:14.483471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:14.484512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:14.485189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:15.227752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:15.236501 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a5bc020-b561-4e90-98df-169520eeda81 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1515 microversion: 2.1 time: 1.071149 Mar 29 02:24:15.248234 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1799/3396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:14 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1515 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:15.253566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:15.254256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:15.262773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:15.263318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:15.264167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:15.264807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:15.612809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:15.624638 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6f5a4f14-ba20-468e-90d7-cc70dae3425f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 1.157080 Mar 29 02:24:15.635749 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1598/3397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:14 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:16.190085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:16.198137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-07fd8f03-9107-4cf1-9cc6-28c134804c06 req-094ef4c6-e599-4cd7-8ea7-9fcdbe0b30aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb", "tag": "7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:16.200588 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:16.200588 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:16.205762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1d70b0e-1ff1-4ec7-9594-db622a3c8da3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1506 microversion: 2.1 time: 0.954613 Mar 29 02:24:16.207247 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1800/3398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:15 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1506 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:16.223204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-07fd8f03-9107-4cf1-9cc6-28c134804c06 req-094ef4c6-e599-4cd7-8ea7-9fcdbe0b30aa service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.223674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-07fd8f03-9107-4cf1-9cc6-28c134804c06 req-094ef4c6-e599-4cd7-8ea7-9fcdbe0b30aa service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.258375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:16.259240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:16.269923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-07fd8f03-9107-4cf1-9cc6-28c134804c06 req-094ef4c6-e599-4cd7-8ea7-9fcdbe0b30aa service nova] Creating event network-changed:7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f for instance 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb on n-h2-828148-1 Mar 29 02:24:16.274327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.275621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.276937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.279266 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-07fd8f03-9107-4cf1-9cc6-28c134804c06 req-094ef4c6-e599-4cd7-8ea7-9fcdbe0b30aa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086819 Mar 29 02:24:16.279433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.285901 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1599/3399] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:24:16.623384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:16.642400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:16.643464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:16.646519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9eeedb66-f24a-4550-962d-e8a3fb271a87 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1473 microversion: 2.1 time: 0.394791 Mar 29 02:24:16.647119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1801/3400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:16 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1473 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:16.671141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.673341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-517017d6-87db-4f94-b0ee-09b6b31b48d6 req-793fa0a8-998d-48ee-bcaf-acb5710cfdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084dabcd-3490-4e74-bfc7-27812cc8cd06", "name": "network-vif-deleted", "tag": "ad1ab860-6a67-42c0-b15e-ae9602d4da71"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:16.675063 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:16.675063 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:16.677366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.684820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.684820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.706167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-517017d6-87db-4f94-b0ee-09b6b31b48d6 req-793fa0a8-998d-48ee-bcaf-acb5710cfdb9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:16.707165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-517017d6-87db-4f94-b0ee-09b6b31b48d6 req-793fa0a8-998d-48ee-bcaf-acb5710cfdb9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:16.747811 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-517017d6-87db-4f94-b0ee-09b6b31b48d6 req-793fa0a8-998d-48ee-bcaf-acb5710cfdb9 service nova] Creating event network-vif-deleted:ad1ab860-6a67-42c0-b15e-ae9602d4da71 for instance 084dabcd-3490-4e74-bfc7-27812cc8cd06 on n-h1-828148-1 Mar 29 02:24:16.763026 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-517017d6-87db-4f94-b0ee-09b6b31b48d6 req-793fa0a8-998d-48ee-bcaf-acb5710cfdb9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099644 Mar 29 02:24:16.764089 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1802/3401] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:17.224757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:17.225669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:17.264586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:17.268816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:17.275731 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aefbf20d-5b2c-424c-855a-e22fd3190643 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.634793 Mar 29 02:24:17.275874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:17.275978 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1600/3402] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:16 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:17.288367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:17.288972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:17.568066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:17.579760 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6be97840-8f90-49b7-8903-3aa7d7f4e6c3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 200 len: 1298 microversion: 2.1 time: 0.358177 Mar 29 02:24:17.580378 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1803/3403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:17 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 1298 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:17.670062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:17.670729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:17.694103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:17.694458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:17.695239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:17.695671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:17.807239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:17.808034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:17.809552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lazy-loading 'fault' on Instance uuid 58040cdd-dbaa-4b7c-b436-ef0992f7e282 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:18.291518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:18.292240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:18.311180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.312558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.315107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:18.323198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.323198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.329368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8cea80ef-aeb3-49b1-bb19-c285e6866ee6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 200 len: 1318 microversion: 2.1 time: 0.669086 Mar 29 02:24:18.330860 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1601/3404] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:17 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 1318 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:18.595453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:18.596337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: 084dabcd-3490-4e74-bfc7-27812cc8cd06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:18.603918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.604680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.606194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.606813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.724891 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance 084dabcd-3490-4e74-bfc7-27812cc8cd06 could not be found. Mar 29 02:24:18.724891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 404 to user: Instance 084dabcd-3490-4e74-bfc7-27812cc8cd06 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:18.724891 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84214e3a-8169-4b29-96ee-b5f7fd65d930 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06" status: 404 len: 111 microversion: 2.1 time: 0.133022 Mar 29 02:24:18.735501 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1602/3405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:18 2022] GET /compute/v2.1/servers/084dabcd-3490-4e74-bfc7-27812cc8cd06 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:18.745635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:18.747508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:18.757086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.757789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.758754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:18.759338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:18.841018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:19.237870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b207bd22-1923-437f-8d28-35b1c10adfc1 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 204 len: 0 microversion: 2.1 time: 0.497434 Mar 29 02:24:19.238869 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1603/3406] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:18 2022] DELETE /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:19.254193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4e2576e9-631a-47d1-b840-93c43aded5cb req-af00f79c-d7cf-46b7-bf9f-62878c788fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58040cdd-dbaa-4b7c-b436-ef0992f7e282", "name": "network-vif-deleted", "tag": "8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:19.254193 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:19.254193 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:19.275124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4e2576e9-631a-47d1-b840-93c43aded5cb req-af00f79c-d7cf-46b7-bf9f-62878c788fe8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:19.275636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4e2576e9-631a-47d1-b840-93c43aded5cb req-af00f79c-d7cf-46b7-bf9f-62878c788fe8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:19.318052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4e2576e9-631a-47d1-b840-93c43aded5cb req-af00f79c-d7cf-46b7-bf9f-62878c788fe8 service nova] Creating event network-vif-deleted:8ffad1ce-a7ce-4ae5-9c1b-ce8c91c3ec58 for instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 on n-h2-828148-1 Mar 29 02:24:19.332159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4e2576e9-631a-47d1-b840-93c43aded5cb req-af00f79c-d7cf-46b7-bf9f-62878c788fe8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091093 Mar 29 02:24:19.333282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1604/3407] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:19.528957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1700467004", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "76ce6e89-5427-4b96-9a58-8886f5b153dd"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:19.619934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:19.626547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] validate_networks() for [('76ce6e89-5427-4b96-9a58-8886f5b153dd', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:24:19.637648 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36d37221-fc88-4a4f-95d9-69c3e0c26f33 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 1.351216 Mar 29 02:24:19.648592 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1804/3408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:18 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:19.653114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:19.653953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:19.665198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:19.665998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:19.666989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:19.667767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:20.438223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:20.453001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1aa3c87a-8fd3-4539-a9be-280ea1944392 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1496 microversion: 2.1 time: 0.806423 Mar 29 02:24:20.453835 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1805/3409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:19 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1496 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:20.458955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:20.459761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:20.473342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:20.474795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:20.477154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:20.477777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:20.558168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. Mar 29 02:24:20.559170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:20.561233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12371759-88a7-4e9c-8de7-f3cd225d1f5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 404 len: 111 microversion: 2.1 time: 0.105292 Mar 29 02:24:20.562372 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1806/3410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:20 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:20.572089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f833ffca-5233-464f-9c8a-2aee3f48ac59 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '.version_select at 0x7f8724c43430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:20.699261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f833ffca-5233-464f-9c8a-2aee3f48ac59 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-key-913870920" status: 202 len: 0 microversion: 2.1 time: 0.129124 Mar 29 02:24:20.699261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1807/3411] 10.222.0.36 () {58 vars in 1205 bytes} [Tue Mar 29 02:24:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-913870920 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:24:20.702903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:20.703606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:20.739227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:20.739832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:20.741534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:20.741980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:21.374404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:21.389604 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d78605c-4efe-484b-890d-471019477d8a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.690524 Mar 29 02:24:21.390916 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1808/3412] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:20 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:21.403348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1736554618", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:21.500382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:24:22.033533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:22.035033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:22.035930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:22.036798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:22.037698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:22.049653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.050283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.051453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.052044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.084513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Getting quotas for project b09ebd529f184de7b0fee4fd914d3bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:22.092276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Getting quotas for user 9001e75421004f6684496eda642f06b3 and project b09ebd529f184de7b0fee4fd914d3bb5. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:22.112072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:22.115116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:22.276291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ec3aa13-44ae-4566-bb3a-0d9413f45a30 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.940313 Mar 29 02:24:22.276963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1605/3413] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:24:22.291497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:22.298922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:22.312423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.313345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.314424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.315019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.596947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:22.612273 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b8dca258-a568-475f-8825-73f42522f6b3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1454 microversion: 2.1 time: 0.329111 Mar 29 02:24:22.613497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1606/3414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:22 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1454 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:22.620580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:22.620580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:22.622379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8af16211-9d71-4267-ad43-fe41073ba799 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:22.622701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:22.625398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8af16211-9d71-4267-ad43-fe41073ba799 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:22.625537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:22.626045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:22.677923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.682547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.688809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.691000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.770162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:22.786153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:22.840690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:22.844572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:22.851414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8af16211-9d71-4267-ad43-fe41073ba799 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:22.864712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8af16211-9d71-4267-ad43-fe41073ba799 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1225 microversion: 2.1 time: 0.250907 Mar 29 02:24:22.865373 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1607/3415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:22 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1225 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:22.877950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:22.878504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:22.900249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.900964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:22.901907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:22.902571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.079900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d770b9ed-fd5b-47fc-88cc-865424b2678b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686775 Mar 29 02:24:23.081312 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1809/3416] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:24:23.087513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3bcac9bb-4684-4071-b16b-76bbbfd85b76 req-24751931-7a51-4fcb-8868-1d4fc95edc0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1cba646-2dd1-4148-adb8-83d799d5a83e", "name": "network-vif-deleted", "tag": "26e56515-ef1f-4f3b-ac96-8d8047bdf679"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:23.090811 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:23.090811 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:23.117521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3bcac9bb-4684-4071-b16b-76bbbfd85b76 req-24751931-7a51-4fcb-8868-1d4fc95edc0f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.118483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3bcac9bb-4684-4071-b16b-76bbbfd85b76 req-24751931-7a51-4fcb-8868-1d4fc95edc0f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.144663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3bcac9bb-4684-4071-b16b-76bbbfd85b76 req-24751931-7a51-4fcb-8868-1d4fc95edc0f service nova] Creating event network-vif-deleted:26e56515-ef1f-4f3b-ac96-8d8047bdf679 for instance e1cba646-2dd1-4148-adb8-83d799d5a83e on n-h1-828148-1 Mar 29 02:24:23.150416 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3bcac9bb-4684-4071-b16b-76bbbfd85b76 req-24751931-7a51-4fcb-8868-1d4fc95edc0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067317 Mar 29 02:24:23.151553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1810/3417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:23.158703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b58e0f70-0888-443c-9f9c-2aded61bc527 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:23.164257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b58e0f70-0888-443c-9f9c-2aded61bc527 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:23.233578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:23.253397 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ebe612b9-2dd2-4ee3-ace3-4070b5a9b642 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.386337 Mar 29 02:24:23.254301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1608/3418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:22 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:23.297959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b58e0f70-0888-443c-9f9c-2aded61bc527 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:23.310791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b58e0f70-0888-443c-9f9c-2aded61bc527 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1209 microversion: 2.1 time: 0.157854 Mar 29 02:24:23.311906 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1811/3419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:23 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1209 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:23.629850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:23.630469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:23.639755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.645468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.646471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.647154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.811288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.811733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.814554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lazy-loading 'fault' on Instance uuid e1cba646-2dd1-4148-adb8-83d799d5a83e {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:23.883477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:23.884741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:23.902743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.903407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:23.904368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:23.906324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:24.143119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:24.156668 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43a6b91f-dcf3-4ad8-9e90-7fec0e5efb87 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 200 len: 1305 microversion: 2.1 time: 0.530245 Mar 29 02:24:24.157683 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1609/3420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:23 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 1305 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:24.253663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:24.270132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:24.270883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:24.276552 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-efa21e06-e8f4-4a6c-8423-d8cdd3977412 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1229 microversion: 2.1 time: 0.396602 Mar 29 02:24:24.279457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1812/3421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:23 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1229 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:24.284092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:24.284734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:24.285765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:24.286374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:24.328256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:24.328890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:24.344247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:24.344513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:24.345310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:24.345741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:24.565816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:24.587943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0040d61f-23c0-4f3f-a8d0-af5b43611819 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1213 microversion: 2.1 time: 0.263777 Mar 29 02:24:24.589173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1813/3422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:24 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1213 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:24.593475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:24.602003 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d7008697-53a3-41f5-b3c1-0fda0f80c44f tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.335659 Mar 29 02:24:24.602591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1610/3423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:24 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:25.176404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:25.177049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: e1cba646-2dd1-4148-adb8-83d799d5a83e] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:25.185104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.185808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.186772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.187370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.239894 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance e1cba646-2dd1-4148-adb8-83d799d5a83e could not be found. Mar 29 02:24:25.240747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 404 to user: Instance e1cba646-2dd1-4148-adb8-83d799d5a83e could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:25.241762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04c60ada-e0a7-459b-b98e-6b9f10d8496a tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e" status: 404 len: 111 microversion: 2.1 time: 0.069129 Mar 29 02:24:25.242318 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1814/3424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:25 2022] GET /compute/v2.1/servers/e1cba646-2dd1-4148-adb8-83d799d5a83e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:25.250806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:25.251310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:25.259503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.260169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.261175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.261793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.294435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:25.295478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:25.307261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.311133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.312140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.312748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.387502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:25.555704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:25.566673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f0cac0e1-01c0-4e9f-8a39-1d4dfb897749 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1285 microversion: 2.1 time: 0.277017 Mar 29 02:24:25.567833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1815/3425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:25 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:25.605923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:25.606679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:25.629743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.631739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.632566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.633046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.859381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:25.870282 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a106578-72d6-4b54-80d6-7f71ed2bc27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1261 microversion: 2.1 time: 0.268457 Mar 29 02:24:25.874642 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1816/3426] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:25 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1261 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:25.879550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:25.880222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:25.892085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.892622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.893512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:25.894387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:25.986490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddb70fe3-e06f-42ff-85a7-54c17393ae69 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 204 len: 0 microversion: 2.1 time: 0.738724 Mar 29 02:24:25.987821 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1611/3427] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:25 2022] DELETE /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:24:26.004410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:26.005529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:26.032660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.034181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:26.035180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.035812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:26.330143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:26.346358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ec93be91-b97c-4b42-b636-3d26e6eb12e6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.470871 Mar 29 02:24:26.347114 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1817/3428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:25 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:26.583925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:26.584819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:26.594594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.595488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:26.596458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.597104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:26.805658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:26.818214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-478aa42d-fe27-4adb-8d85-050dc83bb6f4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1283 microversion: 2.1 time: 0.237182 Mar 29 02:24:26.819931 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1818/3429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:26 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1283 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:26.893252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:26.894397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:26.905739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.906724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:26.908164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:26.908980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:27.040167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:27.054421 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ed7dc59-9787-40aa-869e-b126b7529c11 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1676 microversion: 2.1 time: 1.050843 Mar 29 02:24:27.054421 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1612/3430] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:25 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1676 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:27.183834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:27.199601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4c8ac66-2509-4455-8e8e-3d46bba39380 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1267 microversion: 2.1 time: 0.312353 Mar 29 02:24:27.205479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1819/3431] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:26 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:27.362561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:27.363208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:27.379052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:27.381159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:27.381159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:27.381159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:27.841509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:27.843302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:27.854399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:27.855970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:27.856961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:27.858769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.063366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:28.075846 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8736a80e-f340-49fa-aded-af7d3db078ea tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1283 microversion: 2.1 time: 0.238587 Mar 29 02:24:28.085575 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1820/3432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:27 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1283 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:28.097079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:28.097693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:28.118744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:28.119194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.120000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:28.121184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.676522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:28.688830 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ecb5c691-dacf-4429-89d5-7b9cfa980fce tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1676 microversion: 2.1 time: 0.601745 Mar 29 02:24:28.691608 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1821/3433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:28 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1676 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:28.701125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:28.705778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:28.724000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:28.724818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.726376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:28.726990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.929454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:28.938176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c50252b-396b-4d95-8204-89c48e341c8d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1267 microversion: 2.1 time: 0.245366 Mar 29 02:24:28.938753 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1822/3434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:28 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:28.943340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4f6e5927-e9b6-491e-9a3f-2d1fd5146454 req-bf9247d2-6a20-430d-b487-b7b524f49410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb", "name": "network-vif-plugged", "status": "completed", "tag": "7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:28.950679 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:28.950679 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:28.959839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4f6e5927-e9b6-491e-9a3f-2d1fd5146454 req-bf9247d2-6a20-430d-b487-b7b524f49410 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:28.960276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4f6e5927-e9b6-491e-9a3f-2d1fd5146454 req-bf9247d2-6a20-430d-b487-b7b524f49410 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:28.989545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4f6e5927-e9b6-491e-9a3f-2d1fd5146454 req-bf9247d2-6a20-430d-b487-b7b524f49410 service nova] Creating event network-vif-plugged:7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f for instance 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb on n-h2-828148-1 Mar 29 02:24:28.998134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4f6e5927-e9b6-491e-9a3f-2d1fd5146454 req-bf9247d2-6a20-430d-b487-b7b524f49410 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057975 Mar 29 02:24:29.003214 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1823/3435] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:29.095206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:29.096419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:29.108174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:29.109274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:29.110474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:29.111186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:29.502336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:29.513571 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f2586205-1489-4027-95ef-63db9ed010cb tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 2.154446 Mar 29 02:24:29.514470 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1613/3436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:27 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:29.676029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:29.693906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b72d5158-a366-43c1-8cbd-c253337725c4 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.605500 Mar 29 02:24:29.701654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1824/3437] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:29 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:29.717261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:29.721526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:29.744777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:29.748368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:29.748368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:29.748368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:29.768495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-905776806", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ea588fdd-0b79-4a07-88df-f840714ee194"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:29.874386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] validate_networks() for [('ea588fdd-0b79-4a07-88df-f840714ee194', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:24:30.128036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:30.146320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dd2d73a-54bc-4ccb-9c3d-9ecaeb0118e0 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1676 microversion: 2.1 time: 0.442856 Mar 29 02:24:30.146909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1825/3438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:29 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1676 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:30.151756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:30.152558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:30.160180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:30.161022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:30.162280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:30.162914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:30.448592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:30.462804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-466f00b5-0f08-4e48-895b-c157d1fd4aba tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1267 microversion: 2.1 time: 0.314096 Mar 29 02:24:30.464310 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1826/3439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:30 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1267 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:30.535900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:30.537551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:30.550849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:30.553668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:30.560178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:30.560933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.149802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:31.160346 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ead8687-f0f9-4ea0-b661-90ba57b44376 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1316 microversion: 2.1 time: 0.632559 Mar 29 02:24:31.161342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1827/3440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:30 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:31.166319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:31.167365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:31.176337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.177097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.178163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.178846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.569648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:31.581120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0055948-a791-4dde-b92b-a2acc83ae3db tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.418340 Mar 29 02:24:31.591142 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1828/3441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:31 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:31.595942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:31.596567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:31.609896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.612424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.613967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.614568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.836787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:31.837871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:31.838706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:31.840315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:31.841216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:31.856396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.857194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.858224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:31.866327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:31.926459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Getting quotas for project f2a4476dff96447eb2fcb18a06345131. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:31.941609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Getting quotas for user f1857cb7e24f4940a016db6e88acba6f and project f2a4476dff96447eb2fcb18a06345131. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:31.956551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Going to run 2 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:31.959071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: ff2c5eb9-e9c8-4dfb-972a-c5254899cf57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:32.039629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:32.053579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9dcaa6a9-b2f6-4955-8fab-f599ade5d16b tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1676 microversion: 2.1 time: 0.469925 Mar 29 02:24:32.055651 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1829/3442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:31 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1676 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:32.064820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:32.064820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:32.079281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=ff2c5eb9-e9c8-4dfb-972a-c5254899cf57,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:32.090435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.090435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.090435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.090435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.249024 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67c30443-fd61-4655-bee6-bc89c65b1963 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732268 Mar 29 02:24:32.249282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1614/3443] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:24:32.254409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:32.255476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:32.265888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.266977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.269404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.270061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.560476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:32.570905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-76d587b2-8a0f-4565-8b68-084e7982fa5d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.513954 Mar 29 02:24:32.581181 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1830/3444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:32 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:32.586807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:32.592892 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:32.592892 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:32.592892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:32.593824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Searching by: {'deleted': False, 'project_id': 'f2a4476dff96447eb2fcb18a06345131'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:24:32.616124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.616822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.617949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.618685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.764216 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ecdb1bdb-a890-4465-9d7a-902c330519d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.181548 Mar 29 02:24:32.765480 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1831/3445] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:24:32 2022] GET /compute/v2.1/servers => generated 675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:32.770312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:32.771119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:32.779251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.779917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:32.780912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:32.781522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.335500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:33.355135 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1859edd-02b4-43b5-84aa-e251dbe98ae2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1466 microversion: 2.1 time: 1.098445 Mar 29 02:24:33.359477 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1615/3446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:32 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1466 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:33.370044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:33.373102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-707b2d91-3c2e-4ca4-8fc5-c1f845613481 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:33.376076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-707b2d91-3c2e-4ca4-8fc5-c1f845613481 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:33.380408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d659faf4-2711-4a62-b1e2-3035616545ec tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.613616 Mar 29 02:24:33.385271 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1832/3447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:32 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:33.397548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:33.398173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:33.412458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.412927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.413878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.414473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.582717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-707b2d91-3c2e-4ca4-8fc5-c1f845613481 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:33.601366 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-707b2d91-3c2e-4ca4-8fc5-c1f845613481 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1219 microversion: 2.1 time: 0.239612 Mar 29 02:24:33.603215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1616/3448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:33 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1219 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:33.614191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:33.614823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:33.641373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.642651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.643470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.643912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.666151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:33.678579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3acb330-72de-43bb-996a-fbc1b27dc476 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1608 microversion: 2.1 time: 0.291561 Mar 29 02:24:33.684508 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1833/3449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:33 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1608 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:33.692285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:33.694813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:33.707930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.708971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:33.710302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:33.711004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:34.210926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:34.223463 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68f5f525-031f-4faa-9da7-4d843d5cc720 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.537277 Mar 29 02:24:34.224099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1834/3450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:33 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:34.230893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-866fd32f-6625-46a2-864a-9612f2802a26 req-92a10834-3d71-4040-910b-733c9c719b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2a546b1-5d06-4e78-9a11-7e307db6ef2c", "name": "network-vif-deleted", "tag": "79dd1846-30dc-4ff1-82b6-5420a3398d8f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:34.232806 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:34.232806 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:34.248010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-866fd32f-6625-46a2-864a-9612f2802a26 req-92a10834-3d71-4040-910b-733c9c719b33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:34.269061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-866fd32f-6625-46a2-864a-9612f2802a26 req-92a10834-3d71-4040-910b-733c9c719b33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:34.297034 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-866fd32f-6625-46a2-864a-9612f2802a26 req-92a10834-3d71-4040-910b-733c9c719b33 service nova] Creating event network-vif-deleted:79dd1846-30dc-4ff1-82b6-5420a3398d8f for instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c on n-h1-828148-1 Mar 29 02:24:34.321010 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-866fd32f-6625-46a2-864a-9612f2802a26 req-92a10834-3d71-4040-910b-733c9c719b33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091763 Mar 29 02:24:34.323025 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1835/3451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:34.402526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:34.403314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:34.415954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:34.420866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:34.421891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:34.422416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:34.686537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd606561-0b2e-4a0f-80f3-af619afa7e50 tempest-ServersOnMultiNodesTest-430935029 tempest-ServersOnMultiNodesTest-430935029-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1617 microversion: 2.1 time: 1.079839 Mar 29 02:24:34.687705 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1617/3452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:33 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1617 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:34.692803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:34.699186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:34.711224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:34.711992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:34.713030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:34.713680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.061703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:35.071229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fefcc131-16b7-4422-b461-29d797ba7997 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.673393 Mar 29 02:24:35.072759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1836/3453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:34 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:35.077749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:35.079019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:35.093952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.094577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.095485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.095919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.149099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:35.184481 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f2770bc7-41ea-422d-9b35-9641c09bf9ee tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1215 microversion: 2.1 time: 0.495339 Mar 29 02:24:35.191101 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1618/3454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:34 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1215 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:35.207149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:35.214878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:35.246246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.248315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.249441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lazy-loading 'fault' on Instance uuid c2a546b1-5d06-4e78-9a11-7e307db6ef2c {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:35.249567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.249917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.250725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.251174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.354394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'defab0990da34b4e83db3da9d7834fa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f809798f734833b6638b438d109ff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:35.363653 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2483d506-47ec-40c5-b52c-71b5515b99c5 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 200 len: 1328 microversion: 2.1 time: 0.289217 Mar 29 02:24:35.364637 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1837/3455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:35 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:35.369354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:35.370935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:35.379222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.380023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.381310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.383660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.474605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:35.665219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:35.678794 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df3d6234-e314-4756-ad9c-38acea2f7f0c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.312829 Mar 29 02:24:35.679571 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1838/3456] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:35 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:35.935033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c662e582-4040-4da9-b54d-a0e02cf71bbf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 204 len: 0 microversion: 2.1 time: 0.742513 Mar 29 02:24:35.936160 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1619/3457] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:35 2022] DELETE /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:35.943881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:35.944486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:35.953104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.953565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:35.954616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:35.955084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.091213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:36.098906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:36.120992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.120992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.129672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.130121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.685530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:36.696820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2657c7f2-bf94-45ae-8d83-41e627e996f0 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1472 microversion: 2.1 time: 0.756439 Mar 29 02:24:36.701411 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1839/3458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:35 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:36.716393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:36.716897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:36.731820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.732469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.733615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.734218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.916024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:36.923958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:36.929928 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10b3c4a1-8cf3-49b4-896b-250c352948a9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1277 microversion: 2.1 time: 0.227410 Mar 29 02:24:36.930874 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1840/3459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:36 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:36.935169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74db416d-d02b-4ce9-85a1-6595ee4829b8 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.849351 Mar 29 02:24:36.938887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1620/3460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:36 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:36.938983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66ddad69-5f12-4e24-8a79-15fb3fcdc52c", "tag": "4b58c36b-bc02-4fa5-a965-c9c12d126788"}, {"name": "network-changed", "server_uuid": "7beb6d84-1989-4aff-86dd-0025ee52ed07", "tag": "e8716b4a-798c-4fb9-8932-91a303c777f3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:36.940588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:36.941234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] [instance: c2a546b1-5d06-4e78-9a11-7e307db6ef2c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:36.944041 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:36.944041 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:36.948867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.949320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.950155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.952461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.962501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:36.962913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:36.996137 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] Creating event network-changed:4b58c36b-bc02-4fa5-a965-c9c12d126788 for instance 66ddad69-5f12-4e24-8a79-15fb3fcdc52c on n-h1-828148-1 Mar 29 02:24:36.996137 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] Creating event network-changed:e8716b4a-798c-4fb9-8932-91a303c777f3 for instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 on n-h1-828148-1 Mar 29 02:24:37.002141 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f91e14b5-02de-4931-be75-7102a404810a req-326710a8-bf3c-4bde-a19f-cfd6f69c2201 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069991 Mar 29 02:24:37.003044 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1841/3461] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:37.007954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:37.008650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:37.020619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.021486 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] HTTP exception thrown: Instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c could not be found. Mar 29 02:24:37.024955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Returning 404 to user: Instance c2a546b1-5d06-4e78-9a11-7e307db6ef2c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:37.024955 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c19843ab-7d08-497a-84a4-6b21e8102c10 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c" status: 404 len: 111 microversion: 2.1 time: 0.085708 Mar 29 02:24:37.025181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:37.025284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1621/3462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:36 2022] GET /compute/v2.1/servers/c2a546b1-5d06-4e78-9a11-7e307db6ef2c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:37.027144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.027583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:37.031160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50240f14-3349-4d2d-b9de-bb38f7f1eab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] Calling method '.version_select at 0x7f8724d4da60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:37.114023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50240f14-3349-4d2d-b9de-bb38f7f1eab3 tempest-ServerActionsTestJSON-846736892 tempest-ServerActionsTestJSON-846736892-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-747483895" status: 202 len: 0 microversion: 2.1 time: 0.086283 Mar 29 02:24:37.117670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1622/3463] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:24:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-747483895 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:24:37.568195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:37.584003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3ad3aaa4-d7c4-4fd8-b056-b807fded4efe tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.579723 Mar 29 02:24:37.584578 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1842/3464] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:37 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:37.720453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:37.721229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:37.747531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.748935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:37.751637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.753799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:37.946718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:37.947954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:37.957206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.957678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:37.958462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:37.958888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:39.028723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:39.038442 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c32d833-fb39-48ba-8317-656a437d3838 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 1.095316 Mar 29 02:24:39.041244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1843/3465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:37 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:39.050013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:39.053987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:39.080655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:39.082064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:39.084681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:39.086263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:39.243609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:39.252980 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-030aa2c2-b88d-4aaf-90f7-19812624d9bd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1472 microversion: 2.1 time: 1.538743 Mar 29 02:24:39.257865 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1623/3466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:37 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1472 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:39.270037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:39.271222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:39.290700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:39.291163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:39.292567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:39.293022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:39.490491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:39.502905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e32ee4d-a329-4e20-a6e0-686a99dbe29d tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.457860 Mar 29 02:24:39.503763 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1844/3467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:39 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:40.059887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:40.060447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:40.077558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:40.079046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:40.080364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:40.081732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:40.636010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:40.650245 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8bd43c84-f442-4fd3-8dd7-ea6ead2050fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 1.388574 Mar 29 02:24:40.651800 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1624/3468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:39 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:40.664830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:40.665780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:40.682032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:40.682884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:40.685649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:40.687449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:41.258290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:41.272869 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90258004-fdd3-41ae-9ed5-14cbfaada3d6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 1.221075 Mar 29 02:24:41.282689 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1845/3469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:40 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:41.288290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:41.301670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a7b9aab4-f2cc-4d22-bf5e-59e2fa4c02f2 req-557ff210-2d5c-49a2-b8dd-10b5e4104723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb", "name": "network-vif-deleted", "tag": "7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:41.306989 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fec41180-6c1e-43e3-afec-944b9185e2d9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 200 len: 1301 microversion: 2.1 time: 0.653539 Mar 29 02:24:41.310157 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:41.310157 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:41.315541 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1625/3470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:40 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 1301 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:41.323943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:41.330046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:41.342926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a7b9aab4-f2cc-4d22-bf5e-59e2fa4c02f2 req-557ff210-2d5c-49a2-b8dd-10b5e4104723 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:41.369234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a7b9aab4-f2cc-4d22-bf5e-59e2fa4c02f2 req-557ff210-2d5c-49a2-b8dd-10b5e4104723 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:41.369421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:41.369421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:41.369421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:41.369421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:41.692850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a7b9aab4-f2cc-4d22-bf5e-59e2fa4c02f2 req-557ff210-2d5c-49a2-b8dd-10b5e4104723 service nova] Creating event network-vif-deleted:7eb81ecb-ace4-4a86-8d54-e0c2f0cd913f for instance 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb on n-h2-828148-1 Mar 29 02:24:41.692850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a7b9aab4-f2cc-4d22-bf5e-59e2fa4c02f2 req-557ff210-2d5c-49a2-b8dd-10b5e4104723 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.410230 Mar 29 02:24:41.692850 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1846/3471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:41.697204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:41.700567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:41.724100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:41.727993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:41.729553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:41.736102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.237453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:42.251105 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f080397b-abd8-4e0a-93c8-aaf901777ae5 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.933733 Mar 29 02:24:42.261315 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1626/3472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:41 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:42.291531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:42.292191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:42.320230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.320567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.321397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.321825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.683723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:42.704260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e21eb918-6b4a-4223-b1b3-c5fa4f895619 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 1.016946 Mar 29 02:24:42.714334 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1847/3473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:41 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:42.721720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:42.722529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:42.733893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.734541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.735696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.736296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.849382 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb could not be found. Mar 29 02:24:42.850347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance 2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:42.851374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4f7ca49-b8d9-4970-896d-cfce219bb62c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb" status: 404 len: 111 microversion: 2.1 time: 0.135473 Mar 29 02:24:42.853153 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1848/3474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:42 2022] GET /compute/v2.1/servers/2cf9f9ab-a7c4-4a4a-b79a-d3f797d872cb => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:42.859195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c9eed37d-6731-4e02-bc30-57f5014e4fbe req-1a00daf5-e4d7-4eba-bc57-813c3bf62bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b5bf4a-a0d7-4f25-93ec-465616c89196", "tag": "dbc5199d-d446-407a-aedb-4135363ed084"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:42.861472 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:42.861472 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:42.872544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c9eed37d-6731-4e02-bc30-57f5014e4fbe req-1a00daf5-e4d7-4eba-bc57-813c3bf62bf9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.877000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c9eed37d-6731-4e02-bc30-57f5014e4fbe req-1a00daf5-e4d7-4eba-bc57-813c3bf62bf9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.920937 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c9eed37d-6731-4e02-bc30-57f5014e4fbe req-1a00daf5-e4d7-4eba-bc57-813c3bf62bf9 service nova] Creating event network-changed:dbc5199d-d446-407a-aedb-4135363ed084 for instance 71b5bf4a-a0d7-4f25-93ec-465616c89196 on n-h2-828148-1 Mar 29 02:24:42.923206 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c9eed37d-6731-4e02-bc30-57f5014e4fbe req-1a00daf5-e4d7-4eba-bc57-813c3bf62bf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068271 Mar 29 02:24:42.924336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1849/3475] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:42.929620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:42.932487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:42.951954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.952785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.958619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:42.959901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:42.975312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:42.991709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a314c22-b0ac-41d9-ba7b-1f92c1e6968f tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 0.704130 Mar 29 02:24:43.000964 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1627/3476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:42 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:43.047673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:43.268581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:43.269841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:43.283922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:43.287700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:43.287700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:43.287700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:43.749390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:43.764385 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8a9ad72-d8a8-4368-9716-8844a9491f7a tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.499295 Mar 29 02:24:43.765347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1628/3477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:43 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:44.039067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:44.039805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:44.047804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.048509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.049568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.050226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.140212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43ea9d38-d145-4faf-895a-bdee958a8a20 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/ips" status: 200 len: 149 microversion: 2.1 time: 0.373519 Mar 29 02:24:44.140890 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1629/3478] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:24:43 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/ips => generated 149 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:44.147033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-adffb209-a95e-4152-a4f1-db438f8ad170 req-89a744ee-00e0-4c35-87d1-cfd78deb9762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ddad69-5f12-4e24-8a79-15fb3fcdc52c", "name": "network-vif-plugged", "status": "completed", "tag": "4b58c36b-bc02-4fa5-a965-c9c12d126788"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:44.148760 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:44.148760 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:44.159739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-adffb209-a95e-4152-a4f1-db438f8ad170 req-89a744ee-00e0-4c35-87d1-cfd78deb9762 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.160162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-adffb209-a95e-4152-a4f1-db438f8ad170 req-89a744ee-00e0-4c35-87d1-cfd78deb9762 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.185614 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-adffb209-a95e-4152-a4f1-db438f8ad170 req-89a744ee-00e0-4c35-87d1-cfd78deb9762 service nova] Creating event network-vif-plugged:4b58c36b-bc02-4fa5-a965-c9c12d126788 for instance 66ddad69-5f12-4e24-8a79-15fb3fcdc52c on n-h1-828148-1 Mar 29 02:24:44.205367 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-adffb209-a95e-4152-a4f1-db438f8ad170 req-89a744ee-00e0-4c35-87d1-cfd78deb9762 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062831 Mar 29 02:24:44.219318 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1630/3479] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:44.228704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:44.230053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:44.240038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.250905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.279916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.279916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.491840 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e6e3be5c-3699-4125-918d-07a9bb598ccd tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 204 len: 0 microversion: 2.1 time: 1.563649 Mar 29 02:24:44.493317 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1850/3480] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:42 2022] DELETE /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 0 bytes in 1568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:44.509823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-33e96a68-c7ee-47dd-9071-78a1e0c01136 req-6e0e40e1-123f-4052-a26e-92c216a7d6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2c5eb9-e9c8-4dfb-972a-c5254899cf57", "tag": "088a7efe-3351-4e16-819c-e5de2657cc9c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:44.518991 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:44.518991 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:44.538715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-33e96a68-c7ee-47dd-9071-78a1e0c01136 req-6e0e40e1-123f-4052-a26e-92c216a7d6cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.539357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-33e96a68-c7ee-47dd-9071-78a1e0c01136 req-6e0e40e1-123f-4052-a26e-92c216a7d6cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.566255 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-33e96a68-c7ee-47dd-9071-78a1e0c01136 req-6e0e40e1-123f-4052-a26e-92c216a7d6cb service nova] Creating event network-changed:088a7efe-3351-4e16-819c-e5de2657cc9c for instance ff2c5eb9-e9c8-4dfb-972a-c5254899cf57 on n-h1-828148-1 Mar 29 02:24:44.582585 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-33e96a68-c7ee-47dd-9071-78a1e0c01136 req-6e0e40e1-123f-4052-a26e-92c216a7d6cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083077 Mar 29 02:24:44.583198 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1851/3481] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:44.591044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:44.591396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:44.607481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.607925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:44.608710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:44.629900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:45.146128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:45.157768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31b23ed8-df2e-4698-92cc-01fbbffd3816 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.936473 Mar 29 02:24:45.172042 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1631/3482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:44 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:45.177771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:45.178389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:45.187874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:45.188375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:45.189249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:45.189999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:45.555616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:45.564723 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ccdb9925-2803-4002-81ca-7b2df0e38c61 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1472 microversion: 2.1 time: 0.391293 Mar 29 02:24:45.567319 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1632/3483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:45 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1472 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:45.575665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:45.580505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:45.600119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:45.600881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:45.601906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:45.602519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.148542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:46.161265 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2232adbf-daef-43df-91d9-c3fbdb07fdb6 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1325 microversion: 2.1 time: 0.592891 Mar 29 02:24:46.164691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:46.168154 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1633/3484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:45 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1325 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:46.177994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b7027e07-30ff-4372-9b2f-1d47988237d4 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 1.593269 Mar 29 02:24:46.181905 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1852/3485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:44 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:46.190538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:46.202998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:46.202998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:46.202998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.202998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:46.202998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.243688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a22a199b-d22a-4774-9b65-0ec7dfdd4fda req-0f5916cd-9065-451c-813e-3ffee9c8bfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7beb6d84-1989-4aff-86dd-0025ee52ed07", "name": "network-vif-plugged", "status": "completed", "tag": "e8716b4a-798c-4fb9-8932-91a303c777f3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:46.245485 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:46.245485 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:46.266793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a22a199b-d22a-4774-9b65-0ec7dfdd4fda req-0f5916cd-9065-451c-813e-3ffee9c8bfb3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:46.270108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a22a199b-d22a-4774-9b65-0ec7dfdd4fda req-0f5916cd-9065-451c-813e-3ffee9c8bfb3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.319953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a22a199b-d22a-4774-9b65-0ec7dfdd4fda req-0f5916cd-9065-451c-813e-3ffee9c8bfb3 service nova] Creating event network-vif-plugged:e8716b4a-798c-4fb9-8932-91a303c777f3 for instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 on n-h1-828148-1 Mar 29 02:24:46.352688 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a22a199b-d22a-4774-9b65-0ec7dfdd4fda req-0f5916cd-9065-451c-813e-3ffee9c8bfb3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115644 Mar 29 02:24:46.358726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1853/3486] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:24:46.583872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:46.584962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:46.596982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:46.599448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.600488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:46.601176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:46.627300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:46.653740 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5f2c6e4-0367-41c2-ba86-2252aa3cc1ef tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1309 microversion: 2.1 time: 0.474503 Mar 29 02:24:46.654898 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1634/3487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:46 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1309 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:47.042624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Calling method '.version_select at 0x7f87243c1ca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:47.048242 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-hypervisors:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:47.048242 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:47.048242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:47.048242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:47.070911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:47.071367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:47.084428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:47.084917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:47.092689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74cd50ac-a60c-451b-9793-09d63534924c tempest-PortsAdminExtendedAttrsTestJSON-1383531002 tempest-PortsAdminExtendedAttrsTestJSON-1383531002-project-admin] 10.222.0.36 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.135410 Mar 29 02:24:47.093882 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1635/3488] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:24:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:47.179030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:47.179909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:47.207439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:47.220548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:47.220548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:47.220548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:48.095567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:48.108146 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9c86198-3d25-47ba-852b-e74a4ba9f3be tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1472 microversion: 2.1 time: 1.527128 Mar 29 02:24:48.120111 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1854/3489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:46 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1472 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:48.127445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:48.128853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:48.145704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:48.147776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:48.148866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:48.155146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:48.429686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:48.452703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81c3f8bc-2064-4bc6-bf1f-ca8c02dfecd1 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1523 microversion: 2.1 time: 1.277338 Mar 29 02:24:48.472478 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1636/3490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:47 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1523 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:48.490309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a829be5-5b70-4b8c-a40c-c4d3148f325b"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:48.492978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:48.516626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:48.521053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:48.521053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:48.521053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:49.205488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:49.227126 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43e70045-e884-4891-af74-a122e11cb45a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 1.105370 Mar 29 02:24:49.229214 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1855/3491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:48 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:49.236279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:49.240713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:49.270021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:49.270687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:49.273141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:49.273850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:49.767925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a68b51d2-aaa2-4c8f-b7f6-f1a2a67e0f13 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.282957 Mar 29 02:24:49.770289 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1637/3492] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:24:48 2022] POST /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments => generated 194 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:49.812307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:49.812307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:49.839516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:49.840131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:49.843101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:49.843665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.012014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:50.022588 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6659a4d3-d909-46bd-a2e9-25f3882c8ce6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1490 microversion: 2.1 time: 0.790570 Mar 29 02:24:50.032569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] HTTP exception thrown: Instance is not a member of specified network Mar 29 02:24:50.032569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Returning 404 to user: Instance is not a member of specified network {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:50.032569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88c9214c-2a97-41dc-b183-0e596a78a535 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.256703 Mar 29 02:24:50.032569 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1638/3493] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:24:49 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c/ips/invalid => generated 91 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:24:50.036077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1856/3494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:49 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1490 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:50.040255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-61f9eaa8-5f08-4f3f-b8f7-23de6d1c3dfd req-092bde0f-4a14-413d-9000-63aee54f62f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0998d63-e2a2-4ea4-b29b-2af02357cb67", "name": "network-vif-deleted", "tag": "ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:50.042662 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:50.042662 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:50.054114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:50.060611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:50.081063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-61f9eaa8-5f08-4f3f-b8f7-23de6d1c3dfd req-092bde0f-4a14-413d-9000-63aee54f62f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.081513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-61f9eaa8-5f08-4f3f-b8f7-23de6d1c3dfd req-092bde0f-4a14-413d-9000-63aee54f62f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.084265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.084901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.086165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.086341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.139225 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-61f9eaa8-5f08-4f3f-b8f7-23de6d1c3dfd req-092bde0f-4a14-413d-9000-63aee54f62f1 service nova] Creating event network-vif-deleted:ef0f2e9c-5de9-4d3e-8248-03f53bbe38bf for instance f0998d63-e2a2-4ea4-b29b-2af02357cb67 on n-h1-828148-1 Mar 29 02:24:50.150780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-61f9eaa8-5f08-4f3f-b8f7-23de6d1c3dfd req-092bde0f-4a14-413d-9000-63aee54f62f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119419 Mar 29 02:24:50.152054 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1639/3495] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:50.172408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edfa74eb-ec3d-4106-82f0-1100fc96f1fc tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:50.173230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edfa74eb-ec3d-4106-82f0-1100fc96f1fc tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Failed to fetch instance by id 999 {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:24:50.174312 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-edfa74eb-ec3d-4106-82f0-1100fc96f1fc tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] HTTP exception thrown: Instance 999 could not be found. Mar 29 02:24:50.176236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edfa74eb-ec3d-4106-82f0-1100fc96f1fc tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Returning 404 to user: Instance 999 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:50.179410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edfa74eb-ec3d-4106-82f0-1100fc96f1fc tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024979 Mar 29 02:24:50.183033 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1640/3496] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:24:50 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:24:50.195190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:50.196872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:50.216877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.216877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.217839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.218988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.271403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.274635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.275714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lazy-loading 'fault' on Instance uuid f0998d63-e2a2-4ea4-b29b-2af02357cb67 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:50.302437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:50.501233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:50.511643 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f3afb29-44a7-4ac3-b322-266f87731ad7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 200 len: 1307 microversion: 2.1 time: 0.474258 Mar 29 02:24:50.515484 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1857/3497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:50 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:50.521118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1736554618", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:50.660924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:24:50.855020 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e4ff517-02f5-4f9e-a8bc-cfe4b01936e3 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "DELETE /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 204 len: 0 microversion: 2.1 time: 0.666696 Mar 29 02:24:50.855854 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1641/3498] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:50 2022] DELETE /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:50.864477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:50.865502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:50.893348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.894350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:50.895653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:50.896460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:51.257355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:51.269742 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5903ebc6-7b80-4250-bae3-481bf0178eb9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 0.411462 Mar 29 02:24:51.270312 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1642/3499] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:50 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:51.277342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:51.278204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:51.289221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:51.289924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:51.291195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:51.292301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.217979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:52.247567 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5fc741a6-9d8a-49ef-aff3-0398ca419c1e tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1529 microversion: 2.1 time: 0.955886 Mar 29 02:24:52.255421 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1643/3500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:51 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1529 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:52.263647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:52.264472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f0998d63-e2a2-4ea4-b29b-2af02357cb67] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:52.274441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.275177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.278339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.281813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.349012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:52.349757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:52.350278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:52.350790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:52.352171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:52.364299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance f0998d63-e2a2-4ea4-b29b-2af02357cb67 could not be found. Mar 29 02:24:52.364299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance f0998d63-e2a2-4ea4-b29b-2af02357cb67 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:52.364581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09e6017c-9200-4457-8a15-b652c4d729a9 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67" status: 404 len: 111 microversion: 2.1 time: 0.105065 Mar 29 02:24:52.367601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.368098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.369013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.369666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.377312 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1644/3501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:52 2022] GET /compute/v2.1/servers/f0998d63-e2a2-4ea4-b29b-2af02357cb67 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:52.377312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ae2dbfc8-30b7-440c-b253-1d03361d4806 req-5413d88a-1722-4ec5-86f5-80f5129d1998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2c5eb9-e9c8-4dfb-972a-c5254899cf57", "name": "network-vif-plugged", "status": "completed", "tag": "088a7efe-3351-4e16-819c-e5de2657cc9c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:52.377312 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:52.377312 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:52.403994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ae2dbfc8-30b7-440c-b253-1d03361d4806 req-5413d88a-1722-4ec5-86f5-80f5129d1998 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.410449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ae2dbfc8-30b7-440c-b253-1d03361d4806 req-5413d88a-1722-4ec5-86f5-80f5129d1998 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.410611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:52.415094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:52.423091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ae2dbfc8-30b7-440c-b253-1d03361d4806 req-5413d88a-1722-4ec5-86f5-80f5129d1998 service nova] Creating event network-vif-plugged:088a7efe-3351-4e16-819c-e5de2657cc9c for instance ff2c5eb9-e9c8-4dfb-972a-c5254899cf57 on n-h1-828148-1 Mar 29 02:24:52.428356 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ae2dbfc8-30b7-440c-b253-1d03361d4806 req-5413d88a-1722-4ec5-86f5-80f5129d1998 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049612 Mar 29 02:24:52.429165 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1645/3502] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:52.432105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:52.434806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:52.435631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:52.436801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:52.447085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.450328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.451773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.452404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.622590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dc668cd-b024-4624-b79d-48dd29c2be58 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.105796 Mar 29 02:24:52.627795 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1858/3503] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:24:52.637298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:52.641443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:52.659099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.659548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.665023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:52.665153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:52.850802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:53.128195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:53.138686 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5c11a66-5fd2-4be7-848c-2548835fd6d0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 0.707100 Mar 29 02:24:53.140083 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1646/3504] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:52 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:53.146191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb9362c9-bd05-422a-8cdb-fd81b3235f1c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:53.146191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fb9362c9-bd05-422a-8cdb-fd81b3235f1c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:53.326405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fb9362c9-bd05-422a-8cdb-fd81b3235f1c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:53.337067 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb9362c9-bd05-422a-8cdb-fd81b3235f1c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1209 microversion: 2.1 time: 0.195534 Mar 29 02:24:53.349694 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1647/3505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:53 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:53.352386 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cb6eac6-b08d-4fa1-84b0-d7079364811a tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 204 len: 0 microversion: 2.1 time: 0.722947 Mar 29 02:24:53.353049 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1859/3506] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:52 2022] DELETE /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:53.361016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:53.364523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:53.364523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:53.364749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:53.380552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:53.381025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:53.381818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:53.382248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:53.383455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:53.386971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:53.387853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:53.391927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.047382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:54.060913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12e69451-f4d4-42a7-b41f-a2faf19dcbc7 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1529 microversion: 2.1 time: 0.709954 Mar 29 02:24:54.061555 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1648/3507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:53 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1529 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:54.071641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:54.081121 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65e0d277-b131-4e60-abc4-d7cf5a2d9629 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1472 microversion: 2.1 time: 0.722151 Mar 29 02:24:54.081694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1860/3508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:53 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1472 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:54.156128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:54.156667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:54.165380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.166044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.173810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.173810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.358040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:54.359344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:54.368147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.368587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.369483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.369930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.536318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:54.546640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bcbf49d-3d07-4e6d-981b-fe5bbc1b36f0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 0.394289 Mar 29 02:24:54.548213 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1649/3509] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:54 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:54.561611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:54.564334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c8cd4935-e1e9-4124-aa7e-e3b20f98e71e req-1305d7a8-6ac0-4157-8e50-d62c5568d363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66ddad69-5f12-4e24-8a79-15fb3fcdc52c", "name": "network-vif-deleted", "tag": "4b58c36b-bc02-4fa5-a965-c9c12d126788"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:54.566034 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:54.566034 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:54.576952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8cd4935-e1e9-4124-aa7e-e3b20f98e71e req-1305d7a8-6ac0-4157-8e50-d62c5568d363 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.577393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8cd4935-e1e9-4124-aa7e-e3b20f98e71e req-1305d7a8-6ac0-4157-8e50-d62c5568d363 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.580326 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b64078a-373e-4404-98d3-8f45086b4cb3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1213 microversion: 2.1 time: 0.227275 Mar 29 02:24:54.592270 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1861/3510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:54 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1213 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:54.598057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b673aa19-b94f-4b0b-8da2-ec22047a9e8f req-6a25b7e2-acf0-46b0-bb19-8df7416297d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5bf4a-a0d7-4f25-93ec-465616c89196", "name": "network-vif-plugged", "status": "completed", "tag": "dbc5199d-d446-407a-aedb-4135363ed084"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:54.600140 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:54.600140 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:24:54.610490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b673aa19-b94f-4b0b-8da2-ec22047a9e8f req-6a25b7e2-acf0-46b0-bb19-8df7416297d8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:54.611378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b673aa19-b94f-4b0b-8da2-ec22047a9e8f req-6a25b7e2-acf0-46b0-bb19-8df7416297d8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:54.633720 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b673aa19-b94f-4b0b-8da2-ec22047a9e8f req-6a25b7e2-acf0-46b0-bb19-8df7416297d8 service nova] Creating event network-vif-plugged:dbc5199d-d446-407a-aedb-4135363ed084 for instance 71b5bf4a-a0d7-4f25-93ec-465616c89196 on n-h2-828148-1 Mar 29 02:24:54.638900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b673aa19-b94f-4b0b-8da2-ec22047a9e8f req-6a25b7e2-acf0-46b0-bb19-8df7416297d8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044775 Mar 29 02:24:54.640175 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c8cd4935-e1e9-4124-aa7e-e3b20f98e71e req-1305d7a8-6ac0-4157-8e50-d62c5568d363 service nova] Creating event network-vif-deleted:4b58c36b-bc02-4fa5-a965-c9c12d126788 for instance 66ddad69-5f12-4e24-8a79-15fb3fcdc52c on n-h1-828148-1 Mar 29 02:24:54.640343 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1862/3511] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:54.646551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c8cd4935-e1e9-4124-aa7e-e3b20f98e71e req-1305d7a8-6ac0-4157-8e50-d62c5568d363 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085828 Mar 29 02:24:54.647664 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1650/3512] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:55.079946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:55.080933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:55.091042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.091523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.092568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.093108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.104883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:55.105774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:55.114204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.119394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.119394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.119394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.167535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.168020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.168467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lazy-loading 'fault' on Instance uuid 66ddad69-5f12-4e24-8a79-15fb3fcdc52c {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:55.240388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9001e75421004f6684496eda642f06b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b09ebd529f184de7b0fee4fd914d3bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:55.249286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd8a673b-a784-4a75-8b46-0d4800a75141 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 200 len: 1315 microversion: 2.1 time: 0.173817 Mar 29 02:24:55.249901 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1863/3513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:55 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:55.565229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:55.572096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:55.577694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.578142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.578921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.579349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.722192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:55.745410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c2b0560-3628-4d95-acb9-59891e841013 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1472 microversion: 2.1 time: 0.633473 Mar 29 02:24:55.745410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1651/3514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:55 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1472 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:55.745410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:55.745410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:55.766916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.767676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:55.768666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:55.769386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:56.005363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:56.021383 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19a921af-0777-432a-b061-74f662f750ed tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1269 microversion: 2.1 time: 0.280450 Mar 29 02:24:56.024980 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1652/3515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:55 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1269 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:56.105224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:56.130635 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c361804d-6eb5-43f1-b2d9-8d38bd7f2eaa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1319 microversion: 2.1 time: 0.568568 Mar 29 02:24:56.133722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1864/3516] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:55 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:24:56.267113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:56.268090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] [instance: 66ddad69-5f12-4e24-8a79-15fb3fcdc52c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:56.277937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:56.278702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:56.279720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:56.280371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:56.335580 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] HTTP exception thrown: Instance 66ddad69-5f12-4e24-8a79-15fb3fcdc52c could not be found. Mar 29 02:24:56.344653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] Returning 404 to user: Instance 66ddad69-5f12-4e24-8a79-15fb3fcdc52c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:24:56.346461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9b6ca3aa-3cf4-4feb-bd9b-d34c77df9943 tempest-ServerAddressesNegativeTestJSON-1350862357 tempest-ServerAddressesNegativeTestJSON-1350862357-project] 10.222.0.36 "GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c" status: 404 len: 111 microversion: 2.1 time: 0.083499 Mar 29 02:24:56.347298 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1653/3517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:56 2022] GET /compute/v2.1/servers/66ddad69-5f12-4e24-8a79-15fb3fcdc52c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:24:56.752228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:56.752865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:56.761267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:56.761822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:56.762679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:56.763187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.040628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:57.041893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:57.063043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:57.065147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.066389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:57.069801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.247099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:57.256697 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b59929f5-1830-4380-aec9-cfdc2b05bfe2 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1472 microversion: 2.1 time: 0.508168 Mar 29 02:24:57.261203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1865/3518] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:56 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1472 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:57.266063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:57.272271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:57.273541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:57.287169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87b628e3-b9bc-421f-8c3b-24503a0ebf42 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1267 microversion: 2.1 time: 0.251424 Mar 29 02:24:57.288180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1654/3519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:57 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:57.299118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f3f5f3da-2e21-4270-9b2f-62017b131389 req-28b1a823-bd1f-4818-bc5c-2be3c3b9f216 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63339d2a-2be7-407e-afea-3172124a1cc0", "name": "network-vif-deleted", "tag": "bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:57.300170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:57.300760 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:24:57.300760 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:24:57.301191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.302195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:57.302840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.325906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3f5f3da-2e21-4270-9b2f-62017b131389 req-28b1a823-bd1f-4818-bc5c-2be3c3b9f216 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:57.325906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3f5f3da-2e21-4270-9b2f-62017b131389 req-28b1a823-bd1f-4818-bc5c-2be3c3b9f216 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:57.356163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f3f5f3da-2e21-4270-9b2f-62017b131389 req-28b1a823-bd1f-4818-bc5c-2be3c3b9f216 service nova] Creating event network-vif-deleted:bb59d5f1-6b4f-4437-9f3c-a8a4ab33bc02 for instance 63339d2a-2be7-407e-afea-3172124a1cc0 on n-h1-828148-1 Mar 29 02:24:57.369446 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f3f5f3da-2e21-4270-9b2f-62017b131389 req-28b1a823-bd1f-4818-bc5c-2be3c3b9f216 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078068 Mar 29 02:24:57.370065 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1655/3520] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:24:57.980027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:57.991127 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3385cd15-dbce-4cb3-a994-0b03d7ecdad3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 200 len: 1507 microversion: 2.1 time: 0.728480 Mar 29 02:24:57.994599 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1866/3521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:57 2022] GET /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:58.014442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:58.016045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: ff2c5eb9-e9c8-4dfb-972a-c5254899cf57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:58.033432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.033943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.035041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.037279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.277460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:58.278174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:58.293508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.297859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.297859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.297859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.424562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:58.446595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a4e0466-6f1a-4078-a7d5-77e539da25b6 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/ff2c5eb9-e9c8-4dfb-972a-c5254899cf57" status: 200 len: 1508 microversion: 2.1 time: 0.439018 Mar 29 02:24:58.447232 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1656/3522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:58 2022] GET /compute/v2.1/servers/ff2c5eb9-e9c8-4dfb-972a-c5254899cf57 => generated 1508 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:58.462713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:58.463530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:58.471644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.472548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.473617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.474238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.528426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.531885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.532470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lazy-loading 'fault' on Instance uuid 63339d2a-2be7-407e-afea-3172124a1cc0 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:24:58.640870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:58.653482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4809655-41b7-4407-bf46-65f15b266b11 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 200 len: 1306 microversion: 2.1 time: 0.379596 Mar 29 02:24:58.654653 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1867/3523] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:58 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 1306 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:58.659382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:58.660332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: ff2c5eb9-e9c8-4dfb-972a-c5254899cf57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:58.668775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.669439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.670498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:58.671116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:58.740785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: ff2c5eb9-e9c8-4dfb-972a-c5254899cf57] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:59.205645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:24:59.215104 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8026d510-8ae9-419a-be4d-6487444f0d4d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 0.756087 Mar 29 02:24:59.230612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1657/3524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:58 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:24:59.266563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-431d5181-394c-4ff6-9295-1543c85414b2 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ff2c5eb9-e9c8-4dfb-972a-c5254899cf57" status: 204 len: 0 microversion: 2.1 time: 0.610235 Mar 29 02:24:59.267652 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1868/3525] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:58 2022] DELETE /compute/v2.1/servers/ff2c5eb9-e9c8-4dfb-972a-c5254899cf57 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:24:59.283383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:59.287192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:59.320693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.321628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:59.323662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.325287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:59.543816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 71b5bf4a-a0d7-4f25-93ec-465616c89196] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:24:59.565221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1699340164", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:24:59.741452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:24:59.741874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:24:59.742345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:24:59.742751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:24:59.743156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:24:59.773111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.773970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:59.775026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.775674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:59.795176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Getting quotas for project 859a537211864f99a9c657697c7a18a4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:24:59.802226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Getting quotas for user db249f74191c481b875e27f23d580925 and project 859a537211864f99a9c657697c7a18a4. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:24:59.817136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:24:59.820708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:24:59.963848 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-519c796d-a7f9-4e09-856b-3e2ebbe9b4f5 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.731590 Mar 29 02:24:59.965434 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1658/3526] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:24:59.978422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:24:59.980114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 63339d2a-2be7-407e-afea-3172124a1cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:24:59.995673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.996695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:24:59.997753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:24:59.998493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:00.072408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e2b9975-b231-41be-a170-5ee6e7cf7dfd tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "DELETE /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196" status: 204 len: 0 microversion: 2.1 time: 0.797578 Mar 29 02:25:00.076798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1869/3527] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:24:59 2022] DELETE /compute/v2.1/servers/71b5bf4a-a0d7-4f25-93ec-465616c89196 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:00.082602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:00.083922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:00.110885 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance 63339d2a-2be7-407e-afea-3172124a1cc0 could not be found. Mar 29 02:25:00.113880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance 63339d2a-2be7-407e-afea-3172124a1cc0 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:00.115254 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63511224-cfa4-4403-a1e0-9b695ecd6949 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0" status: 404 len: 111 microversion: 2.1 time: 0.148371 Mar 29 02:25:00.116067 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1659/3528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:24:59 2022] GET /compute/v2.1/servers/63339d2a-2be7-407e-afea-3172124a1cc0 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:00.130064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:00.132111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:00.146268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:00.146853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:00.147799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:00.148356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:00.229759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:00.344214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:00.358139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:00.360053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:00.361302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd85ef8c-263e-4b20-b656-25d7e9a46b3a tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1281 microversion: 2.47 time: 0.282996 Mar 29 02:25:00.361842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1870/3529] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:00 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:00.366292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:00.373472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:00.375536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:00.375979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:00.376819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:00.377269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:00.601512 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1136b791-77ce-4b65-bfc4-90c96971c9d1 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 204 len: 0 microversion: 2.1 time: 0.476703 Mar 29 02:25:00.602131 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1660/3530] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:00 2022] DELETE /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:00.608001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1144564821", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ea588fdd-0b79-4a07-88df-f840714ee194"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:00.722777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] validate_networks() for [('ea588fdd-0b79-4a07-88df-f840714ee194', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:01.194905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:01.208027 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bfde67ac-12be-4c0f-a3ec-a85bd2566d26 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 0.844812 Mar 29 02:25:01.208995 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1871/3531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:00 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:01.224410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:01.224945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:01.234276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:01.234993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:01.235989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:01.238345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:01.313405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:01.699863 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3020f78-48a6-497a-9d61-a5b30e04630c tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 204 len: 0 microversion: 2.1 time: 0.484654 Mar 29 02:25:01.700569 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1872/3532] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:01 2022] DELETE /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:01.706633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a829be5-5b70-4b8c-a40c-c4d3148f325b"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:01.708865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:01.740416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:01.746671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:01.748042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:01.749550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.043820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Invalid volume: volume 3a829be5-5b70-4b8c-a40c-c4d3148f325b is already attached to instances: f947f40e-8500-48ed-b12c-7e32a8e8b4c6 Mar 29 02:25:02.044869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 400 to user: Invalid volume: volume 3a829be5-5b70-4b8c-a40c-c4d3148f325b is already attached to instances: f947f40e-8500-48ed-b12c-7e32a8e8b4c6 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:02.045923 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac5eb45f-0360-44ab-91f3-cdcdf0c16610 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.343764 Mar 29 02:25:02.047010 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1873/3533] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:25:01 2022] POST /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments => generated 174 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:25:02.059107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ebe0238a-7270-4dbf-a34b-fdd410e49346 req-5d35f153-0e65-4672-9fb3-e2792ee04a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527416f8-471f-4abb-8ee7-b57f66e146fc", "tag": "b4b62f01-713b-4f4a-bc3c-974292d51518"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:02.059107 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:02.059107 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:02.074614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ebe0238a-7270-4dbf-a34b-fdd410e49346 req-5d35f153-0e65-4672-9fb3-e2792ee04a17 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.075477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ebe0238a-7270-4dbf-a34b-fdd410e49346 req-5d35f153-0e65-4672-9fb3-e2792ee04a17 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.094997 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ebe0238a-7270-4dbf-a34b-fdd410e49346 req-5d35f153-0e65-4672-9fb3-e2792ee04a17 service nova] Creating event network-changed:b4b62f01-713b-4f4a-bc3c-974292d51518 for instance 527416f8-471f-4abb-8ee7-b57f66e146fc on n-h2-828148-1 Mar 29 02:25:02.103284 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ebe0238a-7270-4dbf-a34b-fdd410e49346 req-5d35f153-0e65-4672-9fb3-e2792ee04a17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051682 Mar 29 02:25:02.112986 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1874/3534] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:02.120384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:02.121130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:02.129921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.130418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.131202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.131699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.463124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:02.480503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:02.483636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:02.494860 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20670036-fc65-4555-acf3-86c94544da01 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1277 microversion: 2.47 time: 0.378942 Mar 29 02:25:02.510324 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1875/3535] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:02 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1277 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:02.516120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:02.517870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:02.528968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.529475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.530277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.530706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.657796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:02.658725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:02.660464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:02.660464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:02.660761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:02.673963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.676396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.677856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:02.680043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:02.737147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Getting quotas for project f2a4476dff96447eb2fcb18a06345131. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:02.758882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Getting quotas for user f1857cb7e24f4940a016db6e88acba6f and project f2a4476dff96447eb2fcb18a06345131. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:02.781661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Going to run 2 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:02.788276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:03.009163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=958e393e-ef02-4763-8788-14060103f7e3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:03.171026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d6b7021-ac38-4956-b9d2-8175d0e7d8b1 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.567461 Mar 29 02:25:03.172148 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1661/3536] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:00 2022] POST /compute/v2.1/servers => generated 32 bytes in 2569 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Mar 29 02:25:03.181289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:03.181828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:03.202638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:03.203607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:03.203859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:03.204812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:03.429243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lazy-loading 'services' on Instance uuid f947f40e-8500-48ed-b12c-7e32a8e8b4c6 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:03.863182 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4ca2a7f-540d-4819-9ffd-c07f9a32c428 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments/3a829be5-5b70-4b8c-a40c-c4d3148f325b" status: 202 len: 0 microversion: 2.1 time: 0.689564 Mar 29 02:25:03.873876 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1662/3537] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:25:03 2022] DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments/3a829be5-5b70-4b8c-a40c-c4d3148f325b => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:25:03.886793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:03.887954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:03.910532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:03.911344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:03.912322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:03.912940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.332259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.343317 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86fd7d77-408f-4c06-8bbe-a92211513ccf tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 200 len: 1474 microversion: 2.1 time: 1.831404 Mar 29 02:25:04.353929 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1876/3538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:02 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 1474 bytes in 1843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:04.359141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:04.364722 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:04.364722 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:04.364722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.364722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Searching by: {'deleted': False, 'project_id': 'f2a4476dff96447eb2fcb18a06345131'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:25:04.380613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.381279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.382326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.383005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.386919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.397586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f40de212-f2b1-48fc-8135-53ad2698bbb6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 0.521978 Mar 29 02:25:04.398561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1663/3539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:03 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:04.404531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f9c3be94-e866-4d9a-8046-834b7ec11975 req-7b46d796-b188-4c75-b802-4647103098ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2c5eb9-e9c8-4dfb-972a-c5254899cf57", "name": "network-vif-deleted", "tag": "088a7efe-3351-4e16-819c-e5de2657cc9c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:04.406837 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:04.406837 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:04.439869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f9c3be94-e866-4d9a-8046-834b7ec11975 req-7b46d796-b188-4c75-b802-4647103098ec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.441467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f9c3be94-e866-4d9a-8046-834b7ec11975 req-7b46d796-b188-4c75-b802-4647103098ec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.469796 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f9c3be94-e866-4d9a-8046-834b7ec11975 req-7b46d796-b188-4c75-b802-4647103098ec service nova] Creating event network-vif-deleted:088a7efe-3351-4e16-819c-e5de2657cc9c for instance ff2c5eb9-e9c8-4dfb-972a-c5254899cf57 on n-h1-828148-1 Mar 29 02:25:04.475596 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f9c3be94-e866-4d9a-8046-834b7ec11975 req-7b46d796-b188-4c75-b802-4647103098ec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075706 Mar 29 02:25:04.478867 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1664/3540] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:04.484367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:04.485481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:04.505579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:25:04.510285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.511201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.512036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.512484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.656004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-248d189a-f277-4fff-8109-a3c8b88665df tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.300516 Mar 29 02:25:04.660921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1877/3541] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:25:04 2022] GET /compute/v2.1/servers => generated 1335 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:04.671611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:04.672810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:04.680464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.681187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.682121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:04.682714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:04.755351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.767157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.771378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:04.773009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f31bdb1f-7c86-4bbb-a160-82258e5fbc3a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110947 Mar 29 02:25:04.773616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bcb64469-4e9b-4642-893e-67e2e3e40f74 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1339 microversion: 2.47 time: 0.293391 Mar 29 02:25:04.773732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1878/3542] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:25:04 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:04.789868 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1665/3543] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:04 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1339 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:04.790106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c19b13bd-4b50-4ebc-9ab5-1248a149542d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:04.790106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c19b13bd-4b50-4ebc-9ab5-1248a149542d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:05.198438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c19b13bd-4b50-4ebc-9ab5-1248a149542d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:05.207539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c19b13bd-4b50-4ebc-9ab5-1248a149542d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1218 microversion: 2.1 time: 0.432214 Mar 29 02:25:05.210759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1879/3544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:04 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:05.369545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:05.374528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:05.387516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.388387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.389755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.390356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.416252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:05.417599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:05.451470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.452338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.453503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.454104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.887602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:05.897117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-262de910-16e9-49c7-9304-6a40b9432355 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 200 len: 1474 microversion: 2.1 time: 0.539277 Mar 29 02:25:05.897965 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1666/3545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:05 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 1474 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:05.903250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:05.904417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:05.918508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.918986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.919772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:05.920207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:05.991515 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aae0f0a3-19aa-4220-846f-c83f29e2d0ae tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092174 Mar 29 02:25:05.992102 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1667/3546] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:25:05 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:25:06.008744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:06.011966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:06.019897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.020698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.021748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.022406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.151587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:06.169859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:06.171174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:06.172590 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b0657fc-d185-496b-8263-1293398020cc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1339 microversion: 2.47 time: 0.179225 Mar 29 02:25:06.173727 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1668/3547] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:05 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1339 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:06.182837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:06.183606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:06.194746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.195582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.198092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.198092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.262105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:06.693767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4330f5ca-9456-4524-9bf0-228bab54bebf tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 204 len: 0 microversion: 2.1 time: 0.518267 Mar 29 02:25:06.694469 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1669/3548] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:06 2022] DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:06.702177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5817fd44-1b83-4964-a740-065eb5336239 req-726cf304-4ecb-443a-b9c3-b553df38d166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b5bf4a-a0d7-4f25-93ec-465616c89196", "name": "network-vif-deleted", "tag": "dbc5199d-d446-407a-aedb-4135363ed084"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:06.704399 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:06.704399 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:06.757290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5817fd44-1b83-4964-a740-065eb5336239 req-726cf304-4ecb-443a-b9c3-b553df38d166 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.757736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5817fd44-1b83-4964-a740-065eb5336239 req-726cf304-4ecb-443a-b9c3-b553df38d166 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.800013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:06.809907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0db622c3-687b-40da-a3fb-32c399349526 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 1.398375 Mar 29 02:25:06.825834 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1880/3549] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:05 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:06.830540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:06.831154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:06.855146 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5817fd44-1b83-4964-a740-065eb5336239 req-726cf304-4ecb-443a-b9c3-b553df38d166 service nova] Creating event network-vif-deleted:dbc5199d-d446-407a-aedb-4135363ed084 for instance 71b5bf4a-a0d7-4f25-93ec-465616c89196 on n-h2-828148-1 Mar 29 02:25:06.867185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.867644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.868482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.870946 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5817fd44-1b83-4964-a740-065eb5336239 req-726cf304-4ecb-443a-b9c3-b553df38d166 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174985 Mar 29 02:25:06.871556 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1670/3550] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:06.881450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.884167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6f8b4119-b18d-4cdb-a5be-5b629a3d4048 req-2b578909-088e-4d1c-a613-674968c8a677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4873d387-bf57-4641-96cc-99305bd75c5a", "name": "network-vif-deleted", "tag": "fd05a781-de17-477f-b6bf-feb3ac844297"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:06.886473 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:06.886473 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:06.907299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6f8b4119-b18d-4cdb-a5be-5b629a3d4048 req-2b578909-088e-4d1c-a613-674968c8a677 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:06.910298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6f8b4119-b18d-4cdb-a5be-5b629a3d4048 req-2b578909-088e-4d1c-a613-674968c8a677 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:06.967165 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6f8b4119-b18d-4cdb-a5be-5b629a3d4048 req-2b578909-088e-4d1c-a613-674968c8a677 service nova] Creating event network-vif-deleted:fd05a781-de17-477f-b6bf-feb3ac844297 for instance 4873d387-bf57-4641-96cc-99305bd75c5a on n-h1-828148-1 Mar 29 02:25:06.981905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6f8b4119-b18d-4cdb-a5be-5b629a3d4048 req-2b578909-088e-4d1c-a613-674968c8a677 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108917 Mar 29 02:25:06.985371 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1671/3551] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:07.003310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:07.011545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:07.037722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.038083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.042127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.042593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.464280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:07.473450 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46ad96fe-3139-4d5c-83a9-7688cb79b02b tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1214 microversion: 2.1 time: 0.646342 Mar 29 02:25:07.474765 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1881/3552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:06 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1214 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:07.481017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:07.482184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:07.491936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.495848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.495848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.495848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.587877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.588675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.589478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lazy-loading 'fault' on Instance uuid 6f414f7b-6392-47fd-9fb5-0728104e2e78 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:07.804508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:07.816576 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ee3b7c9-8464-448b-b55d-96815ac93012 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 200 len: 1309 microversion: 2.1 time: 0.340096 Mar 29 02:25:07.826835 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1882/3553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:07 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 1309 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:07.829419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:07.830486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:07.866295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.866722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:07.867790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:07.869050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.107105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:08.124192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:08.130762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:08.132446 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-50a3be7c-7d36-4cc8-a15f-563d09cf9029 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1339 microversion: 2.47 time: 0.308556 Mar 29 02:25:08.137806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1883/3554] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:07 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:08.151037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:08.152758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:08.167177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.169832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.173017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.173716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.523249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:08.556153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa8925f8-0fcb-4b24-ad98-f8354072333c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1681 microversion: 2.1 time: 1.569002 Mar 29 02:25:08.558018 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1672/3555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:06 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1681 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:08.567336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:08.569338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:08.590578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.591637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.592874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.593862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.733767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:08.745561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebf7e4ef-c6b6-4187-9c3f-19ca83555197 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 0.606122 Mar 29 02:25:08.746697 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1884/3556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:08 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:08.834174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:08.834872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 6f414f7b-6392-47fd-9fb5-0728104e2e78] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:08.852164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.853182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.854149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.854740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.940924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance 6f414f7b-6392-47fd-9fb5-0728104e2e78 could not be found. Mar 29 02:25:08.941796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance 6f414f7b-6392-47fd-9fb5-0728104e2e78 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:08.942820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a6493ae-3d3b-4a65-8469-cbfa818e61d3 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78" status: 404 len: 111 microversion: 2.1 time: 0.112327 Mar 29 02:25:08.943971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1885/3557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:08 2022] GET /compute/v2.1/servers/6f414f7b-6392-47fd-9fb5-0728104e2e78 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:25:08.955981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:08.956515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 4873d387-bf57-4641-96cc-99305bd75c5a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:08.979846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.980528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:08.981511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:08.981953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.048309 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance 4873d387-bf57-4641-96cc-99305bd75c5a could not be found. Mar 29 02:25:09.049238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance 4873d387-bf57-4641-96cc-99305bd75c5a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:09.050234 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8834eba-2240-4397-92fb-bf0a37606bea tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a" status: 404 len: 111 microversion: 2.1 time: 0.101413 Mar 29 02:25:09.051449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1886/3558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:08 2022] GET /compute/v2.1/servers/4873d387-bf57-4641-96cc-99305bd75c5a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:09.200970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-123375140", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "e85a059a-601e-4c20-a114-6107090c4687"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:09.279653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] validate_networks() for [('e85a059a-601e-4c20-a114-6107090c4687', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:09.288601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:09.298339 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4cdced71-2d6b-448c-a20b-16eed642f104 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1276 microversion: 2.1 time: 0.738585 Mar 29 02:25:09.298922 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1673/3559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:08 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1276 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:09.303254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4771c837-32e3-4ab5-95ee-2b404d66b7e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:09.398175 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4771c837-32e3-4ab5-95ee-2b404d66b7e7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/9b986077-cdc0-4840-bc30-7dcb2a9972ee" status: 204 len: 0 microversion: 2.1 time: 0.098145 Mar 29 02:25:09.402668 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1674/3560] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:09 2022] DELETE /compute/v2.1/os-server-groups/9b986077-cdc0-4840-bc30-7dcb2a9972ee => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:09.406238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:09.406747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:09.415430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:09.416009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.416941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:09.417756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.575403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:09.588569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:09.589436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:09.590429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fad4978b-9cde-44d7-981d-0bbb3b436385 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1360 microversion: 2.47 time: 0.190330 Mar 29 02:25:09.600726 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1675/3561] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:09 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1360 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:09.600726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4003c653-5c83-49a6-b611-70c7baf4f441 req-ace9a8da-ad46-4222-a97e-5b30be64be34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f414f7b-6392-47fd-9fb5-0728104e2e78", "name": "network-vif-deleted", "tag": "7373f9f8-fca1-4609-a765-76aa5df00902"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:09.600726 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:09.600726 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:09.606759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4003c653-5c83-49a6-b611-70c7baf4f441 req-ace9a8da-ad46-4222-a97e-5b30be64be34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:09.607208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4003c653-5c83-49a6-b611-70c7baf4f441 req-ace9a8da-ad46-4222-a97e-5b30be64be34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.626945 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4003c653-5c83-49a6-b611-70c7baf4f441 req-ace9a8da-ad46-4222-a97e-5b30be64be34 service nova] Creating event network-vif-deleted:7373f9f8-fca1-4609-a765-76aa5df00902 for instance 6f414f7b-6392-47fd-9fb5-0728104e2e78 on n-h2-828148-1 Mar 29 02:25:09.631999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4003c653-5c83-49a6-b611-70c7baf4f441 req-ace9a8da-ad46-4222-a97e-5b30be64be34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039762 Mar 29 02:25:09.632613 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1676/3562] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:09.638190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:09.638786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:09.647797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:09.648255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.649082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:09.649749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:09.722756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:10.099703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-73bcfba0-4d08-41e9-b3f3-aaa6ffc3d8ec tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c" status: 204 len: 0 microversion: 2.1 time: 0.464631 Mar 29 02:25:10.102058 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1677/3563] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:09 2022] DELETE /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:10.111009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:10.112413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:10.126167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:10.127022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:10.130604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:10.130604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:10.356302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:10.365251 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0e4098c-a97e-4a2d-84c1-ffd92c74b759 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 200 len: 1613 microversion: 2.1 time: 0.260453 Mar 29 02:25:10.365711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1678/3564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:10 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 1613 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:10.375165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-7478394"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:10.375165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:10.379517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:10.380119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:10.380967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:10.381490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.010250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:11.014069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:11.017189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:11.017189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:11.017810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:11.037090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.038074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.039655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.040381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.061697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Getting quotas for project 45a221c5adea4c60a79fa0aca9857980. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:11.069129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Getting quotas for user dab24cd07c6c445c8a195ebd308084c4 and project 45a221c5adea4c60a79fa0aca9857980. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:11.089329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:11.093141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:11.104209 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ca23651-cf0f-4f34-b597-a901464ea294 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "POST /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94/action" status: 202 len: 52 microversion: 2.47 time: 0.737186 Mar 29 02:25:11.105601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1679/3565] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:25:10 2022] POST /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94/action => generated 52 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Mar 29 02:25:11.116889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:11.118431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:11.158518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.159394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.163028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.165876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.305766 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb9ac357-a4fe-4870-b844-cd88fe280475 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252664 Mar 29 02:25:11.307922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1887/3566] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:25:11.318671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:11.319525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:11.331284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.332094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.333261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.333903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:11.483856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:11.938947 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb33c8c7-0fe7-473b-98ec-9a9a25625c1b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 204 len: 0 microversion: 2.1 time: 0.629203 Mar 29 02:25:11.939945 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1888/3567] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:11 2022] DELETE /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:11.949536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9710e3a4-5c56-4d33-ad50-64be7e99640e req-99ae4448-2a90-4647-ad9d-d57d8138c31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527416f8-471f-4abb-8ee7-b57f66e146fc", "name": "network-vif-plugged", "status": "completed", "tag": "b4b62f01-713b-4f4a-bc3c-974292d51518"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:11.951986 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:11.951986 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:11.995851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9710e3a4-5c56-4d33-ad50-64be7e99640e req-99ae4448-2a90-4647-ad9d-d57d8138c31e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:11.999071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9710e3a4-5c56-4d33-ad50-64be7e99640e req-99ae4448-2a90-4647-ad9d-d57d8138c31e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:12.027700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9710e3a4-5c56-4d33-ad50-64be7e99640e req-99ae4448-2a90-4647-ad9d-d57d8138c31e service nova] Creating event network-vif-plugged:b4b62f01-713b-4f4a-bc3c-974292d51518 for instance 527416f8-471f-4abb-8ee7-b57f66e146fc on n-h2-828148-1 Mar 29 02:25:12.034801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9710e3a4-5c56-4d33-ad50-64be7e99640e req-99ae4448-2a90-4647-ad9d-d57d8138c31e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092445 Mar 29 02:25:12.036027 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1889/3568] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:12.042653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:12.043773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:12.053387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:12.054253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:12.055400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:12.056019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:12.516305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:12.538248 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ef25fc61-e64b-4758-82ab-05d2992a06d1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 1.431094 Mar 29 02:25:12.539307 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1680/3569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:11 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:12.548336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:12.549076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:12.559455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:12.561696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:12.561696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:12.561696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:12.733175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:13.252887 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ab56299-5735-4bad-9392-48d6810e183d tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "DELETE /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 204 len: 0 microversion: 2.47 time: 0.711565 Mar 29 02:25:13.253941 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1681/3570] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:25:12 2022] DELETE /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:25:13.259510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:13.262083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:13.268556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.269165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.270050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.270615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.550446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:13.566965 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5abe98a-b539-4893-84ab-4297bf59b6bb tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 1.529337 Mar 29 02:25:13.567826 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1890/3571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:12 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:13.582017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:13.583278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:13.595676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.598646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.599645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.600243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.764139 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. Mar 29 02:25:13.767605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:13.769971 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12e1f2db-1bc1-427d-89be-2e272226ec55 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 404 len: 111 microversion: 2.1 time: 0.200929 Mar 29 02:25:13.772562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1891/3572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:13 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:13.803550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0985c510-4177-483d-b829-909527ecfce3 req-5fc03550-4c30-4918-b70a-0a8ce5f3fbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f947f40e-8500-48ed-b12c-7e32a8e8b4c6", "name": "network-vif-deleted", "tag": "c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:13.808016 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:13.808016 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:13.849457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0985c510-4177-483d-b829-909527ecfce3 req-5fc03550-4c30-4918-b70a-0a8ce5f3fbb6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.852309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0985c510-4177-483d-b829-909527ecfce3 req-5fc03550-4c30-4918-b70a-0a8ce5f3fbb6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.912433 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0985c510-4177-483d-b829-909527ecfce3 req-5fc03550-4c30-4918-b70a-0a8ce5f3fbb6 service nova] Creating event network-vif-deleted:c1a1e52f-1f97-4b7b-ab4c-baa09cc6a41a for instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 on n-h2-828148-1 Mar 29 02:25:13.917924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0985c510-4177-483d-b829-909527ecfce3 req-5fc03550-4c30-4918-b70a-0a8ce5f3fbb6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130581 Mar 29 02:25:13.919033 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1892/3573] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:13.924797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:13.926446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:13.951546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.952294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:13.953111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:13.955750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:14.107695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:14.137410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-064d8734-8cd9-4b82-83a0-f71a67a2f111 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1211 microversion: 2.1 time: 0.882128 Mar 29 02:25:14.141612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1682/3574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:13 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1211 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:14.155325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:14.157407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:14.186231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:14.186690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:14.187479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:14.187989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:14.408558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:14.421515 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80468ca9-d69b-4b6b-bfa1-f7955219fdc6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c" status: 200 len: 1433 microversion: 2.1 time: 0.501189 Mar 29 02:25:14.434374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1893/3575] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:13 2022] GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c => generated 1433 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:14.439298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:14.459476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:14.494965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:14.495468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:14.501037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:14.505188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:15.089306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:15.120130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:15.126181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:15.129393 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-514a0096-3a21-4663-bf9d-33fcd9755ffc tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1366 microversion: 2.47 time: 0.983616 Mar 29 02:25:15.131227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1683/3576] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:14 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1366 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:15.139117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8384b828-8448-4c9a-aa72-8466eba005a6 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '.version_select at 0x7f8717f5ce50>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:15.261593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8384b828-8448-4c9a-aa72-8466eba005a6 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541343059" status: 202 len: 0 microversion: 2.1 time: 0.126461 Mar 29 02:25:15.266062 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1684/3577] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541343059 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:25:15.274904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3817d24e-1ad5-4e5e-8190-8bf2e604b8a0 req-3a9b26b2-0c6b-4deb-8cea-8ca0f687781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958e393e-ef02-4763-8788-14060103f7e3", "tag": "38eaa6ce-64fe-4b61-afe1-439e89df8a2b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:15.280354 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:15.280354 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:15.321862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3817d24e-1ad5-4e5e-8190-8bf2e604b8a0 req-3a9b26b2-0c6b-4deb-8cea-8ca0f687781b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:15.322311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3817d24e-1ad5-4e5e-8190-8bf2e604b8a0 req-3a9b26b2-0c6b-4deb-8cea-8ca0f687781b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:15.360359 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3817d24e-1ad5-4e5e-8190-8bf2e604b8a0 req-3a9b26b2-0c6b-4deb-8cea-8ca0f687781b service nova] Creating event network-changed:38eaa6ce-64fe-4b61-afe1-439e89df8a2b for instance 958e393e-ef02-4763-8788-14060103f7e3 on n-h1-828148-1 Mar 29 02:25:15.366309 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3817d24e-1ad5-4e5e-8190-8bf2e604b8a0 req-3a9b26b2-0c6b-4deb-8cea-8ca0f687781b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102920 Mar 29 02:25:15.367263 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1685/3578] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:15.381176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:15.384263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:15.399933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:15.401290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:15.401290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:15.401603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:15.890257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:15.906641 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2457190-99d9-4778-8b0f-37e7057d674b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1309 microversion: 2.1 time: 1.470904 Mar 29 02:25:15.909096 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1894/3579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:14 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1309 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:15.916377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:15.917472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:15.997857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:15.999764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.007189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.007189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.240549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:16.251299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ecd7bcb-db7d-4bb9-b938-db94b57264f3 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1273 microversion: 2.1 time: 0.340224 Mar 29 02:25:16.256237 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1895/3580] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:15 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:16.259550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:16.260363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: a274f0e4-8009-4256-bc94-d2b2d1cf590c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:16.273824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.276027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.278417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.280384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.345208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance a274f0e4-8009-4256-bc94-d2b2d1cf590c could not be found. Mar 29 02:25:16.346815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance a274f0e4-8009-4256-bc94-d2b2d1cf590c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:16.347979 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-989b4f25-7aca-411b-9a92-1b293c908d18 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c" status: 404 len: 111 microversion: 2.1 time: 0.094677 Mar 29 02:25:16.348554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1896/3581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:16 2022] GET /compute/v2.1/servers/a274f0e4-8009-4256-bc94-d2b2d1cf590c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:16.356776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-fa778f6c-aaf6-4764-b042-3aeefaee8724 req-d3bdc399-a712-4bcc-bda8-ed1355ebac12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a274f0e4-8009-4256-bc94-d2b2d1cf590c", "name": "network-vif-deleted", "tag": "3a4b24ac-7211-4859-b32c-8f4bbdffd372"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:16.358339 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:16.358339 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:16.376960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fa778f6c-aaf6-4764-b042-3aeefaee8724 req-d3bdc399-a712-4bcc-bda8-ed1355ebac12 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.378391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fa778f6c-aaf6-4764-b042-3aeefaee8724 req-d3bdc399-a712-4bcc-bda8-ed1355ebac12 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.411089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-fa778f6c-aaf6-4764-b042-3aeefaee8724 req-d3bdc399-a712-4bcc-bda8-ed1355ebac12 service nova] Creating event network-vif-deleted:3a4b24ac-7211-4859-b32c-8f4bbdffd372 for instance a274f0e4-8009-4256-bc94-d2b2d1cf590c on n-h2-828148-1 Mar 29 02:25:16.436955 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-fa778f6c-aaf6-4764-b042-3aeefaee8724 req-d3bdc399-a712-4bcc-bda8-ed1355ebac12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086028 Mar 29 02:25:16.437656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1897/3582] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:16.449597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:16.450480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:16.463326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.468213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.468213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.468213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.681274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:16.695743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:16.698308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:16.699480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2acb833f-3253-4c69-b15d-59d29b9ffcc3 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1366 microversion: 2.47 time: 0.260736 Mar 29 02:25:16.700029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1898/3583] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:16 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:16.712227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:16.713405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:16.721482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.722704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.723862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.724619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.877103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:16.887437 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3492fc57-3287-4a51-8364-ab8d5d2a21d7 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1433 microversion: 2.1 time: 0.181387 Mar 29 02:25:16.897745 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1899/3584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:16 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1433 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:16.927217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:16.928316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:16.941096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.941541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:16.942313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:16.942882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:17.282196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:17.305769 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b334bfa2-174e-4088-bb54-3edd98213189 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 1.932048 Mar 29 02:25:17.315481 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1686/3585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:15 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:17.323741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:17.325454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:17.325776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:17.335426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-916d8068-fd50-415c-96b4-db446dff667c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1491 microversion: 2.1 time: 0.413485 Mar 29 02:25:17.347732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1900/3586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:16 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1491 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:17.353379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:17.353379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:17.354107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:17.355039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:17.357214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:17.357963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:17.363938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:17.364439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:17.365427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:17.365871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:17.794026 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:25:18.149669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.163055 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a268abb-5560-40b5-b74a-e30f65af36c4 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.841743 Mar 29 02:25:18.164490 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1687/3587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:17 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:18.192385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.192883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-28defac5-5a93-458f-8ca4-9eacef41f6f4 req-b21324cc-a904-44b9-92e1-f843c71091d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a53aa3ec-19b0-4896-aff7-5556f450a219", "tag": "cf9e0a36-681e-4527-855f-e12476f81247"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:18.192883 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:18.192883 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:18.193267 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eabefa8a-212e-4756-a1e9-8dcf68efdd76 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1490 microversion: 2.1 time: 0.842077 Mar 29 02:25:18.193267 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1901/3588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:17 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1490 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:18.209903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:18.214790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:18.220458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-28defac5-5a93-458f-8ca4-9eacef41f6f4 req-b21324cc-a904-44b9-92e1-f843c71091d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.225855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.226867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.227871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.228526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.230737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-28defac5-5a93-458f-8ca4-9eacef41f6f4 req-b21324cc-a904-44b9-92e1-f843c71091d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.264429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-28defac5-5a93-458f-8ca4-9eacef41f6f4 req-b21324cc-a904-44b9-92e1-f843c71091d1 service nova] Creating event network-changed:cf9e0a36-681e-4527-855f-e12476f81247 for instance a53aa3ec-19b0-4896-aff7-5556f450a219 on n-h1-828148-1 Mar 29 02:25:18.283416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-28defac5-5a93-458f-8ca4-9eacef41f6f4 req-b21324cc-a904-44b9-92e1-f843c71091d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114532 Mar 29 02:25:18.287255 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1688/3589] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:18.294011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:18.301876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:18.342952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.343589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.345283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.345957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.435717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.436094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.439833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lazy-loading 'fault' on Instance uuid 82aef6c8-5fe1-4934-b9b3-5420e3459f94 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:18.501303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.501751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.502398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lazy-loading 'fault' on Instance uuid 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:18.742596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.753235 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-801673bd-0d68-4e6d-a3f9-73ae6cb8a63b tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 200 len: 1309 microversion: 2.1 time: 0.464377 Mar 29 02:25:18.754058 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1689/3590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:18 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:18.761586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:18.762427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:18.768553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.778291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.780085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'db249f74191c481b875e27f23d580925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '859a537211864f99a9c657697c7a18a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:18.781952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e743aac-63aa-406c-99a6-1127e1c4f166 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 200 len: 1371 microversion: 2.47 time: 0.578748 Mar 29 02:25:18.783329 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1902/3591] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:18 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 1371 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:18.787362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.788510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:18.790043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:18.790270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.794413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.795149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.807851 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 37674. Mar 29 02:25:18.830630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.831345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:18.834064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:18.834703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.521951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:19.531932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bffcff90-9590-4c46-9b48-563c6dcbc65a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.747042 Mar 29 02:25:19.537468 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1903/3592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:18 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:19.537468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f88fa410-1c1d-4504-841f-52a1383e2325 req-ee882583-c07f-4446-8afb-c0d5fde811e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90d84e3d-ddfc-476d-8c6d-83aa4dcaa705", "name": "network-vif-deleted", "tag": "09a91905-ac3c-4ca4-bbe5-9867accd1b46"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:19.540593 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:19.540593 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:19.549335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f88fa410-1c1d-4504-841f-52a1383e2325 req-ee882583-c07f-4446-8afb-c0d5fde811e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.555257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f88fa410-1c1d-4504-841f-52a1383e2325 req-ee882583-c07f-4446-8afb-c0d5fde811e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.567903 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f88fa410-1c1d-4504-841f-52a1383e2325 req-ee882583-c07f-4446-8afb-c0d5fde811e6 service nova] Creating event network-vif-deleted:09a91905-ac3c-4ca4-bbe5-9867accd1b46 for instance 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 on n-h2-828148-1 Mar 29 02:25:19.573673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f88fa410-1c1d-4504-841f-52a1383e2325 req-ee882583-c07f-4446-8afb-c0d5fde811e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039650 Mar 29 02:25:19.574921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1904/3593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:19.579771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:19.580458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:19.588526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.589115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.589878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.590577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.769389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:19.780492 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a5d3b40-b39e-4112-90b9-4b15a38ed554 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1491 microversion: 2.1 time: 1.024912 Mar 29 02:25:19.793685 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1690/3594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:18 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1491 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:19.798746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:19.799341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:19.808923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.810308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.811452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.813017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.871465 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 could not be found. Mar 29 02:25:19.872079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance 90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:19.872951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e789572-6b35-4324-89c8-d9cbe90f8ae8 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705" status: 404 len: 111 microversion: 2.1 time: 0.078143 Mar 29 02:25:19.877288 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1691/3595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:19 2022] GET /compute/v2.1/servers/90d84e3d-ddfc-476d-8c6d-83aa4dcaa705 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:19.882678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:19.884006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:19.892561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.893306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.894247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:19.894835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:19.970903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:20.458928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc44d99f-948d-4915-908a-1654f412ba77 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 204 len: 0 microversion: 2.1 time: 0.580150 Mar 29 02:25:20.460238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1692/3596] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:19 2022] DELETE /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:20.467104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:20.467944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] [instance: 82aef6c8-5fe1-4934-b9b3-5420e3459f94] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:20.475865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.476483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:20.477418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.477960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:20.500774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:20.512109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cd8eba9b-777d-414a-a5a4-b495728c9a01 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.936120 Mar 29 02:25:20.512696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1905/3597] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:19 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:20.523510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd0e0edf-8168-4118-97be-c8b7bc85aa6e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:20.541850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] HTTP exception thrown: Instance 82aef6c8-5fe1-4934-b9b3-5420e3459f94 could not be found. Mar 29 02:25:20.542589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] Returning 404 to user: Instance 82aef6c8-5fe1-4934-b9b3-5420e3459f94 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:20.543539 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dec270c-c91a-4551-ab4c-084fc2688a04 tempest-ServersAaction247Test-1379428623 tempest-ServersAaction247Test-1379428623-project] 10.222.0.36 "GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94" status: 404 len: 111 microversion: 2.47 time: 0.081603 Mar 29 02:25:20.544198 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1693/3598] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:20 2022] GET /compute/v2.1/servers/82aef6c8-5fe1-4934-b9b3-5420e3459f94 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:25:20.551652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: .version_select at 0x7f8717e94040>, body: {"keypair": {"name": "tempest-keypair-1859013923"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:20.583959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:20.592276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:20.721959 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd0e0edf-8168-4118-97be-c8b7bc85aa6e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/00b1ed25-5174-4132-a26b-80eeebe4f451" status: 204 len: 0 microversion: 2.1 time: 0.208180 Mar 29 02:25:20.723000 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1906/3599] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:20 2022] DELETE /compute/v2.1/os-server-groups/00b1ed25-5174-4132-a26b-80eeebe4f451 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:20.730445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:20.731806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:20.760275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.767933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:20.769086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.771021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:20.891889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:20.899714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:20.919202 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6cadd884-4246-4448-a546-7d4cddfff1d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.373640 Mar 29 02:25:20.920440 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1694/3600] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:25:20 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:20.939976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:20.943247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:20.955687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.955687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:20.956471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:20.957131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.253293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:21.284496 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c50bfd43-60e5-4d71-878a-a5cbf86b367c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1497 microversion: 2.1 time: 0.557023 Mar 29 02:25:21.288467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1907/3601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:20 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1497 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:21.305450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:21.307708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:21.333638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.338529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.344565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.345458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.478740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:21.653823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:21.667782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c0524af6-3448-49d0-859e-02c7b5ad66e8 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.742787 Mar 29 02:25:21.668376 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1695/3602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:20 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:21.676594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:21.677256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:21.692793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.693468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.694448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.695017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.920905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fc492487-cff8-49a9-8470-aab0f378e789 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 204 len: 0 microversion: 2.1 time: 0.629217 Mar 29 02:25:21.921522 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1908/3603] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:21 2022] DELETE /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:21.928144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-534ebe77-40cc-4c1b-8645-9beaa921c48f req-e8d35185-f2f4-476c-830e-aca134450ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b9e0eb-6c2b-4676-b34f-699432c7c80f", "tag": "52ee60b2-439f-4e52-ac2c-02ea3aa48258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:21.928144 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:21.928144 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:21.936612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-534ebe77-40cc-4c1b-8645-9beaa921c48f req-e8d35185-f2f4-476c-830e-aca134450ad7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.937116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-534ebe77-40cc-4c1b-8645-9beaa921c48f req-e8d35185-f2f4-476c-830e-aca134450ad7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.956138 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-534ebe77-40cc-4c1b-8645-9beaa921c48f req-e8d35185-f2f4-476c-830e-aca134450ad7 service nova] Creating event network-changed:52ee60b2-439f-4e52-ac2c-02ea3aa48258 for instance 25b9e0eb-6c2b-4676-b34f-699432c7c80f on n-h2-828148-1 Mar 29 02:25:21.963565 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-534ebe77-40cc-4c1b-8645-9beaa921c48f req-e8d35185-f2f4-476c-830e-aca134450ad7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038170 Mar 29 02:25:21.963565 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1909/3604] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:21.968176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:21.968343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:21.987041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.987664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:21.992238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:21.992238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:22.245535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:22.257137 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ac9f440-72ea-4a88-be79-fe6a754b9029 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.587543 Mar 29 02:25:22.258016 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1696/3605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:21 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:22.307129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:22.308086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:22.319848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:22.321637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:22.322651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:22.323288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:22.783092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:22.795757 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05e7f999-02a6-4dbb-8658-1beb0cab4246 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1497 microversion: 2.1 time: 0.493528 Mar 29 02:25:22.796588 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1697/3606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:22 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:22.801156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:22.802164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:22.809529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:22.810139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:22.810937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:22.811419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:23.054272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:23.063125 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6029848f-b4a6-4412-916d-dea5f2449ba6 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1471 microversion: 2.1 time: 1.099553 Mar 29 02:25:23.063712 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1910/3607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:21 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1471 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:23.078097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Action: 'create', calling method: .version_select at 0x7f8724c6dd30>, body: {"keypair": {"name": "tempest-keypair-1496303868"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:23.093302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:23.100894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for project bda67cbdacc74c0f8dbde35c57289991. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:23.105560 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ebe6ff0e-ddaa-4e63-a2c5-1976cb92c820 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.304520 Mar 29 02:25:23.105560 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1698/3608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:22 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:23.106468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for user 04a5b48824604553ac2fd7b08fc81f52 and project bda67cbdacc74c0f8dbde35c57289991. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:23.274755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:23.275804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:23.290600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:23.291337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:23.292279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:23.292958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:23.730447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for project bda67cbdacc74c0f8dbde35c57289991. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:23.732382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:23.743779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e65e8653-7176-42ec-bc89-52165d5c2843 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.473670 Mar 29 02:25:23.744356 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1699/3609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:23 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:23.754389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for user 04a5b48824604553ac2fd7b08fc81f52 and project bda67cbdacc74c0f8dbde35c57289991. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:23.792751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-534c6e8a-a7a0-4c27-8e97-64e96d8035bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.42 time: 0.718425 Mar 29 02:25:23.800499 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1911/3610] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:25:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 726 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:25:23.816655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:23.820873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:23.836304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:23.839691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:23.843468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:23.844738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:24.074469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-666c7d0d-b5fe-45f4-b4dc-476d6349a3e6 req-c77b5ac8-abfc-4337-acc5-f8e773b03749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527416f8-471f-4abb-8ee7-b57f66e146fc", "name": "network-vif-deleted", "tag": "b4b62f01-713b-4f4a-bc3c-974292d51518"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:24.076708 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:24.076708 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:24.101158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-666c7d0d-b5fe-45f4-b4dc-476d6349a3e6 req-c77b5ac8-abfc-4337-acc5-f8e773b03749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:24.106530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-666c7d0d-b5fe-45f4-b4dc-476d6349a3e6 req-c77b5ac8-abfc-4337-acc5-f8e773b03749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:24.150686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-666c7d0d-b5fe-45f4-b4dc-476d6349a3e6 req-c77b5ac8-abfc-4337-acc5-f8e773b03749 service nova] Creating event network-vif-deleted:b4b62f01-713b-4f4a-bc3c-974292d51518 for instance 527416f8-471f-4abb-8ee7-b57f66e146fc on n-h2-828148-1 Mar 29 02:25:24.151235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:24.162365 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-666c7d0d-b5fe-45f4-b4dc-476d6349a3e6 req-c77b5ac8-abfc-4337-acc5-f8e773b03749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090898 Mar 29 02:25:24.166842 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1912/3611] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:24.171752 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13a7e9d0-e95e-4d30-b9e9-0d9e892f9fb9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1455 microversion: 2.1 time: 0.360913 Mar 29 02:25:24.172571 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1700/3612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:23 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1455 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:24.184132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:24.184906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:24.190724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:24.191907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:24.202632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:24.203082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:24.203867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:24.204301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:24.224068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:24.224068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:24.224068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:24.225088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.030484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:25.053453 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2eb4c42e-a5a8-470a-bdeb-ac780bd57bbc tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.874645 Mar 29 02:25:25.067510 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1701/3613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:24 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:25.084653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b10b017a-98d3-4a06-87e7-ecd837026e04 req-6e315913-553f-4298-94c7-57d1ccd84708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958e393e-ef02-4763-8788-14060103f7e3", "name": "network-vif-plugged", "status": "completed", "tag": "38eaa6ce-64fe-4b61-afe1-439e89df8a2b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:25.098939 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:25.098939 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:25.121756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b10b017a-98d3-4a06-87e7-ecd837026e04 req-6e315913-553f-4298-94c7-57d1ccd84708 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.122733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b10b017a-98d3-4a06-87e7-ecd837026e04 req-6e315913-553f-4298-94c7-57d1ccd84708 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.131203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:25.143535 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7527cd9e-4f69-474d-a0f4-bece5850510e tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1471 microversion: 2.1 time: 0.973352 Mar 29 02:25:25.148691 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1913/3614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:24 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1471 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:25.175533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:25.178242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:25.187306 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b10b017a-98d3-4a06-87e7-ecd837026e04 req-6e315913-553f-4298-94c7-57d1ccd84708 service nova] Creating event network-vif-plugged:38eaa6ce-64fe-4b61-afe1-439e89df8a2b for instance 958e393e-ef02-4763-8788-14060103f7e3 on n-h1-828148-1 Mar 29 02:25:25.196509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.197306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.200468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.200760 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b10b017a-98d3-4a06-87e7-ecd837026e04 req-6e315913-553f-4298-94c7-57d1ccd84708 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131508 Mar 29 02:25:25.201541 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1702/3615] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:25.201985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.221940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:25.223752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:25.240493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.240971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.245500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.247988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.344814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:25.345310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:25.345763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lazy-loading 'fault' on Instance uuid 527416f8-471f-4abb-8ee7-b57f66e146fc {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:25.429519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:25.454508 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-470aa97b-c081-41fd-9d3e-3e01dd72eb3a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 200 len: 1299 microversion: 2.1 time: 0.249255 Mar 29 02:25:25.457834 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1703/3616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:25 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 1299 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:25.587761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:25.596367 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ddeeb87-528b-4570-a63d-4eb42cd9767f tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.446323 Mar 29 02:25:25.597055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1914/3617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:25 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:26.071788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:26.072509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:26.084603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.093973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.093973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.093973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.162204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:26.164073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:26.176236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.179796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.179796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.179796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.265180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.266048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.266617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lazy-loading 'fault' on Instance uuid f861d750-c866-4f2d-ac1b-26bd1b476195 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:26.432299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151d3793a3ad446cbd0716780ed91ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c1d2a34e994f17bc4dd4f66439fbf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:26.445074 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de0cf68e-86b2-4db0-b112-f88ccfa34a79 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 200 len: 1306 microversion: 2.1 time: 0.287151 Mar 29 02:25:26.450834 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1915/3618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:26 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 1306 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:26.462651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a5045ba8-9225-4861-bcbd-0116a3c89134 req-f8e29c65-2af1-468e-a167-54292421fad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f861d750-c866-4f2d-ac1b-26bd1b476195", "name": "network-vif-deleted", "tag": "e3429ef1-8643-4684-b0a0-a2aaebc37d54"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:26.464660 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:26.464660 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:26.475959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a5045ba8-9225-4861-bcbd-0116a3c89134 req-f8e29c65-2af1-468e-a167-54292421fad0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.480183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a5045ba8-9225-4861-bcbd-0116a3c89134 req-f8e29c65-2af1-468e-a167-54292421fad0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.499371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a5045ba8-9225-4861-bcbd-0116a3c89134 req-f8e29c65-2af1-468e-a167-54292421fad0 service nova] Creating event network-vif-deleted:e3429ef1-8643-4684-b0a0-a2aaebc37d54 for instance f861d750-c866-4f2d-ac1b-26bd1b476195 on n-h2-828148-1 Mar 29 02:25:26.510525 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a5045ba8-9225-4861-bcbd-0116a3c89134 req-f8e29c65-2af1-468e-a167-54292421fad0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053454 Mar 29 02:25:26.511159 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1916/3619] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:26.521681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:26.522385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:26.536287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.536739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.537558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.537993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.594446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:26.606562 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-baa64481-7df6-4228-80cb-e0087f453d3d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.539772 Mar 29 02:25:26.612519 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1704/3620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:26 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:26.622732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:26.623687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:26.643087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.646101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.649310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.650093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.653118 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. Mar 29 02:25:26.654064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:26.655472 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26413a7a-658e-43ab-a15f-cb1a384ae5b3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 404 len: 111 microversion: 2.1 time: 0.137629 Mar 29 02:25:26.657518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1917/3621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:26 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:26.665835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:26.666672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:26.675447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.676239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.677301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:26.677971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:26.802668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:27.193111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f280991c-6348-46fa-894c-743e10c721c6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 204 len: 0 microversion: 2.1 time: 0.529616 Mar 29 02:25:27.198012 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1918/3622] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:26 2022] DELETE /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:25:27.204126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:27.206091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:27.215633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:27.216353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:27.217549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:27.218445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:27.236849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:27.251371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-538eddb0-7357-407d-a14a-b874133ac404 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.636810 Mar 29 02:25:27.252064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1705/3623] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:26 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:27.467398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:27.467918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] [instance: f861d750-c866-4f2d-ac1b-26bd1b476195] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:27.483569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:27.488965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:27.488965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:27.488965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:27.565516 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] HTTP exception thrown: Instance f861d750-c866-4f2d-ac1b-26bd1b476195 could not be found. Mar 29 02:25:27.566474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] Returning 404 to user: Instance f861d750-c866-4f2d-ac1b-26bd1b476195 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:27.567580 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3bca18e9-4a4b-49fd-af74-a2de02501e31 tempest-ServersOnMultiNodesTest-1690965005 tempest-ServersOnMultiNodesTest-1690965005-project] 10.222.0.36 "GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195" status: 404 len: 111 microversion: 2.1 time: 0.104108 Mar 29 02:25:27.570056 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1706/3624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:27 2022] GET /compute/v2.1/servers/f861d750-c866-4f2d-ac1b-26bd1b476195 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:27.579478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1565374184", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff676c7f-9045-4fad-b565-a27f45650edb"}], "security_groups": [{"name": "tempest-securitygroup--257608748"}], "key_name": "tempest-keypair-1859013923", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:27.915404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] validate_networks() for [('ff676c7f-9045-4fad-b565-a27f45650edb', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:27.970374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:27.983716 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c20fcbe-c6b6-4333-b369-0de7b9e72724 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1496 microversion: 2.1 time: 0.784295 Mar 29 02:25:27.986247 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1919/3625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:27 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1496 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:27.994242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:27.998729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:28.005591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.007309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.008272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.009081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.339181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:28.347955 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58772e61-6544-446d-8112-5deaeb3ff9f9 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.360247 Mar 29 02:25:28.348518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1920/3626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:27 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:28.353966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-16b922b3-eda1-496b-aac6-439fb9aa4817 req-dcfd5874-ca7c-47cd-852f-6057932fe516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53aa3ec-19b0-4896-aff7-5556f450a219", "name": "network-vif-plugged", "status": "completed", "tag": "cf9e0a36-681e-4527-855f-e12476f81247"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:28.360596 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:28.360596 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:28.371968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-16b922b3-eda1-496b-aac6-439fb9aa4817 req-dcfd5874-ca7c-47cd-852f-6057932fe516 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.372654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-16b922b3-eda1-496b-aac6-439fb9aa4817 req-dcfd5874-ca7c-47cd-852f-6057932fe516 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.390993 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-16b922b3-eda1-496b-aac6-439fb9aa4817 req-dcfd5874-ca7c-47cd-852f-6057932fe516 service nova] Creating event network-vif-plugged:cf9e0a36-681e-4527-855f-e12476f81247 for instance a53aa3ec-19b0-4896-aff7-5556f450a219 on n-h1-828148-1 Mar 29 02:25:28.395759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-16b922b3-eda1-496b-aac6-439fb9aa4817 req-dcfd5874-ca7c-47cd-852f-6057932fe516 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045102 Mar 29 02:25:28.396748 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1921/3627] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:28.416237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:28.418123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:28.433708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.435350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.437047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.439064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.839687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:28.841364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:28.842688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:28.846868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:28.846868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:28.869385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.870519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.871636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:28.872276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:28.909566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:28.915346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Getting quotas for user 94452c4cc43a4e6d89e712588d9c7411 and project bcabdc0f3f76428b941ea1620f328159. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:28.930465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:28.933492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:28.966052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:28.974950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c461af9-7874-42c2-8aae-82a1ad9043df tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.576980 Mar 29 02:25:28.975875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1922/3628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:28 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:29.161941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: .version_select at 0x7f87240cfee0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1012740368", "policies": ["affinity"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:29.190494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:29.191346 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ffa715b-0199-4296-82b3-d532319dd464 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.619666 Mar 29 02:25:29.201948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:29.202152 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1707/3629] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:25:29.207508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:29.212315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:29.218579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:29.219719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:29.220724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:29.221340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:29.367993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:29.375785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:29.393625 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d64f3ce0-5344-412b-b529-03b8e667b0bc tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.415640 Mar 29 02:25:29.394863 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1923/3630] 10.222.0.36 () {60 vars in 1173 bytes} [Tue Mar 29 02:25:28 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:29.403139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ff9c6d8-966e-42ea-a3f8-0c672c0e42c1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:29.405011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ff9c6d8-966e-42ea-a3f8-0c672c0e42c1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:29.603951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ff9c6d8-966e-42ea-a3f8-0c672c0e42c1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:29.634963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ff9c6d8-966e-42ea-a3f8-0c672c0e42c1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1242 microversion: 2.1 time: 0.238733 Mar 29 02:25:29.644133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1924/3631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:29 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:29.652662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:29.653294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:29.678438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:29.679169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:29.680537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:29.681249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:29.924171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:29.933014 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1382cb90-7b74-44d3-ab31-27ba3ec5dad0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1318 microversion: 2.1 time: 0.287436 Mar 29 02:25:29.933595 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1925/3632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:29 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:29.938074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: .version_select at 0x7f8724c431f0>, body: {"server_group": {"name": "tempest-server-group-1842837644", "policies": ["affinity"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:29.958092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:29.964692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:30.035066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:30.043648 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-678ea141-82a1-44ba-b5ba-46f502f796b2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1496 microversion: 2.1 time: 0.840458 Mar 29 02:25:30.044179 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1708/3633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:29 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1496 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:30.049189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-928303062", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "97db737e-f5ab-4686-8e26-8c48c0bc524e"}, {"port": "d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a", "tag": "port-1"}, {"port": "15ceead5-ba63-4d0c-aa69-fe1a873c1813", "tag": "port-2"}, {"uuid": "4d3c42a1-ac51-4d54-af2f-24eea2e5d594", "tag": "net-1"}, {"uuid": "4d3c42a1-ac51-4d54-af2f-24eea2e5d594"}, {"uuid": "90683a4d-22a7-488f-9587-da17e866d8b0", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "90683a4d-22a7-488f-9587-da17e866d8b0", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a3108de8-e636-4fca-9147-6a8e573cd315", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b36edc35-c27f-4db7-b722-643fb5037507", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2c4b13b5-d237-4b15-8215-f63c77ef4c78", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--231492858"}], "key_name": "tempest-keypair-1496303868", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:30.083817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:30.090164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:30.105274 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dad452a1-7d20-4fb6-b675-e89d04f92ad0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.170599 Mar 29 02:25:30.106261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1926/3634] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:25:29 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:30.112492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:30.113403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:30.123827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:30.124481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:30.125632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:30.126275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:30.543122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:30.551430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] validate_networks() for [('97db737e-f5ab-4686-8e26-8c48c0bc524e', None, None, None), (None, None, 'd7a5dc56-ced5-4090-b4c9-8ef771e1bd8a', None), (None, None, '15ceead5-ba63-4d0c-aa69-fe1a873c1813', None), ('4d3c42a1-ac51-4d54-af2f-24eea2e5d594', None, None, None), ('4d3c42a1-ac51-4d54-af2f-24eea2e5d594', None, None, None), ('90683a4d-22a7-488f-9587-da17e866d8b0', '10.2.2.100', None, None), ('90683a4d-22a7-488f-9587-da17e866d8b0', '10.2.2.200', None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:30.552782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa406ed4-b71b-4c50-9918-cec4abd140f8 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.445333 Mar 29 02:25:30.563081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1927/3635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:30 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:30.567615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: .version_select at 0x7f8724172940>, body: {"server_group": {"name": "tempest-server-group-1842837644", "policies": ["affinity"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:30.593873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:30.606933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:30.821426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:30.827928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:30.842057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1764074c-9272-48db-a98b-c3ea5be0a06d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.277934 Mar 29 02:25:30.842665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1928/3636] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:25:30 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:30.852043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-917ab7af-a6cf-4a13-8768-1fcaf19fc1ba req-a577f9f4-631c-4936-a3fe-f03a38524679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b9e0eb-6c2b-4676-b34f-699432c7c80f", "name": "network-vif-plugged", "status": "completed", "tag": "52ee60b2-439f-4e52-ac2c-02ea3aa48258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:30.853935 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:30.853935 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:30.862960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-917ab7af-a6cf-4a13-8768-1fcaf19fc1ba req-a577f9f4-631c-4936-a3fe-f03a38524679 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:30.863452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-917ab7af-a6cf-4a13-8768-1fcaf19fc1ba req-a577f9f4-631c-4936-a3fe-f03a38524679 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:30.884532 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-917ab7af-a6cf-4a13-8768-1fcaf19fc1ba req-a577f9f4-631c-4936-a3fe-f03a38524679 service nova] Creating event network-vif-plugged:52ee60b2-439f-4e52-ac2c-02ea3aa48258 for instance 25b9e0eb-6c2b-4676-b34f-699432c7c80f on n-h2-828148-1 Mar 29 02:25:30.892769 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-917ab7af-a6cf-4a13-8768-1fcaf19fc1ba req-a577f9f4-631c-4936-a3fe-f03a38524679 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048124 Mar 29 02:25:30.893917 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1929/3637] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:30.899837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:30.900660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:30.941261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:30.942848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:30.944063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:30.945829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:31.284535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:31.294063 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38ff484c-7dad-416f-a021-2a4c0f28cf98 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1238 microversion: 2.1 time: 0.398651 Mar 29 02:25:31.304086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1930/3638] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:30 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1238 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:31.308880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1f0e670b-0288-446d-ac1e-d3d9914a276d req-1b0a8dee-9211-462a-9545-56297a0fa43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7beb6d84-1989-4aff-86dd-0025ee52ed07", "name": "network-vif-deleted", "tag": "e8716b4a-798c-4fb9-8932-91a303c777f3"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:31.310392 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:31.310392 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:31.324132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f0e670b-0288-446d-ac1e-d3d9914a276d req-1b0a8dee-9211-462a-9545-56297a0fa43f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:31.324575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1f0e670b-0288-446d-ac1e-d3d9914a276d req-1b0a8dee-9211-462a-9545-56297a0fa43f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:31.342441 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1f0e670b-0288-446d-ac1e-d3d9914a276d req-1b0a8dee-9211-462a-9545-56297a0fa43f service nova] Creating event network-vif-deleted:e8716b4a-798c-4fb9-8932-91a303c777f3 for instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 on n-h1-828148-1 Mar 29 02:25:31.347420 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1f0e670b-0288-446d-ac1e-d3d9914a276d req-1b0a8dee-9211-462a-9545-56297a0fa43f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041987 Mar 29 02:25:31.348017 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1931/3639] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:31.352882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e939d6a-b99a-4019-91d6-2e9eaa17b98d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:31.502995 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e939d6a-b99a-4019-91d6-2e9eaa17b98d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/ade7b8c7-f408-422a-a0cd-086900c4255f" status: 204 len: 0 microversion: 2.1 time: 0.153432 Mar 29 02:25:31.509613 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1932/3640] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:31 2022] DELETE /compute/v2.1/os-server-groups/ade7b8c7-f408-422a-a0cd-086900c4255f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:31.513345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:31.514091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:31.522776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:31.523254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:31.524026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:31.524455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.026977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:32.042226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-888f7deb-d06e-4946-b3ee-6bb4711ac130 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 200 len: 1507 microversion: 2.1 time: 0.534593 Mar 29 02:25:32.043427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1933/3641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:31 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:32.048752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:32.049429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:32.057213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.057899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.058896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.059537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.139694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.140628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.141259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lazy-loading 'fault' on Instance uuid 7beb6d84-1989-4aff-86dd-0025ee52ed07 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:32.284027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:32.291738 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1c3ff799-3659-4508-85e2-c47fca207d6f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 200 len: 1299 microversion: 2.1 time: 0.246989 Mar 29 02:25:32.292294 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1934/3642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:32 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:32.296640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe62a4c4-2ba6-4502-9d5c-238a70f51385 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:32.308528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe62a4c4-2ba6-4502-9d5c-238a70f51385 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.015005 Mar 29 02:25:32.309395 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1935/3643] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:25:32 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:32.315368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:32.316186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:32.325742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.326581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.327511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.328095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.745222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:32.754457 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db6fe406-8e4f-4e37-be2b-729bc83c1220 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1315 microversion: 2.1 time: 0.443770 Mar 29 02:25:32.755045 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1936/3644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:32 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:32.760677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:32.761542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:32.773813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.774362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:32.775260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:32.775748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:33.127907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:33.137054 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c505b79-ee62-42c2-b63b-48ff2e62ee91 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3" status: 200 len: 1506 microversion: 2.1 time: 0.380809 Mar 29 02:25:33.137933 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1937/3645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:32 2022] GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3 => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:33.142699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:33.143483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:33.154689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:33.155367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:33.156142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:33.156565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:33.517443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:33.528911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cedcfbbd-7fb3-4017-a85b-a134ccea34a4 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.389575 Mar 29 02:25:33.529882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1938/3646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:33 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:33.535128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-28236661-121e-4975-8258-59aac338b43b tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:33.671197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-28236661-121e-4975-8258-59aac338b43b tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/7e992cda-5141-4a1d-b485-24cda5961ba2" status: 204 len: 0 microversion: 2.1 time: 0.140253 Mar 29 02:25:33.674771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1939/3647] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:33 2022] DELETE /compute/v2.1/os-server-groups/7e992cda-5141-4a1d-b485-24cda5961ba2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:33.676486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:33.677027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:33.685656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:33.686343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:33.687277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:33.687864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:33.768395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:34.096152 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7817fa7e-f2bb-4197-8908-0a9b1a597dfa tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "DELETE /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3" status: 204 len: 0 microversion: 2.1 time: 0.423076 Mar 29 02:25:34.096736 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1940/3648] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:33 2022] DELETE /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:34.102944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:34.103690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:34.111167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.111614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.112374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.113090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.163782 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. Mar 29 02:25:34.164562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:34.165424 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-319b007b-f246-4038-ab12-ea07ab88d0d8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 404 len: 111 microversion: 2.1 time: 0.067239 Mar 29 02:25:34.165976 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1941/3649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:34 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:34.170356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-191a83a6-4b96-48f9-b79b-200a4a4e28ab tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:34.184366 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-191a83a6-4b96-48f9-b79b-200a4a4e28ab tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.017348 Mar 29 02:25:34.187392 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1942/3650] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:25:34 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:34.190378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:34.192047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:34.203228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.203839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.204623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.205096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.635414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:34.646573 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-131687c2-fe54-47b3-92e4-afd3e1c11027 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1504 microversion: 2.1 time: 0.459350 Mar 29 02:25:34.648776 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1943/3651] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:34 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1504 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:34.669902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:34.670630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:34.702687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.703457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.705205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:34.705972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:34.794146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:35.195254 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62d02bc5-d7c8-4274-88cb-764ae8471470 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 204 len: 0 microversion: 2.1 time: 0.544856 Mar 29 02:25:35.196351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1944/3652] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:34 2022] DELETE /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:35.201861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: .version_select at 0x7f8724172310>, body: {"server_group": {"name": "tempest-server-group-505305404", "policies": ["affinity"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:35.225183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:35.233500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:35.356464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:35.362335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:35.375563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42322959-34e6-4fc7-b704-9bfe32cfa104 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.177705 Mar 29 02:25:35.376339 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1945/3653] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:25:35 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:35.381792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1073767720", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:35.464565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:36.260203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:36.260798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:36.261128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:36.261567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:36.261976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:36.270830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.271267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.272186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.272643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.289771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:36.294929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:36.307068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:36.309499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:36.436522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c562b08a-04a2-4aed-8e22-ccd5ff2bad63 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058851 Mar 29 02:25:36.437444 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1946/3654] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:25:36.443018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:36.443018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:36.452293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.453021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.454017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.454633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.755542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:36.766194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e7080e2-5c5c-46bd-885d-71f09777b4f7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.326241 Mar 29 02:25:36.766194 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1947/3655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:36 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:36.770379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:36.771141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:36.779692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.780309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.781426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.781960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:36.974475 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbdf29b6-692f-417c-bea0-9efc77b8988d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "DELETE /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.207853 Mar 29 02:25:36.975572 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1948/3656] 10.222.0.36 () {58 vars in 1295 bytes} [Tue Mar 29 02:25:36 2022] DELETE /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f/os-server-password => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:36.982951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-264deda5-3047-4238-a59e-bf749acc9801 req-13b1a485-9f1a-4965-9271-2e1ed9e7ef7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc57426-c0af-4968-ae4f-8c6ceb296f3c", "tag": "f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:36.984606 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:36.984606 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:36.987105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:36.987610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:36.988159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:36.988573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:36.989065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:36.998911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-264deda5-3047-4238-a59e-bf749acc9801 req-13b1a485-9f1a-4965-9271-2e1ed9e7ef7f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:36.999641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-264deda5-3047-4238-a59e-bf749acc9801 req-13b1a485-9f1a-4965-9271-2e1ed9e7ef7f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:37.018715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:37.019168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:37.022205 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-264deda5-3047-4238-a59e-bf749acc9801 req-13b1a485-9f1a-4965-9271-2e1ed9e7ef7f service nova] Creating event network-changed:f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41 for instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c on n-h2-828148-1 Mar 29 02:25:37.023423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:37.023925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:37.030906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-264deda5-3047-4238-a59e-bf749acc9801 req-13b1a485-9f1a-4965-9271-2e1ed9e7ef7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051722 Mar 29 02:25:37.031839 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1949/3657] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:37.053280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:37.054679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:37.063646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:37.064102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:37.064926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:37.065372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:37.072518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for project bda67cbdacc74c0f8dbde35c57289991. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:37.085665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Getting quotas for user 04a5b48824604553ac2fd7b08fc81f52 and project bda67cbdacc74c0f8dbde35c57289991. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:37.440809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:37.443838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a3108de8-e636-4fca-9147-6a8e573cd315',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b36edc35-c27f-4db7-b722-643fb5037507',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c4b13b5-d237-4b15-8215-f63c77ef4c78',volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:37.871190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:37.888537 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bec43d65-0798-4a42-b76b-cf74f4995bb0 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3" status: 200 len: 1512 microversion: 2.1 time: 0.855395 Mar 29 02:25:37.889790 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1950/3658] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:37 2022] GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3 => generated 1512 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:37.905524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89e5ae71-a9fd-4749-a673-77741c983620 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.030317 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89e5ae71-a9fd-4749-a673-77741c983620 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5" status: 204 len: 0 microversion: 2.1 time: 0.139215 Mar 29 02:25:38.035448 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1951/3659] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:37 2022] DELETE /compute/v2.1/os-server-groups/875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:38.042582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.043407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:38.053554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.054863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.055928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.057640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.199639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:38.216508 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-701bf330-0dcd-48d1-838c-b27460afcad1 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1205 microversion: 2.1 time: 0.174024 Mar 29 02:25:38.216508 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1952/3660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:38 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1205 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:38.219706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.220425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:38.236070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.236070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.236070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.236532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.311690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-baa2882d-e810-4f2d-afbe-664fdcb5bd54 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.097473 Mar 29 02:25:38.312607 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1953/3661] 10.222.0.36 () {58 vars in 1292 bytes} [Tue Mar 29 02:25:38 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f/os-server-password => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:25:38.316985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.317712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:38.326476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.326986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.327820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.328263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.600437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:38.610089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-92d2ccf9-bb2f-4a2e-8f08-bb553530d7d5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.296115 Mar 29 02:25:38.620994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1954/3662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:38 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:38.625921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3f294a7-6ccc-4f56-ac4a-a41da1a609a0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.642331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3f294a7-6ccc-4f56-ac4a-a41da1a609a0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018922 Mar 29 02:25:38.645082 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1955/3663] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:25:38 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:38.651068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:38.651575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:38.660549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.661162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.665421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:38.665421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:38.731996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:25:38.876399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bfa03344-675a-4af6-bf2e-ef5e2dd21a59 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 8.830797 Mar 29 02:25:38.882413 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1709/3664] 10.222.0.36 () {62 vars in 1188 bytes} [Tue Mar 29 02:25:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 8837 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:25:38.887106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: .version_select at 0x7f872436dca0>, body: {"server_group": {"name": "tempest-server-group-459012571", "policies": ["anti-affinity"]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:38.905069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:38.912255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:39.006604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:39.014093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_groups'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:39.030578 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69686fb9-4b98-4636-a897-23f572de7d6d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.146980 Mar 29 02:25:39.031568 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1710/3665] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:25:38 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:39.038081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.039300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:39.099768 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dcc9a62-4b08-43f1-ba3e-f60f7148b5fd tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "DELETE /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 204 len: 0 microversion: 2.1 time: 0.453321 Mar 29 02:25:39.105858 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1956/3666] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:25:38 2022] DELETE /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:39.113264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.114380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:39.124492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.125288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.126344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.128075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.214145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:39.225009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:39.228368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:39.229974 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf75c41e-7b70-401e-96f9-c84ed5df6061 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1285 microversion: 2.42 time: 0.197150 Mar 29 02:25:39.231326 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1711/3667] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:39.250135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-02b06cfe-4db2-4ba2-b6c1-1acac7f575dd req-a87a7d4a-f0e8-42a0-95c8-7b6622a496ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958e393e-ef02-4763-8788-14060103f7e3", "name": "network-vif-deleted", "tag": "38eaa6ce-64fe-4b61-afe1-439e89df8a2b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:39.252335 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:39.252335 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:39.264741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-02b06cfe-4db2-4ba2-b6c1-1acac7f575dd req-a87a7d4a-f0e8-42a0-95c8-7b6622a496ab service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.265737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-02b06cfe-4db2-4ba2-b6c1-1acac7f575dd req-a87a7d4a-f0e8-42a0-95c8-7b6622a496ab service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.267881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1857cb7e24f4940a016db6e88acba6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a4476dff96447eb2fcb18a06345131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:39.284130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82c98e5c-c9de-4846-b567-eeeb3bc6857a tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3" status: 200 len: 1470 microversion: 2.1 time: 0.181897 Mar 29 02:25:39.285064 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1957/3668] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:39.292369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ca1bda6-dfca-401f-8b9d-0ff611c7c872 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.298926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-02b06cfe-4db2-4ba2-b6c1-1acac7f575dd req-a87a7d4a-f0e8-42a0-95c8-7b6622a496ab service nova] Creating event network-vif-deleted:38eaa6ce-64fe-4b61-afe1-439e89df8a2b for instance 958e393e-ef02-4763-8788-14060103f7e3 on n-h1-828148-1 Mar 29 02:25:39.310230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-02b06cfe-4db2-4ba2-b6c1-1acac7f575dd req-a87a7d4a-f0e8-42a0-95c8-7b6622a496ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076487 Mar 29 02:25:39.311414 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1712/3669] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:39.320585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.321581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:39.331726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.332170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.332966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.333569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.436726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ca1bda6-dfca-401f-8b9d-0ff611c7c872 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/594ac15f-41cb-463d-bfc9-c8c915d6adc9" status: 204 len: 0 microversion: 2.1 time: 0.150067 Mar 29 02:25:39.438162 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1958/3670] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:25:39 2022] DELETE /compute/v2.1/os-server-groups/594ac15f-41cb-463d-bfc9-c8c915d6adc9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:25:39.446169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.448156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:39.470735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.480493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.483735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:39.497514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:39.924303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:39.935117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59b93e73-e629-4e8b-bb27-5a1156e387ba tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1510 microversion: 2.1 time: 0.621955 Mar 29 02:25:39.945330 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1713/3671] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1510 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:39.949632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4eefcd6-167c-4fc9-88a2-dbbf0780938e tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.962659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4eefcd6-167c-4fc9-88a2-dbbf0780938e tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.024817 Mar 29 02:25:39.964483 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1714/3672] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:39.977083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:39.977083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:40.009697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:40.013779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:40.014897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:40.015626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:40.017215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:40.031592 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f79a8da-92c2-4db7-b01d-0a21ef8b962d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1267 microversion: 2.1 time: 0.591746 Mar 29 02:25:40.033197 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1959/3673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1267 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:40.140061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1289334088", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "6eec8494-14ec-4365-b645-69702a29ac9c"}]}, "os:scheduler_hints": {"group": "e7f9ae14-0ca2-45c6-9b2a-390508e4ddae"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:40.221938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] validate_networks() for [('6eec8494-14ec-4365-b645-69702a29ac9c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:40.581117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:40.596782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5aae4d7f-b0a8-4618-9bfd-b8abd14e4ba2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.627395 Mar 29 02:25:40.600032 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1715/3674] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:39 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:40.623806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:40.636264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:40.673172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:40.674147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:40.675213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:40.681534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.018176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:41.038716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:41.040256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:41.041489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-818d6b6a-c3f4-49a3-90b8-6e49ecf7b25d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1527 microversion: 2.42 time: 0.442681 Mar 29 02:25:41.042432 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1716/3675] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:40 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1527 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:41.046813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:41.057555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: 958e393e-ef02-4763-8788-14060103f7e3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:41.065165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.065930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.066953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.067686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.126369 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] HTTP exception thrown: Instance 958e393e-ef02-4763-8788-14060103f7e3 could not be found. Mar 29 02:25:41.127117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Returning 404 to user: Instance 958e393e-ef02-4763-8788-14060103f7e3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:41.128243 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4af88b4-de14-421e-b02a-6975b65bdf2d tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3" status: 404 len: 111 microversion: 2.1 time: 0.084810 Mar 29 02:25:41.129219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1717/3676] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:41 2022] GET /compute/v2.1/servers/958e393e-ef02-4763-8788-14060103f7e3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:41.134374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:41.135215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:41.143839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.144516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.146121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.147387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.503035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:41.512535 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee2a18db-fd2e-45bb-ac0d-883e8fbeb598 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1510 microversion: 2.1 time: 0.382142 Mar 29 02:25:41.513291 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1718/3677] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:41 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:41.518911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:41.519860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:41.529724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.530919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:41.531896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:41.533012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.046905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:42.060639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec826c02-00ee-4ed5-ac33-855b4ff5e06a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 0.546124 Mar 29 02:25:42.070407 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1719/3678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:41 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:42.080635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:42.081665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] [instance: a53aa3ec-19b0-4896-aff7-5556f450a219] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:42.092902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.093983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:42.094492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:42.094929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:42.095344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:42.095757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:42.096420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.098890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.099501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.133335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.133777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.146076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.146838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.190905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:42.196638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:42.200610 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] HTTP exception thrown: Instance a53aa3ec-19b0-4896-aff7-5556f450a219 could not be found. Mar 29 02:25:42.201310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] Returning 404 to user: Instance a53aa3ec-19b0-4896-aff7-5556f450a219 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:42.202383 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24c214d2-3fa4-4928-9f06-51ee2d217cc3 tempest-MultipleCreateTestJSON-8343678 tempest-MultipleCreateTestJSON-8343678-project] 10.222.0.36 "GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219" status: 404 len: 111 microversion: 2.1 time: 0.130543 Mar 29 02:25:42.206926 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1720/3679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:42 2022] GET /compute/v2.1/servers/a53aa3ec-19b0-4896-aff7-5556f450a219 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:42.211278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0355ce55-8d7d-4b7a-89b8-440df6518c94 req-46740acd-8915-4998-95b4-d6343cad7387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a53aa3ec-19b0-4896-aff7-5556f450a219", "name": "network-vif-deleted", "tag": "cf9e0a36-681e-4527-855f-e12476f81247"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:42.213543 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:42.213543 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:42.224286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0355ce55-8d7d-4b7a-89b8-440df6518c94 req-46740acd-8915-4998-95b4-d6343cad7387 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.225054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0355ce55-8d7d-4b7a-89b8-440df6518c94 req-46740acd-8915-4998-95b4-d6343cad7387 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.228986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:42.231348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:42.248201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0355ce55-8d7d-4b7a-89b8-440df6518c94 req-46740acd-8915-4998-95b4-d6343cad7387 service nova] Creating event network-vif-deleted:cf9e0a36-681e-4527-855f-e12476f81247 for instance a53aa3ec-19b0-4896-aff7-5556f450a219 on n-h1-828148-1 Mar 29 02:25:42.253614 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0355ce55-8d7d-4b7a-89b8-440df6518c94 req-46740acd-8915-4998-95b4-d6343cad7387 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048339 Mar 29 02:25:42.254936 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1721/3680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:42.260314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:42.263012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:42.271822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.273197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.274152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.274755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.388367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:42.404180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:42.573591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:42.587531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Getting quotas for user cb84cd38935d4017b472bb153e84dad0 and project 7301bbbfd37a43ba99e29d9c6ea2701c. Resources: {'server_group_members'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:42.693089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e6cc17f2-6f89-4763-aa82-ce0d15be2fa8 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.550811 Mar 29 02:25:42.697864 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1960/3681] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:25:42.717714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:42.722870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:42.741835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:42.765365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18b7498e-8c8e-4803-9c99-8866cd5b4191 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.508978 Mar 29 02:25:42.779912 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1722/3682] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:42 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:42.780033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.780033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.780033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.780033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.782769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2b511991-cc72-49e4-acff-4c60f250c07b req-94f476df-490b-48c3-bb43-e519d7b471c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc57426-c0af-4968-ae4f-8c6ceb296f3c", "name": "network-vif-plugged", "status": "completed", "tag": "f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:42.784640 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:42.784640 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:25:42.810058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b511991-cc72-49e4-acff-4c60f250c07b req-94f476df-490b-48c3-bb43-e519d7b471c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.810751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b511991-cc72-49e4-acff-4c60f250c07b req-94f476df-490b-48c3-bb43-e519d7b471c8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.833693 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2b511991-cc72-49e4-acff-4c60f250c07b req-94f476df-490b-48c3-bb43-e519d7b471c8 service nova] Creating event network-vif-plugged:f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41 for instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c on n-h2-828148-1 Mar 29 02:25:42.856131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2b511991-cc72-49e4-acff-4c60f250c07b req-94f476df-490b-48c3-bb43-e519d7b471c8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081375 Mar 29 02:25:42.858206 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1723/3683] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:42.888891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:42.892885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:42.910892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.915070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:42.916093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:42.917026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:43.274097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:43.293895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:43.295536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:43.296675 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5c989cdc-eeef-4870-83c0-1dba0ce0efdf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1593 microversion: 2.42 time: 0.597508 Mar 29 02:25:43.297467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1961/3684] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:42 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1593 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:43.311727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c311fc3-c2f8-4013-8dca-3455330f8904 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:43.312345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c311fc3-c2f8-4013-8dca-3455330f8904 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:43.535893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c311fc3-c2f8-4013-8dca-3455330f8904 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:43.550485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c311fc3-c2f8-4013-8dca-3455330f8904 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1213 microversion: 2.1 time: 0.251794 Mar 29 02:25:43.552700 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1962/3685] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:43 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1213 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:43.559718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:43.561322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:43.572518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:43.573607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:43.574984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:43.575911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:43.795572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:43.803231 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4de235dd-a764-41fb-8a02-e0f809fa1da1 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1510 microversion: 2.1 time: 0.942979 Mar 29 02:25:43.814216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1724/3686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:42 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1510 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:43.822151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:43.823362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:43.832314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:43.832765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:43.833586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:43.841663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.326105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:44.340644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30b95639-a89e-4e6e-be18-ce82bec348a3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1367 microversion: 2.1 time: 0.523148 Mar 29 02:25:44.344524 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1725/3687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:43 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:44.351741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:44.352662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:44.362765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.363580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.365046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.365873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.493272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:44.528457 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2f07954-a070-4b7b-b155-e2af62032592 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 0.971807 Mar 29 02:25:44.530792 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1963/3688] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:43 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:44.544916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-97819cb9-8998-4f1e-b907-a79d5c2ee4ca req-ce941b0e-81b5-4567-a88c-1fe5ae31428a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "305ce8f3-8864-420d-80ef-67c0816603aa", "tag": "371a5c4f-f3b2-4d69-8055-ec3f23e9140b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:44.548791 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:44.548791 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:44.578925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-97819cb9-8998-4f1e-b907-a79d5c2ee4ca req-ce941b0e-81b5-4567-a88c-1fe5ae31428a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.587731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-97819cb9-8998-4f1e-b907-a79d5c2ee4ca req-ce941b0e-81b5-4567-a88c-1fe5ae31428a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.651565 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-97819cb9-8998-4f1e-b907-a79d5c2ee4ca req-ce941b0e-81b5-4567-a88c-1fe5ae31428a service nova] Creating event network-changed:371a5c4f-f3b2-4d69-8055-ec3f23e9140b for instance 305ce8f3-8864-420d-80ef-67c0816603aa on n-h1-828148-1 Mar 29 02:25:44.666613 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-97819cb9-8998-4f1e-b907-a79d5c2ee4ca req-ce941b0e-81b5-4567-a88c-1fe5ae31428a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134220 Mar 29 02:25:44.669924 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1964/3689] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:44.692494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5753e7a1-58da-4164-82ae-cc721c544458 req-a74208e7-445c-47c6-8ea5-443a57107dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b9e0eb-6c2b-4676-b34f-699432c7c80f", "name": "network-vif-deleted", "tag": "52ee60b2-439f-4e52-ac2c-02ea3aa48258"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:44.697298 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:44.697298 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:44.701575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:44.715555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:44.720687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5753e7a1-58da-4164-82ae-cc721c544458 req-a74208e7-445c-47c6-8ea5-443a57107dbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.721408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5753e7a1-58da-4164-82ae-cc721c544458 req-a74208e7-445c-47c6-8ea5-443a57107dbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.729918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:44.731418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3b8ee97f-7a48-4739-9832-24820a366608 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1593 microversion: 2.42 time: 0.385436 Mar 29 02:25:44.732003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1726/3690] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:44 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1593 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:44.737244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:44.748693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:44.776408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5753e7a1-58da-4164-82ae-cc721c544458 req-a74208e7-445c-47c6-8ea5-443a57107dbe service nova] Creating event network-vif-deleted:52ee60b2-439f-4e52-ac2c-02ea3aa48258 for instance 25b9e0eb-6c2b-4676-b34f-699432c7c80f on n-h2-828148-1 Mar 29 02:25:44.780359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.780999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.781787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.782218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.787406 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5753e7a1-58da-4164-82ae-cc721c544458 req-a74208e7-445c-47c6-8ea5-443a57107dbe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115795 Mar 29 02:25:44.790612 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1965/3691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:44.822410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:44.823435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:44.838992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.845337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.847840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.848446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.989514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:44.990692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:44.992205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lazy-loading 'fault' on Instance uuid 25b9e0eb-6c2b-4676-b34f-699432c7c80f {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:25:45.247149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:45.269594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e99bc264-66d1-44c0-98cc-c2323860bc3d tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1217 microversion: 2.1 time: 0.535678 Mar 29 02:25:45.281527 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1727/3692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:44 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1217 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:45.411511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dab24cd07c6c445c8a195ebd308084c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a221c5adea4c60a79fa0aca9857980', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:45.444771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17070361-c4e2-404c-b5e3-59cf046e5732 tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 200 len: 1305 microversion: 2.1 time: 0.616534 Mar 29 02:25:45.444771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1966/3693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:44 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 1305 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:45.453920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:45.457313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:45.479530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:45.481738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1989759917", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "637edb7d-d7fa-4aef-a6be-ac743f15f6b6"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:45.484779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:45.489839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:45.489839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:45.614767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] validate_networks() for [('637edb7d-d7fa-4aef-a6be-ac743f15f6b6', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:25:45.957689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:45.970403 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d743c4ee-7671-4b60-b467-96e1e9688bfd tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1556 microversion: 2.1 time: 0.526495 Mar 29 02:25:45.970403 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1967/3694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:45 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1556 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:45.971454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:45.972320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:45.980647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:45.981439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:45.982457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:45.982893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:46.444163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:46.465014 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8361200b-fde8-4734-ad2c-a7521d50feb7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 0.491424 Mar 29 02:25:46.465014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1968/3695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:45 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:46.469955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:46.470695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:46.479508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:46.480047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:46.481032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:46.481467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.083871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:47.100244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:47.102214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:47.103927 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05e265fe-ad03-4e93-9417-f01df6846b8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1660 microversion: 2.42 time: 0.642100 Mar 29 02:25:47.115954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1969/3696] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:46 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1660 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:47.121242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:47.121992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:47.129727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.130499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.132029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.132704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.520991 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6e76444-a86e-47db-90a9-fd232d0e9f5e tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.403491 Mar 29 02:25:47.522290 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1970/3697] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:25:47 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-interface => generated 284 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:47.527526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:47.528476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:47.544506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.547376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.548250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.549348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.799003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:25:47.800136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:25:47.800795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:25:47.801553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:25:47.802132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:25:47.815847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.819440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.820126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.821421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.849535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Getting quotas for project 539a5cfe3d62486ab34c720b5e37e46a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:25:47.857306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Getting quotas for user acd1f27dbbdb4f94b83c49ae795f8285 and project 539a5cfe3d62486ab34c720b5e37e46a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:25:47.873746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:25:47.877396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:25:47.949964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:47.960224 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c95447e4-22cb-429a-88a6-0c7e6a0ddcb9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1271 microversion: 2.1 time: 0.436537 Mar 29 02:25:47.963471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1971/3698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:47 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1271 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:47.969109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:47.973402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] [instance: 25b9e0eb-6c2b-4676-b34f-699432c7c80f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:47.988667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.989401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:47.990410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:47.991885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.033980 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b84553b6-332a-4a6c-8594-c3566d365d8c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.751149 Mar 29 02:25:48.037145 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1728/3699] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:25:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:25:48.053098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:48.054646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:48.069573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.070261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.071221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.071814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.114915 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] HTTP exception thrown: Instance 25b9e0eb-6c2b-4676-b34f-699432c7c80f could not be found. Mar 29 02:25:48.116809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] Returning 404 to user: Instance 25b9e0eb-6c2b-4676-b34f-699432c7c80f could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:25:48.120197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-40d1ac15-1bf9-4781-a67c-19b146415c9d tempest-ServerPasswordTestJSON-739456256 tempest-ServerPasswordTestJSON-739456256-project] 10.222.0.36 "GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f" status: 404 len: 111 microversion: 2.1 time: 0.154812 Mar 29 02:25:48.124014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1972/3700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:47 2022] GET /compute/v2.1/servers/25b9e0eb-6c2b-4676-b34f-699432c7c80f => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:25:48.134181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcaa585d-a344-493f-aeb2-0dfac3679441 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:48.138678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dcaa585d-a344-493f-aeb2-0dfac3679441 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:48.567263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcaa585d-a344-493f-aeb2-0dfac3679441 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:48.580187 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcaa585d-a344-493f-aeb2-0dfac3679441 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1218 microversion: 2.1 time: 0.453743 Mar 29 02:25:48.591171 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1973/3701] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:48 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1218 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:48.591171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:48.592017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:48.603906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.604935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.606601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.607221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.820762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:48.829770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c75748c4-d5d6-4c45-acdf-0992705613e5 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 0.789884 Mar 29 02:25:48.830430 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1729/3702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:48 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:48.982823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:48.983449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:48.991467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.991910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:48.992666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:48.993201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:49.439886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:49.450444 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9eeb467f-e05a-48e7-bf0a-061a92fc55b1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.471398 Mar 29 02:25:49.461094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1730/3703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:48 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:49.599651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:49.600569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:49.620977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:49.644259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:49.655363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:49.673667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:49.890060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:49.906970 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7041a403-8222-469d-a9b7-db0d82b10435 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1222 microversion: 2.1 time: 0.312678 Mar 29 02:25:49.917885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1731/3704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:49 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1222 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:49.921699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:49.925201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:49.948374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:49.948818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:49.952929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:49.954554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:50.037349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:50.047825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:50.054381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:50.059933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a3276849-07f5-4d92-83da-0ed4deecd121 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1660 microversion: 2.42 time: 1.473303 Mar 29 02:25:50.059933 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1974/3705] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:48 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1660 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:50.466902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:50.467795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:50.476238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:50.477084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:50.478117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:50.478783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:50.729391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:50.739325 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-262e48d6-fa20-49b3-96a7-c67556d6c742 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 0.826640 Mar 29 02:25:50.740203 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1732/3706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:49 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:50.927430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:50.928089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:50.936189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:50.936659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:50.937519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:50.937959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:51.361555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:51.379075 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a747e338-ad99-49ad-bd3e-0167a5be2671 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1270 microversion: 2.1 time: 0.455339 Mar 29 02:25:51.380021 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1733/3707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:50 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1270 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:51.388007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:51.388612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:51.406817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:51.407519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:51.408304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:51.410309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:51.565330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:51.579078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b801f061-3618-4096-9724-42047133b505 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 1.115584 Mar 29 02:25:51.579982 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1975/3708] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:50 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:51.757118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:51.757744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:51.766586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:51.767567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:51.768584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:51.769253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:52.495629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:52.511444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:52.514383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:52.514383 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4d2ea34-0708-4b51-8eeb-7fa06f5c7297 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1706 microversion: 2.42 time: 1.133080 Mar 29 02:25:52.514683 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1734/3709] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:51 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1706 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:52.518926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:52.519542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:52.546110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:52.546567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:52.557970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:52.558677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:52.905866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:52.923447 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0ae7d05-b672-455d-b0f2-0d051b3bcbed tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1276 microversion: 2.1 time: 0.407409 Mar 29 02:25:52.927386 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1735/3710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:52 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1276 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:52.933713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:52.942414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:52.950922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:52.951846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:52.956610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:52.956610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:53.041696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:53.051085 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e2f89d4f-cdee-4163-bb58-4b8a8dfa56e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 1.298128 Mar 29 02:25:53.052085 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1976/3711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:51 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:53.057622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b92e42a0-5f9c-41ee-9966-504eff2ad7b1 req-4f7f76e1-19d8-470d-813d-20c6ead0e795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee7ea393-7ad8-47c5-96d6-7437a1cb82c6", "tag": "a539cbb0-cd1e-443b-99a1-dd7211b24036"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:53.059496 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:53.059496 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:53.071223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b92e42a0-5f9c-41ee-9966-504eff2ad7b1 req-4f7f76e1-19d8-470d-813d-20c6ead0e795 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:53.072014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b92e42a0-5f9c-41ee-9966-504eff2ad7b1 req-4f7f76e1-19d8-470d-813d-20c6ead0e795 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:53.092090 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b92e42a0-5f9c-41ee-9966-504eff2ad7b1 req-4f7f76e1-19d8-470d-813d-20c6ead0e795 service nova] Creating event network-changed:a539cbb0-cd1e-443b-99a1-dd7211b24036 for instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 on n-h1-828148-1 Mar 29 02:25:53.100128 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b92e42a0-5f9c-41ee-9966-504eff2ad7b1 req-4f7f76e1-19d8-470d-813d-20c6ead0e795 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044794 Mar 29 02:25:53.100471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1977/3712] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:53.227123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3f637a8d-6c55-439a-988e-f7e789f03139 req-b8f0a40b-d336-455a-90d5-8593a6dce41e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc57426-c0af-4968-ae4f-8c6ceb296f3c", "tag": "f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:53.228975 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:53.228975 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:53.246608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3f637a8d-6c55-439a-988e-f7e789f03139 req-b8f0a40b-d336-455a-90d5-8593a6dce41e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:53.249517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3f637a8d-6c55-439a-988e-f7e789f03139 req-b8f0a40b-d336-455a-90d5-8593a6dce41e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:53.285241 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3f637a8d-6c55-439a-988e-f7e789f03139 req-b8f0a40b-d336-455a-90d5-8593a6dce41e service nova] Creating event network-changed:f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41 for instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c on n-h2-828148-1 Mar 29 02:25:53.298044 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3f637a8d-6c55-439a-988e-f7e789f03139 req-b8f0a40b-d336-455a-90d5-8593a6dce41e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075383 Mar 29 02:25:53.299233 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1978/3713] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:53.533988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:53.534975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:53.543453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:53.544154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:53.545175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:53.545870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:54.455072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:54.470697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:54.472405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:54.473749 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ab5367c0-02e0-4166-a9cf-6a4edcf2fd01 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1694 microversion: 2.42 time: 0.944673 Mar 29 02:25:54.485820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:54.492356 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1979/3714] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:53 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1694 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:25:54.496762 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7b5538e-fddd-4cbb-9032-c96e8969e399 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 1.571468 Mar 29 02:25:54.504274 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1736/3715] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:52 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:54.506782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9bba0810-c43e-4ed2-ab3e-89d3c6579c93 req-2f6e744e-8aae-445a-ab50-1825b5703f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305ce8f3-8864-420d-80ef-67c0816603aa", "name": "network-vif-plugged", "status": "completed", "tag": "371a5c4f-f3b2-4d69-8055-ec3f23e9140b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:54.508413 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:54.508413 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:54.509585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:54.516790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9bba0810-c43e-4ed2-ab3e-89d3c6579c93 req-2f6e744e-8aae-445a-ab50-1825b5703f73 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:54.517259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9bba0810-c43e-4ed2-ab3e-89d3c6579c93 req-2f6e744e-8aae-445a-ab50-1825b5703f73 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:54.518073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:54.546270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:54.549338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:54.555768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:54.555768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:54.557209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9bba0810-c43e-4ed2-ab3e-89d3c6579c93 req-2f6e744e-8aae-445a-ab50-1825b5703f73 service nova] Creating event network-vif-plugged:371a5c4f-f3b2-4d69-8055-ec3f23e9140b for instance 305ce8f3-8864-420d-80ef-67c0816603aa on n-h1-828148-1 Mar 29 02:25:54.565948 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9bba0810-c43e-4ed2-ab3e-89d3c6579c93 req-2f6e744e-8aae-445a-ab50-1825b5703f73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074212 Mar 29 02:25:54.572794 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1980/3716] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:54.585581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:54.587515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:54.607748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:54.608567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:54.609976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:54.622524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:55.778583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:55.792361 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d821fc87-f0ea-4177-a832-b8cf9330366f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 1.286694 Mar 29 02:25:55.793092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1737/3717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:54 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:55.799506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:55.801979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:55.812157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:55.813215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:55.814346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:55.814988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:55.970503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:55.998485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a32bcd8d-6836-43a3-a129-d64cab03e624 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1309 microversion: 2.1 time: 1.420831 Mar 29 02:25:56.000816 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1981/3718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:54 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1309 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:56.006750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:56.009404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:56.018007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:56.018565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:56.019342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:56.019974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:56.721824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:56.730920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce9eb607-40c1-44d0-83dc-66734a6a7e44 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.728699 Mar 29 02:25:56.733513 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1982/3719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:56 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:56.811536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:56.812457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:56.824238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:56.825927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:56.827632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:56.829288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:56.924981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:56.938930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:56.941385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:56.942745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f4e0a033-dde8-42a6-84ca-a055a98c0b10 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1740 microversion: 2.42 time: 1.148502 Mar 29 02:25:56.944355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1738/3720] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:55 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1740 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:57.017605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:57.018948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:57.028228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:57.029193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:57.032808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:57.033515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:57.478546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:57.488826 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ec6e819-f2f2-476e-b8dc-fd936b623060 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 0.682095 Mar 29 02:25:57.491670 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1983/3721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:56 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:57.753763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:57.754810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:57.763514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:57.764072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:57.764982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:57.765518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.028718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:58.046264 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-11f1acf3-2b0e-436b-8be4-a0bce14fdc4c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1490 microversion: 2.1 time: 1.032652 Mar 29 02:25:58.047068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1739/3722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:57 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1490 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:58.068072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:58.068072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:58.073553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.074226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.075349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.075840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.278959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:58.294950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3b27680-31a2-46ec-a1d0-93b409302f05 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.547077 Mar 29 02:25:58.295461 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1984/3723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:57 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:25:58.310742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:58.311945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:58.319806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.320277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.321138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.321575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.507403 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43ed9734-8811-4a69-b703-4daff39c5b19 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "PUT /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1085 microversion: 2.1 time: 0.200482 Mar 29 02:25:58.518993 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1985/3724] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:25:58 2022] PUT /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1085 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:58.524888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:58.525901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:58.536352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.537856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.539398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.540125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.677391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:58.694120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:58.695966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:58.697518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edeb95af-2507-433b-8399-9a5f3df856dc tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1786 microversion: 2.42 time: 0.637122 Mar 29 02:25:58.698755 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1740/3725] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:25:58 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1786 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:25:58.703602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:58.704861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:58.713862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.714959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:58.715978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:58.716532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:59.464669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:59.474150 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-776dbfa1-9948-47c6-b310-b3915651a7c9 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 0.953615 Mar 29 02:25:59.475128 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1986/3726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:58 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:59.480961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b8442b93-6625-4931-8131-312c39f091d8 req-0fd38843-189e-44e7-897c-af26976a0516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6d24f0-7323-470a-86c2-849a3648bba6", "tag": "4aecb358-9ed3-4867-9e8a-a68028fb4ab8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:25:59.482904 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:25:59.482904 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:25:59.492247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b8442b93-6625-4931-8131-312c39f091d8 req-0fd38843-189e-44e7-897c-af26976a0516 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:59.492965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b8442b93-6625-4931-8131-312c39f091d8 req-0fd38843-189e-44e7-897c-af26976a0516 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:59.509604 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b8442b93-6625-4931-8131-312c39f091d8 req-0fd38843-189e-44e7-897c-af26976a0516 service nova] Creating event network-changed:4aecb358-9ed3-4867-9e8a-a68028fb4ab8 for instance df6d24f0-7323-470a-86c2-849a3648bba6 on n-h1-828148-1 Mar 29 02:25:59.514571 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b8442b93-6625-4931-8131-312c39f091d8 req-0fd38843-189e-44e7-897c-af26976a0516 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038143 Mar 29 02:25:59.515829 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1987/3727] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:25:59.521178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:59.522074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:59.529867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:59.530309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:59.531259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:59.531946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:59.620624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:25:59.636501 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47b10c30-dc58-462f-bb16-cd11ffafd45f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1511 microversion: 2.1 time: 0.936472 Mar 29 02:25:59.637485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1741/3728] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:58 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1511 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:25:59.652688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:25:59.653482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:25:59.670586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:59.671154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:25:59.676254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:25:59.676254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.160405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:00.170481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d6e5945-ddbc-4c9d-8fef-bb4bb14ff3ad tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.652776 Mar 29 02:26:00.180121 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1988/3729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:59 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:00.185827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:00.186058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:00.193849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.194787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.195269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.195795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.416800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:00.426208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e2a55287-880b-416d-aa88-0ac4207d2e02 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1511 microversion: 2.1 time: 0.777469 Mar 29 02:26:00.427140 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1742/3730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:25:59 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:00.444755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:00.445619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:00.453736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.454172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.455136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.455570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.523377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:26:00.898705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4054a487-cca6-4eec-b4ac-41c084d5f896 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 204 len: 0 microversion: 2.1 time: 0.457421 Mar 29 02:26:00.899962 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1743/3731] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:26:00 2022] DELETE /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:26:00.910805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:00.912135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:00.937285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.938715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:00.939744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:00.940416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:01.169244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:01.183448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:01.187494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:01.191178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2140399b-81c9-4017-8d53-efbc05a20a37 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1786 microversion: 2.42 time: 1.010136 Mar 29 02:26:01.194265 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1989/3732] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:00 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1786 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:01.198944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:01.202063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:01.220174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:01.221334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:01.225899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:01.227003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:01.929527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:01.942428 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9ad2a26-41b9-4fdf-afc5-689bcd6bf23a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1517 microversion: 2.1 time: 0.746759 Mar 29 02:26:01.954637 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1990/3733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:01 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1517 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:01.960712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:01.961660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:01.971465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:01.972233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:01.973265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:01.973892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:02.098823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:02.107965 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce278747-1490-417f-b1be-3602b9f7f7ef tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 1.204784 Mar 29 02:26:02.113094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1744/3734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:00 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:02.212020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:02.212732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:02.239764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:02.240600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:02.241639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:02.242270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:02.723116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:02.736223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1f838bd-ebdf-4582-a243-c0ea38b77e08 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.780007 Mar 29 02:26:02.736815 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1991/3735] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:01 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:02.962878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:02.963754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:02.974203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:02.975088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:02.975863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:02.976500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:03.653384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:03.668101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:03.673871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:03.675023 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53cefb03-98ed-403d-ac9b-8302875697bd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1832 microversion: 2.42 time: 1.467328 Mar 29 02:26:03.675595 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1745/3736] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:02 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1832 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:26:03.687706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:03.688790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:03.705902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:03.706430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:03.707445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:03.713630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:04.012980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:04.023041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3e332bf0-55c8-44a8-9a54-9c341c0cabc2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1517 microversion: 2.1 time: 1.065912 Mar 29 02:26:04.034065 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1992/3737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:02 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1517 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:04.039714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:04.040589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:04.054698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:04.056002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:04.057099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:04.057757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:04.720210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:04.741084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3f5fdd0-1667-457a-8d19-d99309ac55be tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 0.695399 Mar 29 02:26:04.742617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1993/3738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:04 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:04.747540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:04.748389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:04.758517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:04.759178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:04.760169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:04.760818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:05.096069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:05.105759 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-235f1ad2-4da5-486d-ace3-0a5d43380e48 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 1.421642 Mar 29 02:26:05.116453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1746/3739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:03 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:05.123736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-45a0d3a1-e822-462e-8b2c-a33aa9422c32 req-aaf39f43-e79d-4cbe-b496-ae154abb67ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7ea393-7ad8-47c5-96d6-7437a1cb82c6", "name": "network-vif-plugged", "status": "completed", "tag": "a539cbb0-cd1e-443b-99a1-dd7211b24036"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:05.126093 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:05.126093 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:05.135664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-45a0d3a1-e822-462e-8b2c-a33aa9422c32 req-aaf39f43-e79d-4cbe-b496-ae154abb67ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:05.136558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-45a0d3a1-e822-462e-8b2c-a33aa9422c32 req-aaf39f43-e79d-4cbe-b496-ae154abb67ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:05.154695 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-45a0d3a1-e822-462e-8b2c-a33aa9422c32 req-aaf39f43-e79d-4cbe-b496-ae154abb67ed service nova] Creating event network-vif-plugged:a539cbb0-cd1e-443b-99a1-dd7211b24036 for instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 on n-h1-828148-1 Mar 29 02:26:05.161349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-45a0d3a1-e822-462e-8b2c-a33aa9422c32 req-aaf39f43-e79d-4cbe-b496-ae154abb67ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043171 Mar 29 02:26:05.163061 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1747/3740] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:05.173453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3e6409c0-9aae-45e1-ae97-fa5ffc5622c2 req-0eb25cf5-3a17-4886-90c5-e813ba0cbb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "5439bc8e-6127-445f-b123-cba37ea6e3fc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:05.183910 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:05.183910 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:05.215282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3e6409c0-9aae-45e1-ae97-fa5ffc5622c2 req-0eb25cf5-3a17-4886-90c5-e813ba0cbb31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:05.219998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3e6409c0-9aae-45e1-ae97-fa5ffc5622c2 req-0eb25cf5-3a17-4886-90c5-e813ba0cbb31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:05.242813 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3e6409c0-9aae-45e1-ae97-fa5ffc5622c2 req-0eb25cf5-3a17-4886-90c5-e813ba0cbb31 service nova] Creating event network-changed:5439bc8e-6127-445f-b123-cba37ea6e3fc for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:05.248603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3e6409c0-9aae-45e1-ae97-fa5ffc5622c2 req-0eb25cf5-3a17-4886-90c5-e813ba0cbb31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083997 Mar 29 02:26:05.250145 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1748/3741] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:05.266959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:05.268082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:05.277462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:05.278497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:05.279709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:05.280406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:06.164150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:06.177780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:06.179737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:06.181460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c69b3e1a-fe2c-4f73-a582-b47a86258d7e tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1832 microversion: 2.42 time: 1.437812 Mar 29 02:26:06.182535 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1994/3742] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:04 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1832 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:06.188761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:06.189712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:06.203095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:06.204505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:06.205873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:06.206670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:06.409982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:06.428457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e47f56cb-e7c0-4d6a-85d0-42418c5a006b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1517 microversion: 2.1 time: 1.175293 Mar 29 02:26:06.430613 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1749/3743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:05 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1517 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:06.448245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:06.449140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:06.460344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:06.463276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:06.464730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:06.465630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:06.996921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.013968 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0cad8e5c-53c6-48a0-9923-a4e439698d2c tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 0.569816 Mar 29 02:26:07.014877 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1750/3744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:06 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:07.022913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6ebd298e-70e1-440e-b0e6-9cdee9f03ed3 req-95d1ddeb-91a7-4030-be0e-87f59b88769c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305ce8f3-8864-420d-80ef-67c0816603aa", "name": "network-vif-deleted", "tag": "371a5c4f-f3b2-4d69-8055-ec3f23e9140b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:07.024956 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:07.024956 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:07.040167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6ebd298e-70e1-440e-b0e6-9cdee9f03ed3 req-95d1ddeb-91a7-4030-be0e-87f59b88769c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.040605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6ebd298e-70e1-440e-b0e6-9cdee9f03ed3 req-95d1ddeb-91a7-4030-be0e-87f59b88769c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.074008 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6ebd298e-70e1-440e-b0e6-9cdee9f03ed3 req-95d1ddeb-91a7-4030-be0e-87f59b88769c service nova] Creating event network-vif-deleted:371a5c4f-f3b2-4d69-8055-ec3f23e9140b for instance 305ce8f3-8864-420d-80ef-67c0816603aa on n-h1-828148-1 Mar 29 02:26:07.094718 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6ebd298e-70e1-440e-b0e6-9cdee9f03ed3 req-95d1ddeb-91a7-4030-be0e-87f59b88769c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078388 Mar 29 02:26:07.095240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1751/3745] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:07.203604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:07.204710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:07.213953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.214715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.215703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.216346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.330830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.340485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6eacca5-615a-4a19-a771-99e586a9a9bd tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1313 microversion: 2.1 time: 1.156004 Mar 29 02:26:07.341419 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1995/3746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:06 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1313 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:07.449516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:07.451210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:07.473084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.473084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.473084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.473084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.553687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:07.554406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:07.555029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lazy-loading 'fault' on Instance uuid 305ce8f3-8864-420d-80ef-67c0816603aa {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:07.792942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.804320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-966ff73d-15b3-42b6-8aae-6b340ff5a698 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 200 len: 1320 microversion: 2.1 time: 0.359499 Mar 29 02:26:07.805511 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1996/3747] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:07 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:07.867343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.881208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.884689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:07.884689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a39330f0-0d6d-41b6-bf8c-7a0b3dbd825d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1832 microversion: 2.42 time: 0.685862 Mar 29 02:26:07.884689 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1752/3748] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:07 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1832 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:08.040129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:08.040129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:08.051541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:08.053405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:08.056084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:08.056530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:08.358204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:08.358819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:08.370385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:08.371239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:08.372899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:08.373508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:08.963059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:08.972535 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2dc6178e-54e0-4be5-af3d-e930fbb27ba6 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 0.944319 Mar 29 02:26:08.973506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1997/3749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:08 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:08.978304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a5a59c39-709a-42e0-b822-4a335f985cde req-8b1bc19a-1da2-49ba-a5fc-594b6313bb04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:08.980056 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:08.980056 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:08.989151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a5a59c39-709a-42e0-b822-4a335f985cde req-8b1bc19a-1da2-49ba-a5fc-594b6313bb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:08.989603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a5a59c39-709a-42e0-b822-4a335f985cde req-8b1bc19a-1da2-49ba-a5fc-594b6313bb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.010947 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a5a59c39-709a-42e0-b822-4a335f985cde req-8b1bc19a-1da2-49ba-a5fc-594b6313bb04 service nova] Creating event network-changed:d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:09.019393 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a5a59c39-709a-42e0-b822-4a335f985cde req-8b1bc19a-1da2-49ba-a5fc-594b6313bb04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044155 Mar 29 02:26:09.020262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1998/3750] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:09.026284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:09.027260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:09.032174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:09.035424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.036100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.037148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.037955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.049267 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46b569f1-0ef1-4d5e-93d6-eaec405a4c79 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1499 microversion: 2.1 time: 0.694773 Mar 29 02:26:09.049869 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1753/3751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:08 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1499 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:09.063935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:09.064545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:09.072438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.072953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.073722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.074320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.107862 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. Mar 29 02:26:09.108742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:09.109800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81e7546c-905b-4496-8c94-dfaa1703da85 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 404 len: 111 microversion: 2.1 time: 0.087565 Mar 29 02:26:09.110729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 1999/3752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:09 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:09.121645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f93083b-0aab-4fd2-bc0b-b7ec5975e530 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:09.145840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.server_groups [None req-9f93083b-0aab-4fd2-bc0b-b7ec5975e530 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Querying cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) for 1 instances {{(pid=103513) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Mar 29 02:26:09.148463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f93083b-0aab-4fd2-bc0b-b7ec5975e530 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.148463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f93083b-0aab-4fd2-bc0b-b7ec5975e530 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.208358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f93083b-0aab-4fd2-bc0b-b7ec5975e530 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae" status: 200 len: 222 microversion: 2.1 time: 0.096177 Mar 29 02:26:09.209636 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2000/3753] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:26:09 2022] GET /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae => generated 222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:09.220618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:09.221349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:09.231758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.232164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.234121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:09.234780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:09.323228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:26:09.810619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df426730-d98e-421d-b897-5c7ca0bc2da3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 204 len: 0 microversion: 2.1 time: 0.594260 Mar 29 02:26:09.811578 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2001/3754] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:26:09 2022] DELETE /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:26:09.819587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-513937810", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "9b6b9384-11bc-44cc-bff3-f94e2104cdf4"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:09.980318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] validate_networks() for [('9b6b9384-11bc-44cc-bff3-f94e2104cdf4', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:26:10.107833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:10.123124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:10.129318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:10.131652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87ed5d89-084a-4e94-ab15-a5d1438aed32 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1853 microversion: 2.42 time: 1.080129 Mar 29 02:26:10.134281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1754/3755] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:09 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1853 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:10.147807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:10.147807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:10.165380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:10.167602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:10.168759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:10.169943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:10.699649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:10.708086 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13c44073-31f7-4587-9730-162d9297f999 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1505 microversion: 2.1 time: 0.572313 Mar 29 02:26:10.708694 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1755/3756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:10 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:10.713360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:10.714231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:10.721999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:10.722545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:10.723406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:10.723952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:11.769372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:11.778901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4e243d7-fc1a-46d4-8680-cdb184ae491e tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 1.068853 Mar 29 02:26:11.791223 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1756/3757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:10 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:11.796544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c8b18171-6825-4259-8292-da3c640eb38e req-ca5638d4-e478-4921-88c1-ada9905c9038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6d24f0-7323-470a-86c2-849a3648bba6", "name": "network-vif-plugged", "status": "completed", "tag": "4aecb358-9ed3-4867-9e8a-a68028fb4ab8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:11.798454 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:11.798454 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:11.808049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8b18171-6825-4259-8292-da3c640eb38e req-ca5638d4-e478-4921-88c1-ada9905c9038 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:11.808885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8b18171-6825-4259-8292-da3c640eb38e req-ca5638d4-e478-4921-88c1-ada9905c9038 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:11.827923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c8b18171-6825-4259-8292-da3c640eb38e req-ca5638d4-e478-4921-88c1-ada9905c9038 service nova] Creating event network-vif-plugged:4aecb358-9ed3-4867-9e8a-a68028fb4ab8 for instance df6d24f0-7323-470a-86c2-849a3648bba6 on n-h1-828148-1 Mar 29 02:26:11.833482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c8b18171-6825-4259-8292-da3c640eb38e req-ca5638d4-e478-4921-88c1-ada9905c9038 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040519 Mar 29 02:26:11.834600 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1757/3758] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:11.839898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:11.841005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:11.860694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:11.860694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:11.860694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:11.860694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:12.720791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:26:12.721837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:26:12.722728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:26:12.723347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:26:12.724620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:26:12.742489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:12.747747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:12.752750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:12.753956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:12.826992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:12.866848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Getting quotas for user 7f9c4272809f40bb9bd72d426340581c and project 6df2a3fdc322462b9efa2b63c348d28c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:12.916470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:26:12.918948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:26:13.084754 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9872e8e1-08ee-4eff-9f8f-b550c168c039 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.271505 Mar 29 02:26:13.085759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2002/3759] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:26:13.091304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:13.094305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:13.107296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:13.107750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:13.108776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:13.109027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:13.349556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:13.362513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:13.364480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:13.367181 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf229e5f-3d8d-442d-9aa4-3685147fcd76 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.529357 Mar 29 02:26:13.371435 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1758/3760] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:11 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:13.378263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c8d1f222-4bc4-43e2-840c-dff2b1a8e36d req-07c26737-e062-4d74-a122-35f04ba75629 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "15ceead5-ba63-4d0c-aa69-fe1a873c1813"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:13.387491 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:13.387491 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:13.397237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8d1f222-4bc4-43e2-840c-dff2b1a8e36d req-07c26737-e062-4d74-a122-35f04ba75629 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:13.397846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c8d1f222-4bc4-43e2-840c-dff2b1a8e36d req-07c26737-e062-4d74-a122-35f04ba75629 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:13.415918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c8d1f222-4bc4-43e2-840c-dff2b1a8e36d req-07c26737-e062-4d74-a122-35f04ba75629 service nova] Creating event network-changed:15ceead5-ba63-4d0c-aa69-fe1a873c1813 for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:13.430359 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c8d1f222-4bc4-43e2-840c-dff2b1a8e36d req-07c26737-e062-4d74-a122-35f04ba75629 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053842 Mar 29 02:26:13.431473 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1759/3761] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:13.438481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:13.439736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:13.453460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:13.454099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:13.455405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:13.455996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:14.364862 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:26:14.412332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:14.441392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02009722-9427-4a6d-a659-b2887de5c448 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1505 microversion: 2.1 time: 1.354348 Mar 29 02:26:14.445191 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2003/3762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:13 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1505 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:14.626359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:14.641432 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-039da25f-e8ff-411c-92ef-856c88136626 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1318 microversion: 2.1 time: 1.205313 Mar 29 02:26:14.666917 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1760/3763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:13 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1318 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:14.680591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:14.682526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:14.710368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:14.713571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:14.716332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:14.716879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:14.743585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-2036672937", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:14.896073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] validate_networks() for [('8b33351c-6eaf-4e79-b73a-4270ff8cd867', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:26:15.260151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:15.269916 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a531abcc-0b7d-40ea-9b77-8d57ffd1772f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1212 microversion: 2.1 time: 0.599958 Mar 29 02:26:15.272197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1761/3764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:14 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1212 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:15.283357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:15.285589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:15.303762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:15.304209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:15.306426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:15.306895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:15.422555 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38584. Mar 29 02:26:15.883854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:15.905017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:15.909101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:15.912617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e47d5bf1-55f7-47f0-9a54-1e5facf2537c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.638816 Mar 29 02:26:15.921190 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1762/3765] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:15 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:15.933508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2de114ef-a9a8-4632-977e-8f2b872b55f6 req-c54bbb9d-713e-466d-889a-874acd53d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee7ea393-7ad8-47c5-96d6-7437a1cb82c6", "name": "network-vif-deleted", "tag": "a539cbb0-cd1e-443b-99a1-dd7211b24036"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:15.939003 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:15.939003 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:15.987754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2de114ef-a9a8-4632-977e-8f2b872b55f6 req-c54bbb9d-713e-466d-889a-874acd53d1c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:15.988562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2de114ef-a9a8-4632-977e-8f2b872b55f6 req-c54bbb9d-713e-466d-889a-874acd53d1c0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:16.039671 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2de114ef-a9a8-4632-977e-8f2b872b55f6 req-c54bbb9d-713e-466d-889a-874acd53d1c0 service nova] Creating event network-vif-deleted:a539cbb0-cd1e-443b-99a1-dd7211b24036 for instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 on n-h1-828148-1 Mar 29 02:26:16.051883 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2de114ef-a9a8-4632-977e-8f2b872b55f6 req-c54bbb9d-713e-466d-889a-874acd53d1c0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126376 Mar 29 02:26:16.051883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1763/3766] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:16.062891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:16.063675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:16.092209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:16.092209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:16.093745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:16.094218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:16.236900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:16.237715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:16.238169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lazy-loading 'fault' on Instance uuid ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:16.496890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb84cd38935d4017b472bb153e84dad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7301bbbfd37a43ba99e29d9c6ea2701c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:16.511209 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-826acc72-6ec1-4b4d-afd8-354d28d6187a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 200 len: 1303 microversion: 2.1 time: 0.457905 Mar 29 02:26:16.512172 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1764/3767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:16 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 1303 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:16.521526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:16.522957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:16.548369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:16.548831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:16.552925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:16.553591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.211721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:17.228915 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0891372c-6065-4dd1-98ca-588b1499b8d7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1508 microversion: 2.1 time: 0.715297 Mar 29 02:26:17.240875 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1765/3768] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:16 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1508 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:17.240875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4d7178bd-586e-4370-a24c-a7ce6a3482de req-e6ec8693-83be-4339-8c44-d7f2a0804c5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "23ae4153-d36c-4180-8450-7828198b373d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:17.240875 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:17.240875 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:17.250669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4d7178bd-586e-4370-a24c-a7ce6a3482de req-e6ec8693-83be-4339-8c44-d7f2a0804c5f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.251166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4d7178bd-586e-4370-a24c-a7ce6a3482de req-e6ec8693-83be-4339-8c44-d7f2a0804c5f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.293862 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4d7178bd-586e-4370-a24c-a7ce6a3482de req-e6ec8693-83be-4339-8c44-d7f2a0804c5f service nova] Creating event network-changed:23ae4153-d36c-4180-8450-7828198b373d for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:17.307855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4d7178bd-586e-4370-a24c-a7ce6a3482de req-e6ec8693-83be-4339-8c44-d7f2a0804c5f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076616 Mar 29 02:26:17.308704 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1766/3769] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:17.322280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:17.322987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:17.334800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.335156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.336143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.336578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.551949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:17.566319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86e99f27-2409-4be0-b88d-3d38f9d18866 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1266 microversion: 2.1 time: 0.255218 Mar 29 02:26:17.573982 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1767/3770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:17 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:17.579398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:17.583249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:17.607554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.609351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.613489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.615460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.830895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:26:17.831373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:26:17.831772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:26:17.832398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:26:17.833052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:26:17.852868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.853564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.857624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:17.858291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:17.906369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Getting quotas for project 6bd1bdc45f7b49d793ec358f4b9c1797. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:17.913292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Getting quotas for user b9a9d81442d049ea91cd80ce56f93af5 and project 6bd1bdc45f7b49d793ec358f4b9c1797. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:17.939616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:26:17.942205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:26:18.104631 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c03e0bf1-e30a-4e08-9aef-7e8ab720dc6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.658452 Mar 29 02:26:18.112334 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2004/3771] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:26:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:26:18.179677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.181229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:18.199113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.204963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.206055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.206821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.393457 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. Mar 29 02:26:18.394594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:18.399319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d141f09-946f-4df9-a854-9f73530577c5 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 404 len: 111 microversion: 2.1 time: 0.283767 Mar 29 02:26:18.401253 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2005/3772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 111 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:18.413089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b19dbded-fcc2-497b-a086-db648c9868d0 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.414499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b19dbded-fcc2-497b-a086-db648c9868d0 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:18.532555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:18.544764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:18.546301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:18.547435 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1245b83c-1909-4d40-b8f2-a37dfcba8688 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.977596 Mar 29 02:26:18.559191 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1768/3773] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:17 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:18.560069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83258073-940f-4a20-8565-511f6ff438e4 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.578902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_groups [None req-83258073-940f-4a20-8565-511f6ff438e4 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Querying cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) for 1 instances {{(pid=103514) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Mar 29 02:26:18.579936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83258073-940f-4a20-8565-511f6ff438e4 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.580529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83258073-940f-4a20-8565-511f6ff438e4 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.599800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83258073-940f-4a20-8565-511f6ff438e4 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.049849 Mar 29 02:26:18.609419 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1769/3774] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:18.615587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.623170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:18.627519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b19dbded-fcc2-497b-a086-db648c9868d0 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:18.629129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.630510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.631570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.632367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.636193 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b19dbded-fcc2-497b-a086-db648c9868d0 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1223 microversion: 2.1 time: 0.233408 Mar 29 02:26:18.637107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2006/3775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1223 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:18.641810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61f227b3-56b6-4678-9314-e2cc429742d3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.668745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.server_groups [None req-61f227b3-56b6-4678-9314-e2cc429742d3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Querying cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) for 1 instances {{(pid=103513) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Mar 29 02:26:18.669985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f227b3-56b6-4678-9314-e2cc429742d3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.670591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f227b3-56b6-4678-9314-e2cc429742d3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.690637 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61f227b3-56b6-4678-9314-e2cc429742d3 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae" status: 200 len: 184 microversion: 2.1 time: 0.052175 Mar 29 02:26:18.691612 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2007/3776] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae => generated 184 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:18.709419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.709419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:18.715468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.716308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.717606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.718210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.869854 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. Mar 29 02:26:18.870533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:18.873457 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62dcdb1b-fddd-4342-864a-8f1e5c571be0 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 404 len: 111 microversion: 2.1 time: 0.174330 Mar 29 02:26:18.874029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2008/3777] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:26:18 2022] DELETE /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:18.881859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:18.888008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] [instance: ee7ea393-7ad8-47c5-96d6-7437a1cb82c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:18.902482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.905418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.906482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:18.906922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:18.977277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:18.995457 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. Mar 29 02:26:18.996180 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fae8f0d1-a419-4c09-aaa0-e4a15629d99c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1266 microversion: 2.1 time: 0.385103 Mar 29 02:26:18.996546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:18.996859 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1770/3778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:19.004071 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef8ea19d-96e4-4912-b6e0-f09768f62b86 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6" status: 404 len: 111 microversion: 2.1 time: 0.125621 Mar 29 02:26:19.005366 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2009/3779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:18 2022] GET /compute/v2.1/servers/ee7ea393-7ad8-47c5-96d6-7437a1cb82c6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:19.015191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ef698bc-7526-448c-888b-f0ce6503aad9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.049538 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2ef698bc-7526-448c-888b-f0ce6503aad9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance group 594ac15f-41cb-463d-bfc9-c8c915d6adc9 could not be found. Mar 29 02:26:19.050175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ef698bc-7526-448c-888b-f0ce6503aad9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance group 594ac15f-41cb-463d-bfc9-c8c915d6adc9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:19.054458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ef698bc-7526-448c-888b-f0ce6503aad9 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/594ac15f-41cb-463d-bfc9-c8c915d6adc9" status: 404 len: 117 microversion: 2.1 time: 0.043665 Mar 29 02:26:19.055907 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1771/3780] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:26:19 2022] DELETE /compute/v2.1/os-server-groups/594ac15f-41cb-463d-bfc9-c8c915d6adc9 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:19.065352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-325f3af1-65a9-41e2-a334-9b380aef42b2 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.083844 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-325f3af1-65a9-41e2-a334-9b380aef42b2 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance group 875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5 could not be found. Mar 29 02:26:19.084805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-325f3af1-65a9-41e2-a334-9b380aef42b2 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance group 875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:19.085667 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-325f3af1-65a9-41e2-a334-9b380aef42b2 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5" status: 404 len: 117 microversion: 2.1 time: 0.024727 Mar 29 02:26:19.089985 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2010/3781] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:26:19 2022] DELETE /compute/v2.1/os-server-groups/875d6c4d-c4d1-4ad6-9d34-8407b8ef81a5 => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:19.101104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5fddf89-778c-4ede-bb8c-93d0d648020a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.121280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b5fddf89-778c-4ede-bb8c-93d0d648020a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance group 7e992cda-5141-4a1d-b485-24cda5961ba2 could not be found. Mar 29 02:26:19.122138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5fddf89-778c-4ede-bb8c-93d0d648020a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance group 7e992cda-5141-4a1d-b485-24cda5961ba2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:19.123024 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5fddf89-778c-4ede-bb8c-93d0d648020a tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/7e992cda-5141-4a1d-b485-24cda5961ba2" status: 404 len: 117 microversion: 2.1 time: 0.031784 Mar 29 02:26:19.133654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90e6324d-d8d4-468b-9786-e9fb94341c24 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.153967 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1772/3782] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:26:19 2022] DELETE /compute/v2.1/os-server-groups/7e992cda-5141-4a1d-b485-24cda5961ba2 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:19.173574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-90e6324d-d8d4-468b-9786-e9fb94341c24 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] HTTP exception thrown: Instance group ade7b8c7-f408-422a-a0cd-086900c4255f could not be found. Mar 29 02:26:19.174453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90e6324d-d8d4-468b-9786-e9fb94341c24 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Returning 404 to user: Instance group ade7b8c7-f408-422a-a0cd-086900c4255f could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:19.175904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90e6324d-d8d4-468b-9786-e9fb94341c24 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/ade7b8c7-f408-422a-a0cd-086900c4255f" status: 404 len: 117 microversion: 2.1 time: 0.046791 Mar 29 02:26:19.181357 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2011/3783] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:26:19 2022] DELETE /compute/v2.1/os-server-groups/ade7b8c7-f408-422a-a0cd-086900c4255f => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:19.188114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22b93521-9814-4f80-928e-64604a9ff5e1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.341142 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22b93521-9814-4f80-928e-64604a9ff5e1 tempest-ServerGroupTestJSON-981951127 tempest-ServerGroupTestJSON-981951127-project] 10.222.0.36 "DELETE /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae" status: 204 len: 0 microversion: 2.1 time: 0.158146 Mar 29 02:26:19.349742 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1773/3784] 10.222.0.36 () {58 vars in 1265 bytes} [Tue Mar 29 02:26:19 2022] DELETE /compute/v2.1/os-server-groups/e7f9ae14-0ca2-45c6-9b2a-390508e4ddae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:26:19.568983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.569621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:19.582471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:19.587424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:19.587424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:19.587424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:19.658498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:19.659257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:19.694558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:19.704427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:19.704427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:19.704427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:20.204449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:20.233372 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c55d6dee-d681-4471-a805-f6a517887d6a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1227 microversion: 2.1 time: 0.578475 Mar 29 02:26:20.234625 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1774/3785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:19 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1227 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:20.242167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:20.243285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:20.254249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:20.255473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:20.257140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:20.257798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:20.508155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:20.521672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77249aed-2d5f-4064-9e99-ca04b433b445 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1266 microversion: 2.1 time: 0.283153 Mar 29 02:26:20.530889 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1775/3786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:20 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:20.628628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dc3d8fe-25b8-47ff-963f-45c275d78b04"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:20.630581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:20.655274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:20.655971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:20.656757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:20.662723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:20.982679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:21.011533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:21.013414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:21.014972 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a5f5e8b-40fe-4deb-ab3c-95dd10b7b9c5 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.451861 Mar 29 02:26:21.026742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2012/3787] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:19 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:21.251975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:21.252597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:21.263968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:21.267628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:21.271647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:21.272130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:21.483228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:21.494116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f145b4b-dc62-4d41-84ed-db6e5dc77524 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1283 microversion: 2.1 time: 0.245990 Mar 29 02:26:21.500510 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2013/3788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:21 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:21.638156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-201931075", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:21.799907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] validate_networks() for [('214316d3-612e-4541-ac7e-127e5bf6dc4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:26:22.010262 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d6d49698-699d-48fb-abbd-e3a3e7e2b9b3 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "POST /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.385567 Mar 29 02:26:22.013248 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1776/3789] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:26:20 2022] POST /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments => generated 194 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:22.029433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:22.030179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:22.057676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:22.058142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:22.058946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:22.059562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:22.858565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:22.873484 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd3a9404-f79c-4c91-86b0-5d0ac37d419a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.855982 Mar 29 02:26:22.874787 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1777/3790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:22 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:22.894064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7219ec94-0019-4ab8-af21-95548aec2ec0 req-ba2f1ac1-2d38-4d9d-a8f9-fed0ba29a675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "cffc250d-42d3-48de-875e-040ce109f7cd"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:22.904790 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:22.904790 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:22.930983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7219ec94-0019-4ab8-af21-95548aec2ec0 req-ba2f1ac1-2d38-4d9d-a8f9-fed0ba29a675 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:22.933455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7219ec94-0019-4ab8-af21-95548aec2ec0 req-ba2f1ac1-2d38-4d9d-a8f9-fed0ba29a675 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:22.976196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7219ec94-0019-4ab8-af21-95548aec2ec0 req-ba2f1ac1-2d38-4d9d-a8f9-fed0ba29a675 service nova] Creating event network-changed:cffc250d-42d3-48de-875e-040ce109f7cd for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:22.984038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7219ec94-0019-4ab8-af21-95548aec2ec0 req-ba2f1ac1-2d38-4d9d-a8f9-fed0ba29a675 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107192 Mar 29 02:26:22.987590 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1778/3791] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:23.009707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:23.015624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:23.036310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:23.037519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:23.038960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:23.040651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:23.951774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:23.995555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:24.000977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:24.004787 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-999aebe7-4705-4336-acb8-6f0b2e640831 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.004858 Mar 29 02:26:24.005909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1779/3792] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:22 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:24.022453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:24.025758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:24.042363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:24.042824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:24.044072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:24.044828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:24.594778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:24.608472 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-85a13260-234c-48fd-b916-897d2ed2ae5c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1281 microversion: 2.1 time: 0.596601 Mar 29 02:26:24.610253 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1780/3793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:24 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1281 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:24.620065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:24.622917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:24.639363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:24.642247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:24.643116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:24.643576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.090508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:26:25.102854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:26:25.103563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:26:25.103971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:26:25.104386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:26:25.115187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.115624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.117598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.119529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.144412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:25.151259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for user 2efd8e6056cd4a27a715e3b54eca605d and project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:25.171827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:26:25.179598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:26:25.321587 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f48c76f9-a0b1-4e3e-9e4c-3598bf7ce0a3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.821496 Mar 29 02:26:25.329887 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2014/3794] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:26:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:26:25.336369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:25.337608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:25.350138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.351147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.352222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.352998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.531113 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-faa043e1-2a34-4309-a1b0-22c32a47c7ec tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/ips" status: 200 len: 149 microversion: 2.1 time: 0.199415 Mar 29 02:26:25.532345 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2015/3795] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:26:25 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/ips => generated 149 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:25.538799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:25.539841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:25.549504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.550728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.552330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:25.553997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:25.734617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:25.757886 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5803550-9904-4494-b829-8c340c61b837 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 1.139947 Mar 29 02:26:25.757886 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1781/3796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:24 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:25.763519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-65041f6d-c447-4029-ba4a-a4c82ea22fa3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:25.765310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-65041f6d-c447-4029-ba4a-a4c82ea22fa3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:25.934958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-65041f6d-c447-4029-ba4a-a4c82ea22fa3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:25.947065 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-65041f6d-c447-4029-ba4a-a4c82ea22fa3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1221 microversion: 2.1 time: 0.189966 Mar 29 02:26:25.949110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1782/3797] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:25 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:25.985622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:25.989083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:26.010430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:26.011147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:26.012115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:26.012759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:26.527989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:26.541341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:26.543166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:26.545363 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13e49816-3a88-4830-9525-fffc988f7ed7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.011065 Mar 29 02:26:26.546727 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2016/3798] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:25 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:26.552276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-962233057", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:26.636718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] validate_networks() for [('214316d3-612e-4541-ac7e-127e5bf6dc4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:26:27.384412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:27.407562 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8fbb1cd0-038c-48b2-a593-95017813f510 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 1.456717 Mar 29 02:26:27.409937 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1783/3799] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:25 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:27.416177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:27.417039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:27.440059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:27.440521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:27.441356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:27.442385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:28.162285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:28.177744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98a5e86d-85a1-45f7-bcb7-f1c25abe40fa tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.765955 Mar 29 02:26:28.188357 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1784/3800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:27 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:28.210773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-653693a6-93ce-4f0d-8360-b51fe2796e49 req-4bc70efc-b54e-488d-9337-f4ec5c5dffba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "a3943a15-704e-4b26-9b7c-ce42e87e288b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:28.214914 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:28.214914 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:28.240591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-653693a6-93ce-4f0d-8360-b51fe2796e49 req-4bc70efc-b54e-488d-9337-f4ec5c5dffba service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:28.241166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-653693a6-93ce-4f0d-8360-b51fe2796e49 req-4bc70efc-b54e-488d-9337-f4ec5c5dffba service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:28.308015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-653693a6-93ce-4f0d-8360-b51fe2796e49 req-4bc70efc-b54e-488d-9337-f4ec5c5dffba service nova] Creating event network-changed:a3943a15-704e-4b26-9b7c-ce42e87e288b for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:28.320548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-653693a6-93ce-4f0d-8360-b51fe2796e49 req-4bc70efc-b54e-488d-9337-f4ec5c5dffba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128897 Mar 29 02:26:28.321845 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1785/3801] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:28.346106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:28.347100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:28.366504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:28.371068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:28.371068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:28.371068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.369683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:29.380104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:29.381709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:29.382836 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c5683d11-3439-471d-98e7-0867919539c4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.057976 Mar 29 02:26:29.383393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1786/3802] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:28 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:29.388157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:29.388763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:29.399866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.403652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.403652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.403652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.417965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:26:29.419242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:26:29.420626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:26:29.421668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:26:29.422584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:26:29.437346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.443664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.443664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.443664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.474141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:29.480418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for user 2efd8e6056cd4a27a715e3b54eca605d and project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:29.494034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:26:29.496302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:26:29.586850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0fbd341a-b917-486f-892c-e8f2ac78f840 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.038687 Mar 29 02:26:29.588160 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2017/3803] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:26:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:26:29.593181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e060e8-1719-4fd9-b624-b76bb26dc31b"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:29.594596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:29.603902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.604724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:29.606011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:29.606687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.312562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:30.339350 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2260fa29-ef2f-4759-ad9f-1017c64deb5b tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 0.954394 Mar 29 02:26:30.340669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1787/3804] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:29 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:30.357936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:30.361386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:30.411419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.412803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.418273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.419410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.678011 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-660e6c2c-b038-4960-a6d8-8694958da07c tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "POST /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088210 Mar 29 02:26:30.694980 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2018/3805] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:26:29 2022] POST /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments => generated 194 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:30.708664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0751a675-03b4-46a1-8a0a-a9d8aa2d9259 req-d6bad6ae-7653-4705-adff-c32f6e97e8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:30.727789 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:30.727789 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:30.748019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0751a675-03b4-46a1-8a0a-a9d8aa2d9259 req-d6bad6ae-7653-4705-adff-c32f6e97e8e4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.748865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0751a675-03b4-46a1-8a0a-a9d8aa2d9259 req-d6bad6ae-7653-4705-adff-c32f6e97e8e4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.769248 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0751a675-03b4-46a1-8a0a-a9d8aa2d9259 req-d6bad6ae-7653-4705-adff-c32f6e97e8e4 service nova] Creating event network-changed:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:26:30.775680 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0751a675-03b4-46a1-8a0a-a9d8aa2d9259 req-d6bad6ae-7653-4705-adff-c32f6e97e8e4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077700 Mar 29 02:26:30.777224 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2019/3806] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:30.784920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:30.786422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:30.807827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.807827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.807827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.807827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.873393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:30.886201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e93b2a1-8aa3-4d78-8b9f-d97aac9cf52f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.542928 Mar 29 02:26:30.886201 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1788/3807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:30 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:30.898338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3d781410-977f-4369-8504-5b0d268e374d req-2f342331-0bc5-41b3-99cd-a6fd9f7872e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03c979dc-98fa-4453-8d4a-ce8dccb438ff", "tag": "c92cd060-a06b-47a4-a8e6-3450fa3f1312"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:30.902918 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:30.902918 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:30.920762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3d781410-977f-4369-8504-5b0d268e374d req-2f342331-0bc5-41b3-99cd-a6fd9f7872e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.921233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3d781410-977f-4369-8504-5b0d268e374d req-2f342331-0bc5-41b3-99cd-a6fd9f7872e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.954724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3d781410-977f-4369-8504-5b0d268e374d req-2f342331-0bc5-41b3-99cd-a6fd9f7872e7 service nova] Creating event network-changed:c92cd060-a06b-47a4-a8e6-3450fa3f1312 for instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff on n-h2-828148-1 Mar 29 02:26:30.954724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3d781410-977f-4369-8504-5b0d268e374d req-2f342331-0bc5-41b3-99cd-a6fd9f7872e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066426 Mar 29 02:26:30.954724 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1789/3808] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:30.961234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:30.962295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:30.971135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.971798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:30.988886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:30.988886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:31.059111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:31.081575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9961c8f0-5e97-4a23-a1bc-857f9a76a9ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1225 microversion: 2.1 time: 0.300973 Mar 29 02:26:31.084971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2020/3809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:30 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:31.355379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:31.356158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:31.368489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:31.369110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:31.369979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:31.375303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:31.776777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:31.788296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:31.790063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:31.791189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d4fa108-0c2d-4122-9c3d-11501789c40b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.835709 Mar 29 02:26:31.791913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1790/3810] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:30 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:31.903808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:31.904404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:31.924153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:31.929699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:31.929699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:31.929699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:32.556520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:32.570901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf2885ae-2288-44a6-97a7-9793a05efc69 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.672804 Mar 29 02:26:32.572484 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1791/3811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:31 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:32.577143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:32.577992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:32.586731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:32.587527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:32.589557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:32.591244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:33.053539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:33.071347 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4936a4b0-29c3-45e8-9bfa-fbfaa6ea8494 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1279 microversion: 2.1 time: 0.497455 Mar 29 02:26:33.084505 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1792/3812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:32 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1279 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:33.089571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:33.090488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:33.101156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:33.102337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:33.103729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:33.105566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:33.452121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:33.462571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:33.464077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:33.465505 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-330f76a9-9166-4b76-ab72-c82df5d82fef tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.379712 Mar 29 02:26:33.466733 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1793/3813] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:33 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:33.477600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ab7ab939-e97e-443e-b07a-c0eb9dfac4db req-fec2b975-08bd-4571-bdfc-8f3a0c8822c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "36ac7136-8916-47de-9d81-73917be95fee"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:33.479813 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:33.479813 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:33.481838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:33.490334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ab7ab939-e97e-443e-b07a-c0eb9dfac4db req-fec2b975-08bd-4571-bdfc-8f3a0c8822c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:33.493738 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a9a31fcf-e75f-455e-bf07-5c55f55baa23 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 2.138669 Mar 29 02:26:33.493877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ab7ab939-e97e-443e-b07a-c0eb9dfac4db req-fec2b975-08bd-4571-bdfc-8f3a0c8822c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:33.493968 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2021/3814] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:31 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:33.510802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ab7ab939-e97e-443e-b07a-c0eb9dfac4db req-fec2b975-08bd-4571-bdfc-8f3a0c8822c1 service nova] Creating event network-changed:36ac7136-8916-47de-9d81-73917be95fee for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:26:33.515495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ab7ab939-e97e-443e-b07a-c0eb9dfac4db req-fec2b975-08bd-4571-bdfc-8f3a0c8822c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047365 Mar 29 02:26:33.516308 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1794/3815] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:33.599407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:33.600026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:33.610929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:33.611735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:33.612768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:33.613501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:34.089192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:34.089896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:34.106556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:34.107015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:34.107797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:34.108420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:34.251260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:34.260540 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a8bb34e-f127-42c0-8bd9-cb1eaaed9278 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1279 microversion: 2.1 time: 0.175366 Mar 29 02:26:34.261145 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1795/3816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:34 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:34.435047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9ef2164b-9e6c-4e3b-ab2f-5bb7ce61b90c req-b9444c22-2d58-4344-8f61-2716fef38da8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c1b67e-5774-4151-a20e-4f0fba6162d0", "tag": "19138e39-3cad-4c89-b396-0118d8520f9a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:34.440855 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:34.440855 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:34.462314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9ef2164b-9e6c-4e3b-ab2f-5bb7ce61b90c req-b9444c22-2d58-4344-8f61-2716fef38da8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:34.463031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9ef2164b-9e6c-4e3b-ab2f-5bb7ce61b90c req-b9444c22-2d58-4344-8f61-2716fef38da8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:34.486903 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9ef2164b-9e6c-4e3b-ab2f-5bb7ce61b90c req-b9444c22-2d58-4344-8f61-2716fef38da8 service nova] Creating event network-changed:19138e39-3cad-4c89-b396-0118d8520f9a for instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 on n-h1-828148-1 Mar 29 02:26:34.492521 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9ef2164b-9e6c-4e3b-ab2f-5bb7ce61b90c req-b9444c22-2d58-4344-8f61-2716fef38da8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064553 Mar 29 02:26:34.493990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1796/3817] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:34.514484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:34.515363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:34.525693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:34.526449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:34.527239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:34.528420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:35.002899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:35.023779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:35.027465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:35.028872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd7a76af-8869-4cbc-9ddb-e7bc77c415dd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.533333 Mar 29 02:26:35.032256 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1797/3818] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:34 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:35.045905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:35.046821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:35.055080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:35.055767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:35.056740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:35.057188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:35.152157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:35.165494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-564da222-e76e-4454-a306-a63b5500311b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 1.569692 Mar 29 02:26:35.179078 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2022/3819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:33 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:35.278292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:35.279310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:35.288740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:35.289581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:35.291077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:35.291701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:35.465542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:35.475802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bccf7a87-a99a-4112-99b4-d4f57b074b21 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 0.441560 Mar 29 02:26:35.476903 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1798/3820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:35 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:36.048977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:36.049599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:36.062615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.063075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:36.063856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.064289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:36.443829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:36.460407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:36.473567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:36.474781 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5196ab3a-4278-4d3e-b3c0-8902439f21b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.429544 Mar 29 02:26:36.490856 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1799/3821] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:36 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:36.490856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:36.490856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:36.514476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.514933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:36.516033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.516677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:36.881967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:36.890870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba60e2f4-70a5-45f4-a930-a741b8d7e79d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.410222 Mar 29 02:26:36.901224 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1800/3822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:36 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:36.906477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:36.907102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:36.917188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.918085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:36.919242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:36.919908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.155404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:37.164120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-965b9769-67d6-4660-8d2a-82e65d91c5a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 1.889488 Mar 29 02:26:37.166154 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2023/3823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:35 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 1892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:37.171314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c182600a-9e50-4787-8465-953a7309bc90 req-c33c58ce-dc4d-4d05-916f-8b8581c26b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c979dc-98fa-4453-8d4a-ce8dccb438ff", "name": "network-vif-plugged", "status": "completed", "tag": "c92cd060-a06b-47a4-a8e6-3450fa3f1312"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:37.173009 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:37.173009 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:37.184205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:37.190289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c182600a-9e50-4787-8465-953a7309bc90 req-c33c58ce-dc4d-4d05-916f-8b8581c26b64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.190733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c182600a-9e50-4787-8465-953a7309bc90 req-c33c58ce-dc4d-4d05-916f-8b8581c26b64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.207439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6cb19b4-2b05-487e-8a72-c87b702e7fda tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 0.304931 Mar 29 02:26:37.207961 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1801/3824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:36 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:37.230111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c182600a-9e50-4787-8465-953a7309bc90 req-c33c58ce-dc4d-4d05-916f-8b8581c26b64 service nova] Creating event network-vif-plugged:c92cd060-a06b-47a4-a8e6-3450fa3f1312 for instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff on n-h2-828148-1 Mar 29 02:26:37.238964 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c182600a-9e50-4787-8465-953a7309bc90 req-c33c58ce-dc4d-4d05-916f-8b8581c26b64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070529 Mar 29 02:26:37.240077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2024/3825] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:37.498295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:37.499044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:37.507049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.507498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.508315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.508773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.632326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6b1bc1ce-e7c9-423f-aef5-91a9492441a4"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:37.633456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:37.641193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.641639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.642410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.642842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.698610 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:37.698610 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:37.860639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] HTTP exception thrown: Volume 6b1bc1ce-e7c9-423f-aef5-91a9492441a4 could not be found. Mar 29 02:26:37.861298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Returning 400 to user: Volume 6b1bc1ce-e7c9-423f-aef5-91a9492441a4 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:37.862137 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83b9de3b-329d-4601-b9ed-178cef4c22ec tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/1dc3d8fe-25b8-47ff-963f-45c275d78b04" status: 400 len: 107 microversion: 2.1 time: 0.447887 Mar 29 02:26:37.866167 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1802/3826] 10.222.0.36 () {60 vars in 1432 bytes} [Tue Mar 29 02:26:37 2022] PUT /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/1dc3d8fe-25b8-47ff-963f-45c275d78b04 => generated 107 bytes in 449 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:26:37.909218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:37.910761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:37.923443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.923893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:37.924665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:37.925118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.185217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:38.193657 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98b7c4eb-e6a2-4b16-91a8-11166726745b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.289989 Mar 29 02:26:38.194208 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1803/3827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:37 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:38.198888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:38.199908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:38.207228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.207779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.208917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.209576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.593306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lazy-loading 'services' on Instance uuid df6d24f0-7323-470a-86c2-849a3648bba6 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:38.868388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:38.885579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:38.897820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:38.897820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a440617a-b2ae-4597-957c-17060630117f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.394466 Mar 29 02:26:38.897820 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2025/3828] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:37 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:26:38.921314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:38.921314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:38.924019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be57dc4f-adf0-494f-8c7f-f8f57cc9aa94 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/1dc3d8fe-25b8-47ff-963f-45c275d78b04" status: 202 len: 0 microversion: 2.1 time: 0.722669 Mar 29 02:26:38.924019 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1804/3829] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:26:38 2022] DELETE /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/1dc3d8fe-25b8-47ff-963f-45c275d78b04 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:26:38.942664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:38.942664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:38.950084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.950084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.950084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.950084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.957275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.957275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:38.957275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:38.957275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.214892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:39.223591 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ae8a126-8bad-4e6a-b9e3-d40f8fcea147 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 0.303113 Mar 29 02:26:39.224164 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1805/3830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:38 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:39.229136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:39.230399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:39.239342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.240201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.240564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.241043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.313029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bb57787-faa9-4c9d-8fe7-03712969fe06 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087543 Mar 29 02:26:39.313780 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1806/3831] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:26:39 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:39.322184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:39.322789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:39.330078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.330746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.331844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.332454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.546465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:39.555293 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2057d1d-b383-445e-b3a0-a0a7017c7363 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1308 microversion: 2.1 time: 0.236488 Mar 29 02:26:39.560988 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1807/3832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:39 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:39.908272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:39.912125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:39.923986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.926499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:39.927939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:39.931051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.264596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:40.274001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6b30801-7394-46ca-bd66-386b58ced380 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 1.382973 Mar 29 02:26:40.274573 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2026/3833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:38 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:40.288285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-df0161fb-49dd-45f6-b304-88967388a1da req-8b23bce2-97f3-4104-9dc8-a500db1d5879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "name": "network-vif-plugged", "status": "completed", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:40.289982 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:40.289982 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:40.301364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-df0161fb-49dd-45f6-b304-88967388a1da req-8b23bce2-97f3-4104-9dc8-a500db1d5879 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.302276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-df0161fb-49dd-45f6-b304-88967388a1da req-8b23bce2-97f3-4104-9dc8-a500db1d5879 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.320598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-df0161fb-49dd-45f6-b304-88967388a1da req-8b23bce2-97f3-4104-9dc8-a500db1d5879 service nova] Creating event network-vif-plugged:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:26:40.329544 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-df0161fb-49dd-45f6-b304-88967388a1da req-8b23bce2-97f3-4104-9dc8-a500db1d5879 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045208 Mar 29 02:26:40.330432 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2027/3834] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:40.337751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:40.338599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:40.344996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:40.348432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.349242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.350185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.350783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.360517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:40.363070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:40.364213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01ce71d6-b739-4db9-834d-5265a525f776 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.460576 Mar 29 02:26:40.366635 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1808/3835] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:39 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:26:40.372016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:40.372824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:40.382383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.383076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.384021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.385275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.549580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lazy-loading 'services' on Instance uuid 9bc57426-c0af-4968-ae4f-8c6ceb296f3c {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:40.783090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:40.792130 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c17ed8da-b4a2-497c-8ec9-9a49a220c879 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1323 microversion: 2.1 time: 0.423851 Mar 29 02:26:40.792874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1809/3836] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:40 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1323 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:40.797577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:40.798561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:40.805932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.806378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.807264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.807691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.873078 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dd7c4fb-97c9-463a-9f94-cd9a32db0784 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079057 Mar 29 02:26:40.873623 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1810/3837] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:26:40 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:26:40.878597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:40.879320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:40.886458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.886909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.887789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.888236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.905427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c161ae04-abe3-4070-9051-a885868c2363 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments/02e060e8-1719-4fd9-b624-b76bb26dc31b" status: 202 len: 0 microversion: 2.1 time: 0.572705 Mar 29 02:26:40.908010 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2028/3838] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:26:40 2022] DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments/02e060e8-1719-4fd9-b624-b76bb26dc31b => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:26:40.930066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:40.931576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:40.940642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.941903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:40.942902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:40.943438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.030589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-526690b7-a44b-4b2e-a91a-980d296adc3f tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108535 Mar 29 02:26:41.031832 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2029/3839] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:26:40 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:41.151624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:41.160408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4c3e9d1-3e73-40d6-874d-4eda7bbd57b7 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1490 microversion: 2.1 time: 0.285705 Mar 29 02:26:41.161287 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1811/3840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:40 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1490 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:41.177514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1410052161"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:41.178639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:41.186410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.186856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.187873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.188461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.293061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:41.293727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:41.302456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.303123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.304125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.304764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.459702 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0f71679-d3bd-4526-b680-5be8396b6663 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "PUT /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1076 microversion: 2.1 time: 0.285326 Mar 29 02:26:41.470808 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2030/3841] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:26:41 2022] PUT /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1076 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:41.481026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:41.482060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:41.494744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.495259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.496623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.497148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.661812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:41.677356 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd867b67-8916-4db9-bacf-6e8daa82a5d0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 0.385215 Mar 29 02:26:41.688227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1812/3842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:41 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:41.694336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:41.695250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:41.710358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.711579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:41.714177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:41.724016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.133962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.153154 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41e3a440-0bcf-4870-96d0-794624e5656c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1502 microversion: 2.1 time: 0.463512 Mar 29 02:26:42.154279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1813/3843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:41 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:42.169041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-208345c4-d228-4be2-8c46-0b7bef700b64 req-d854571b-7549-4b12-af8a-dad7c430a9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2414f4-0514-4fcc-8262-ed3b38545e31", "tag": "55d6b32d-4b8d-4f1b-8575-e745edd91df9"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:42.172209 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:42.172209 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:42.203305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-208345c4-d228-4be2-8c46-0b7bef700b64 req-d854571b-7549-4b12-af8a-dad7c430a9e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.204008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-208345c4-d228-4be2-8c46-0b7bef700b64 req-d854571b-7549-4b12-af8a-dad7c430a9e6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.251723 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-208345c4-d228-4be2-8c46-0b7bef700b64 req-d854571b-7549-4b12-af8a-dad7c430a9e6 service nova] Creating event network-changed:55d6b32d-4b8d-4f1b-8575-e745edd91df9 for instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 on n-h2-828148-1 Mar 29 02:26:42.256815 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-208345c4-d228-4be2-8c46-0b7bef700b64 req-d854571b-7549-4b12-af8a-dad7c430a9e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100871 Mar 29 02:26:42.257444 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1814/3844] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:42.262548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:42.263229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:42.270975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.271110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.271812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.272238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.533952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.550667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c25b4e0-6579-49fa-9ef6-91a6cc5742b3 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1519 microversion: 2.1 time: 0.291205 Mar 29 02:26:42.556419 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1815/3845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:42 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1519 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:42.561529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:42.562801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:42.571649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.572429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.573468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.574111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.646905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f578303d-1c5b-4f35-a108-a67f04ae4eb2 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089000 Mar 29 02:26:42.647757 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1816/3846] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:26:42 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:26:42.652947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:42.654588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:42.665955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.670325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.671258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.673014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.706590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.727475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.729032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.730303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ffa2a6e4-753d-4393-a967-5ee388d76651 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.261563 Mar 29 02:26:42.730923 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2031/3847] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:41 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:42.741576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:42.742541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:42.756016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.756469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.757287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:42.757721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:42.816025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lazy-loading 'flavor' on Instance uuid 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:42.938344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:42.968191 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b648d6f6-4b8f-4db6-8baa-e753c081fa00 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1502 microversion: 2.1 time: 0.319006 Mar 29 02:26:42.972768 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1817/3848] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:42 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:42.983627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:42.986049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:43.003734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.004619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.006776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.009414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.216730 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96373af3-2099-492a-a019-fe473fd942da tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action" status: 200 len: 32 microversion: 2.1 time: 0.484567 Mar 29 02:26:43.217706 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2032/3849] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:26:42 2022] POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:26:43.223896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:43.224476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:43.233681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.234408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.235504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.236089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.308572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:43.313806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:26:43.317836 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72e49bdb-2227-4cd9-9215-a55d99efcd97 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 0.339749 Mar 29 02:26:43.318612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1818/3850] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:42 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:43.323497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f022a8a-9ba5-44c3-b829-cf7997af8392 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:43.331034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f022a8a-9ba5-44c3-b829-cf7997af8392 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.336230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f022a8a-9ba5-44c3-b829-cf7997af8392 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.398239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f022a8a-9ba5-44c3-b829-cf7997af8392 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Going to try to stop instance {{(pid=103514) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:26:43.698291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f675baa-8725-426a-9f67-bad14a6dee80 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 204 len: 0 microversion: 2.1 time: 0.478846 Mar 29 02:26:43.699369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2033/3851] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:26:43 2022] DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:26:43.704947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:43.705757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:43.731314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.733799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.734822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.736705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f022a8a-9ba5-44c3-b829-cf7997af8392 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "POST /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff/action" status: 202 len: 0 microversion: 2.1 time: 0.416314 Mar 29 02:26:43.738010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1819/3852] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:26:43 2022] POST /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:26:43.741479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.767623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:43.769945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:43.793211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.794559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:43.796654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:43.797192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.349760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:44.358913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1b7e65e-465b-4d93-9222-8dd1f02708f1 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1681 microversion: 2.1 time: 0.614425 Mar 29 02:26:44.359492 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1820/3853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:43 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1681 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:44.364874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:44.365675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:44.373432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.374107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.375060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.375651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.584109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:44.592875 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc7cf24f-8fe9-4347-8fa3-0ec6a2454035 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.231974 Mar 29 02:26:44.593458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1821/3854] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:44 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:44.598814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:44.599433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:44.607350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.607799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.608582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.609071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.872610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:44.882579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:44.884072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:44.885238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a58e2fa-1934-43eb-80dc-8782a0d9ea88 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.290795 Mar 29 02:26:44.885783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1822/3855] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:44 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:44.890073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4ba98d61-2190-48f4-a4ca-e467bc1d9ec3 req-e3128f47-d354-4fda-9574-4c9ea1bd9b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c1b67e-5774-4151-a20e-4f0fba6162d0", "name": "network-vif-plugged", "status": "completed", "tag": "19138e39-3cad-4c89-b396-0118d8520f9a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:44.891638 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:44.891638 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:44.899851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4ba98d61-2190-48f4-a4ca-e467bc1d9ec3 req-e3128f47-d354-4fda-9574-4c9ea1bd9b39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.900293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4ba98d61-2190-48f4-a4ca-e467bc1d9ec3 req-e3128f47-d354-4fda-9574-4c9ea1bd9b39 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.917099 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4ba98d61-2190-48f4-a4ca-e467bc1d9ec3 req-e3128f47-d354-4fda-9574-4c9ea1bd9b39 service nova] Creating event network-vif-plugged:19138e39-3cad-4c89-b396-0118d8520f9a for instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 on n-h1-828148-1 Mar 29 02:26:44.921764 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4ba98d61-2190-48f4-a4ca-e467bc1d9ec3 req-e3128f47-d354-4fda-9574-4c9ea1bd9b39 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034823 Mar 29 02:26:44.922360 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1823/3856] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:44.928076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "83e13ea4-0d15-455e-ba7f-c92bed1465bb"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:44.929255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:44.936726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.937213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.937988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:44.938425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:44.994956 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-volumes-attachments:swap failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:44.994956 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:45.059157 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] HTTP exception thrown: Volume a717ad94-1271-4722-9f34-6be68002acbc could not be found. Mar 29 02:26:45.059772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] Returning 404 to user: Volume a717ad94-1271-4722-9f34-6be68002acbc could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:45.060611 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d641e4d3-920d-4081-a5ce-d666063440f4 tempest-VolumesAdminNegativeTest-155796777 tempest-VolumesAdminNegativeTest-155796777-project-admin] 10.222.0.36 "PUT /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/a717ad94-1271-4722-9f34-6be68002acbc" status: 404 len: 109 microversion: 2.1 time: 0.137123 Mar 29 02:26:45.061205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1824/3857] 10.222.0.36 () {60 vars in 1432 bytes} [Tue Mar 29 02:26:44 2022] PUT /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6/os-volume_attachments/a717ad94-1271-4722-9f34-6be68002acbc => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:45.066139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:45.067166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:45.077195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.077900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.079144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.079744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.161077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:45.174492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d826ed1-8357-4dbd-a750-8abbb20dab8c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 1.473755 Mar 29 02:26:45.175576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2034/3858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:43 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:45.306316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:45.314697 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-653d12f9-7a3e-4590-9634-f729e0eca535 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 0.252528 Mar 29 02:26:45.315259 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1825/3859] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:45 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:45.376079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:45.376864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:45.386148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.386603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.387439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.387874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.611526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:45.613921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:45.622563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.623578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.624650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.625277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.836705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:45.845880 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8eb048db-b873-4e25-bfcf-996aba58b83d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.238760 Mar 29 02:26:45.848101 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1826/3860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:45 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:45.903833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:45.904826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:45.918582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.920028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:45.921193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:45.922309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.238771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:46.267315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:46.271958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:46.276164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-07f669c6-2831-4645-a2a0-70c41a1d0fc8 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.376107 Mar 29 02:26:46.285054 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1827/3861] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:45 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:26:46.294540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:46.295154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:46.304254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.304684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.305853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.305989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.736934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:46.744708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:46.746259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e81d9bef-0cd4-4b87-9c35-55482a9e6540 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.459885 Mar 29 02:26:46.763492 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcbaaa10-fb11-42cf-b0b4-64c4c264aa35 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1681 microversion: 2.1 time: 1.391448 Mar 29 02:26:46.764679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2035/3863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:45 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1681 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:46.769473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:46.769729 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1828/3863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:46 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:46.770572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:46.778731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.779762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.780949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.781633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.863516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:46.864318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:46.879729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.883794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:46.883794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:46.883794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:47.380792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:47.389485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cc4f8bb5-371d-4975-8657-5737bdc43d5f tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.530130 Mar 29 02:26:47.390060 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1829/3864] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:46 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:47.403881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:47.404751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:47.413465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:47.413918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:47.414758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:47.415187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:47.771185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:47.786772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:47.788289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:47.794578 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-95095e84-cde0-4f83-a6e6-6f61309d4afd tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.394204 Mar 29 02:26:47.806300 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1830/3865] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:47 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:47.806300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:47.806300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:47.813584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:47.819102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:47.819102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:47.819102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:47.903576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:47.921645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10b00625-7861-4914-8907-1932b67f8a66 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 1.155574 Mar 29 02:26:47.945353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2036/3866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:46 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:47.974972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:47.975603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:48.018447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:48.021279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:48.021279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:48.021279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:48.667114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:48.681331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d526ee7-698b-4bf0-9d8a-1dda2c673e97 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.884463 Mar 29 02:26:48.681833 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1831/3867] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:47 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:48.692193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:48.692816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:48.722753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:48.723208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:48.724022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:48.724457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:49.035453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:49.057478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26623111-8934-43fc-bef0-52169bfb2d23 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1614 microversion: 2.1 time: 1.110885 Mar 29 02:26:49.059702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2037/3868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:47 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1614 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:49.074044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:49.075596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:49.098020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:49.099729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:49.101527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:49.102258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:49.533128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:49.545308 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-295f6310-747c-4570-b989-1a5f8779a96a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.862361 Mar 29 02:26:49.546480 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1832/3869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:48 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:49.551833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:49.561828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:49.576778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:49.577562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:49.578512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:49.581821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.271316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.292701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.295430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.297149 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03e16acb-20dc-4a8a-9a95-78471da2b91f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.233748 Mar 29 02:26:50.298509 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2038/3870] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:49 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:50.303845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:50.304766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:50.318067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.318695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.319782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.320432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.385904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.400280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f945aa3-a00c-4d2c-9881-b701ee3f7bcd tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 0.851886 Mar 29 02:26:50.400899 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1833/3871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:49 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:50.411334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:50.411950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:50.430762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.431212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.431987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.435210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.840511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94452c4cc43a4e6d89e712588d9c7411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcabdc0f3f76428b941ea1620f328159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.856673 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db67ae9e-bc9e-4b6b-b5d5-fa2a9ded4a66 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 200 len: 1614 microversion: 2.1 time: 0.453678 Mar 29 02:26:50.858453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1834/3872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:50 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 1614 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:50.871919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:50.873531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:50.896241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.898361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.900339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:50.904305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.906376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.910452 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-508d0680-2da4-406f-8ac0-eeaa64813cff tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.610631 Mar 29 02:26:50.928110 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2039/3873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:50 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:50.930471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-55832816-c3e4-40fd-81ac-2ec018089977 req-2de20225-abf2-4ac3-8fe1-5b00276dcbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc57426-c0af-4968-ae4f-8c6ceb296f3c", "name": "network-vif-deleted", "tag": "f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:50.958677 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:50.958677 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:50.962222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-55832816-c3e4-40fd-81ac-2ec018089977 req-2de20225-abf2-4ac3-8fe1-5b00276dcbf6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:50.962682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-55832816-c3e4-40fd-81ac-2ec018089977 req-2de20225-abf2-4ac3-8fe1-5b00276dcbf6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:50.996404 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-55832816-c3e4-40fd-81ac-2ec018089977 req-2de20225-abf2-4ac3-8fe1-5b00276dcbf6 service nova] Creating event network-vif-deleted:f16ed7b8-46e2-4e46-b894-6ae1d8d8cd41 for instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c on n-h2-828148-1 Mar 29 02:26:51.010458 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-55832816-c3e4-40fd-81ac-2ec018089977 req-2de20225-abf2-4ac3-8fe1-5b00276dcbf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088977 Mar 29 02:26:51.011429 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2040/3874] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:51.234497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ee9d05d3-27aa-4b7a-86ff-89bd1c797f1f req-9516d461-3b8f-4b17-b178-948c9bb18fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2414f4-0514-4fcc-8262-ed3b38545e31", "name": "network-vif-plugged", "status": "completed", "tag": "55d6b32d-4b8d-4f1b-8575-e745edd91df9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:51.236918 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:51.236918 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:26:51.274547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ee9d05d3-27aa-4b7a-86ff-89bd1c797f1f req-9516d461-3b8f-4b17-b178-948c9bb18fe0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:51.288186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ee9d05d3-27aa-4b7a-86ff-89bd1c797f1f req-9516d461-3b8f-4b17-b178-948c9bb18fe0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:51.365476 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ee9d05d3-27aa-4b7a-86ff-89bd1c797f1f req-9516d461-3b8f-4b17-b178-948c9bb18fe0 service nova] Creating event network-vif-plugged:55d6b32d-4b8d-4f1b-8575-e745edd91df9 for instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 on n-h2-828148-1 Mar 29 02:26:51.372297 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ee9d05d3-27aa-4b7a-86ff-89bd1c797f1f req-9516d461-3b8f-4b17-b178-948c9bb18fe0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143354 Mar 29 02:26:51.373809 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2041/3875] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:26:51.393322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:51.407380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:51.435888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:51.435888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:51.436731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:51.437287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.028011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:52.038795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae9744e8-9cf2-416d-8e52-1a55bc692975 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 1.179048 Mar 29 02:26:52.044408 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1835/3876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:50 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:52.058574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:52.059476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:52.080686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.081322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.089484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.089935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.305583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:52.323928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:52.329345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:52.336304 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4016ff52-7c16-4434-b817-d746602cb207 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.956649 Mar 29 02:26:52.339219 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2042/3877] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:51 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:52.354063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:52.354988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:52.364487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.366857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.368276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.369087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.512697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:26:52.883305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:52.894733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d1f49b3-9d34-4e3d-99b4-114c148613c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1321 microversion: 2.1 time: 0.849112 Mar 29 02:26:52.895863 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1836/3878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:52 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:52.900551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:52.901384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:52.915937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.916921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.917924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.918773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.932104 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0608927-3348-48b0-8cdd-0014f9243de7 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "DELETE /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 204 len: 0 microversion: 2.1 time: 0.589738 Mar 29 02:26:52.933072 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2043/3879] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:26:52 2022] DELETE /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:26:52.942307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:52.948313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:52.962403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.965750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:52.965750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:52.973319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.031959 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. Mar 29 02:26:53.032946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:53.033760 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2acdbc0d-6173-4e2e-8383-4d8f454b4292 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 404 len: 111 microversion: 2.1 time: 0.136696 Mar 29 02:26:53.035506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1837/3880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:52 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:53.045532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:53.046552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:53.054825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.055662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.056663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.057547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.387365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:53.402571 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-155ee9e3-aca4-4277-a74d-9821d113f14f tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1514 microversion: 2.1 time: 0.364269 Mar 29 02:26:53.404257 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1838/3881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:53 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:53.411122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46d60e8e-4b16-475c-a261-3a502551135a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '.version_select at 0x7f872405dd30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:53.512520 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46d60e8e-4b16-475c-a261-3a502551135a tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859013923" status: 202 len: 0 microversion: 2.1 time: 0.106690 Mar 29 02:26:53.513604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1839/3882] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:26:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859013923 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:26:53.520702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:53.523068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:53.550221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.550853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.552509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.553174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.860304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:53.870692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c6605cd-0264-4f3d-8573-ab6623419fe4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.933143 Mar 29 02:26:53.871484 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2044/3883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:52 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:53.876388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:53.877047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:53.890770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.891226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:53.891978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:53.892411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.087800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.097521 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2cadfcb9-151d-45e4-922d-c1794d72092b tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.582468 Mar 29 02:26:54.098181 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1840/3884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:53 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:54.103148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:54.104238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:54.114050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.114761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.116158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.116827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.336467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.350752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.354326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.356953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56e9eca2-46e1-46d3-acc5-dcdcc344b56f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.482918 Mar 29 02:26:54.357702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2045/3885] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:53 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:54.420936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:54.421554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:54.429569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.430319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.431258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.431847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.804597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.813047 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6aae3c48-5a29-4d91-8e6f-3960275e27cb tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1514 microversion: 2.1 time: 0.395790 Mar 29 02:26:54.813852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2046/3886] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:54 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1514 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:26:54.828198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:54.837229 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6380e12b-2ab5-4b1c-b612-061d430cd9d2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1515 microversion: 2.1 time: 0.737631 Mar 29 02:26:54.837801 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1841/3887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:54 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1515 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:54.854228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:54.855221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:54.863660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.864392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.864872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.865309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.887646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:54.888443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:54.912741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.913697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.927835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:54.928481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:54.941812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'flavor' on Instance uuid 6a2414f4-0514-4fcc-8262-ed3b38545e31 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:26:55.347697 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5b224be-8800-4d56-901f-a25f09b6711c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action" status: 200 len: 32 microversion: 2.1 time: 0.497064 Mar 29 02:26:55.348483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2047/3888] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:26:54 2022] POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action => generated 32 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:26:55.359386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:55.359732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:55.368157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.368606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:55.371144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.371581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:55.805740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:55.816079 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9182efa-86dc-453a-a03f-17ad307f2734 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.462551 Mar 29 02:26:55.830019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2048/3889] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:55 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:55.830019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:55.830019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:55.832821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.833380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:55.834156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.834590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:55.902771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:55.916071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4517db3-de57-4a4c-8733-671068dc539a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 1.032308 Mar 29 02:26:55.916808 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1842/3890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:54 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:55.921789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:55.922815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:55.933066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.933710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:55.934589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:55.935156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:56.463468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:56.475700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3dbd79ef-3201-464c-bfd8-a468ecb70569 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.656902 Mar 29 02:26:56.476829 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2049/3891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:55 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:56.481657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:56.482806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:56.492228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:56.493206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:56.494209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:56.494794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:56.883209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:56.898654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:56.902895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:56.902895 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a326a036-143a-4e4b-9a02-a901a6954ce4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.983643 Mar 29 02:26:56.905601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1843/3892] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:55 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:56.916904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:56.917746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:56.927057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:56.927776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:56.929136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:56.929781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:57.151362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd1f27dbbdb4f94b83c49ae795f8285', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '539a5cfe3d62486ab34c720b5e37e46a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:57.169092 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1baad27e-c2a9-478f-a2f8-a3d510f9eace tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 200 len: 1514 microversion: 2.1 time: 0.690847 Mar 29 02:26:57.171009 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2050/3893] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:56 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 1514 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:57.178219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:57.179151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:57.189586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:57.191952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:57.193053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:57.195128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:57.482396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:57.500536 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d4cf602-611a-4ffd-a8dc-17216efc46e2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.587581 Mar 29 02:26:57.504178 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1844/3894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:56 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:57.514539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:57.515525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:57.532379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:57.533020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:57.539003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:57.539003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:58.076756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:58.090664 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99f11727-f729-4e46-a825-eb072effdd16 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.583616 Mar 29 02:26:58.092133 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1845/3895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:57 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:58.097528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-aa5bfe5d-cfd8-468d-a14c-469b798b80db req-09bf70bc-925b-421f-bebe-18871a1a6a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6d24f0-7323-470a-86c2-849a3648bba6", "name": "network-vif-deleted", "tag": "4aecb358-9ed3-4867-9e8a-a68028fb4ab8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:58.100138 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:26:58.100138 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:26:58.109531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aa5bfe5d-cfd8-468d-a14c-469b798b80db req-09bf70bc-925b-421f-bebe-18871a1a6a7f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:58.110066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aa5bfe5d-cfd8-468d-a14c-469b798b80db req-09bf70bc-925b-421f-bebe-18871a1a6a7f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:58.127143 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-aa5bfe5d-cfd8-468d-a14c-469b798b80db req-09bf70bc-925b-421f-bebe-18871a1a6a7f service nova] Creating event network-vif-deleted:4aecb358-9ed3-4867-9e8a-a68028fb4ab8 for instance df6d24f0-7323-470a-86c2-849a3648bba6 on n-h1-828148-1 Mar 29 02:26:58.133518 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-aa5bfe5d-cfd8-468d-a14c-469b798b80db req-09bf70bc-925b-421f-bebe-18871a1a6a7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039478 Mar 29 02:26:58.134838 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1846/3896] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:26:58.231896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: .version_select at 0x7f87242e9c10>, body: {"keypair": {"name": "tempest-keypair-410854583"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:26:58.239394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:58.262203 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f3364a7-60e8-4cb8-90b5-4243ddcf2d35 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 1.088535 Mar 29 02:26:58.263145 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2051/3897] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:57 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:58.275932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:58.277552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:58.302303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:58.304422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:58.305370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:58.307954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:58.310111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:58.334039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:59.020066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:26:59.037410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:26:59.055884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7eac10fd-7ef3-4e55-9331-b306c947cc2a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.919560 Mar 29 02:26:59.061330 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1847/3898] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:26:58 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:59.074077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:59.074856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] [instance: df6d24f0-7323-470a-86c2-849a3648bba6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:59.090152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.091629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.092719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.093343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.177765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] HTTP exception thrown: Instance df6d24f0-7323-470a-86c2-849a3648bba6 could not be found. Mar 29 02:26:59.183487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] Returning 404 to user: Instance df6d24f0-7323-470a-86c2-849a3648bba6 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:26:59.183487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e33b3467-04ef-46af-837b-718b5b38be42 tempest-VolumesAdminNegativeTest-2007662497 tempest-VolumesAdminNegativeTest-2007662497-project] 10.222.0.36 "GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6" status: 404 len: 111 microversion: 2.1 time: 0.121489 Mar 29 02:26:59.183487 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1848/3899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:59 2022] GET /compute/v2.1/servers/df6d24f0-7323-470a-86c2-849a3648bba6 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:26:59.186742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:59.187515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:59.213057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.218042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.218042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.218042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.258535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:59.269461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:59.271007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:59.272226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81bfadac-ecf5-49f3-bd55-0999ade9fff4 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 1.007360 Mar 29 02:26:59.277687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2052/3900] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:26:58 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:26:59.288445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:59.289484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:59.301029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.302450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.303334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.304303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.796016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:59.814052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-70223afb-695c-47b3-84e6-33d703c380e9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.632175 Mar 29 02:26:59.815983 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1849/3901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:59 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:26:59.822228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:26:59.825389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:26:59.833493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.833941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.839047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:26:59.839047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:26:59.916985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:26:59.926272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-79f07b93-7b75-4184-8c82-4abe81d275d9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.646818 Mar 29 02:26:59.929731 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2053/3902] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:59 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:00.291321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:00.293708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:00.312409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.331149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:00.331149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.331149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:00.434591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:00.450898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-610ab6f5-21c1-48ad-ab99-415cd308296e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.634144 Mar 29 02:27:00.452185 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1850/3903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:26:59 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:00.794658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:00.795513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:00.811056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.811230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:00.812592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.813412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:00.902567 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. Mar 29 02:27:00.903971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:00.905094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-720c3352-fb08-4472-9390-983c9d9d276b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 404 len: 111 microversion: 2.1 time: 0.117757 Mar 29 02:27:00.906512 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1851/3904] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:00 2022] DELETE /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:00.912474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:00.913467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:00.923335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.925848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:00.926911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:00.929443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.035695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:01.066041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:01.067660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:01.071878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-511a328d-0974-49c5-93b5-38f34dd0a1bf tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.781176 Mar 29 02:27:01.073080 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2054/3905] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:00 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:27:01.081763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:01.082383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 9bc57426-c0af-4968-ae4f-8c6ceb296f3c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:01.102074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.102528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.103317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.103754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.215895 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. Mar 29 02:27:01.227459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 9bc57426-c0af-4968-ae4f-8c6ceb296f3c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:01.228336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c99cf504-acbd-4bde-aaa6-0ef8d19f7ced tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c" status: 404 len: 111 microversion: 2.1 time: 0.153106 Mar 29 02:27:01.229105 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2055/3906] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:01 2022] GET /compute/v2.1/servers/9bc57426-c0af-4968-ae4f-8c6ceb296f3c => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:01.238798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:01.239427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:01.258458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.258911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.259706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.264357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.467403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:01.480781 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d0d01ba-08dd-41b1-b3b3-f373446d3086 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.572805 Mar 29 02:27:01.485823 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1852/3907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:00 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:01.488291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:01.488962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:01.515208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.519245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.523314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:01.523969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:01.963459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:01.974329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1374f1af-ad6e-4bb2-aba6-4eef0c0d0c08 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.744159 Mar 29 02:27:01.986209 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2056/3908] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:01 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:02.090982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:02.091662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:02.112541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:02.112541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:02.112541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:02.112541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:02.198384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:02.245419 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-359358f3-2cfa-496d-9abc-f02ab7fc8e4f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.751419 Mar 29 02:27:02.245419 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1853/3909] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:01 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:02.500923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:02.502218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:02.516085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:02.518299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:02.525256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:02.546498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:02.672244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:02.691347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:02.696609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:02.696609 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8affc7b-f631-42d1-827e-0134d010af7c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.606791 Mar 29 02:27:02.696609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2057/3910] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:02 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:02.978579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:02.990628 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5e2db734-f49f-449d-92ae-c8b85086ea16 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.493030 Mar 29 02:27:02.992871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:02.994029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:03.001474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.002764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.002897 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1854/3911] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:02 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:03.003887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.004382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.256008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:03.257603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:03.266066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.266826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.267847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.268515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.635991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:03.645528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6623b780-755d-4222-9d1a-9b2a61553896 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.393655 Mar 29 02:27:03.663314 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1855/3912] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:03 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:03.716568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:03.717528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:03.728462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:03.731022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.731698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.732670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:03.733329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:03.745072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e93ea66f-10f7-46f1-a968-98292f747064 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.754394 Mar 29 02:27:03.750309 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2058/3913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:02 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:04.009097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:04.010412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:04.018593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.019034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.020798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.021260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.034347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:04.043603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:04.045105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:04.046200 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99a20469-0754-4834-b5fa-485c2b35f52d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.336586 Mar 29 02:27:04.046737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1856/3914] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:03 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:04.566219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:04.577487 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-82d03372-0b29-4430-9819-568103359969 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.573157 Mar 29 02:27:04.593212 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2059/3915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:04 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:04.681329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:04.682654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:04.695857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.697482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.699375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.699960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.762469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:04.763534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:04.771689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.772131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.773066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:04.773503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:04.962905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:04.975857 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d0c2b68-e3a5-4922-bb20-3387f31ea828 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.299013 Mar 29 02:27:04.977873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1857/3916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:04 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:05.031593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-312453148", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb7c7d33-536f-4e4c-b35d-fb43c69f7bc9"}], "security_groups": [{"name": "tempest-securitygroup--2040314063"}], "key_name": "tempest-keypair-410854583", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:05.066052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:05.078031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d501c73-a791-4975-a1f2-59fb636b0603 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.319109 Mar 29 02:27:05.078594 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2060/3917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:04 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:05.083865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:05.090724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:05.092623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.093648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.094866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.095558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.171462 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. Mar 29 02:27:05.172191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:05.173089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-855e04f4-ee2f-4b65-b139-dc43c18987be tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 404 len: 111 microversion: 2.1 time: 0.093525 Mar 29 02:27:05.174386 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2061/3918] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:05 2022] DELETE /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:05.178434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:05.179057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:05.186410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.186856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.187628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.188422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.369631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] validate_networks() for [('fb7c7d33-536f-4e4c-b35d-fb43c69f7bc9', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:27:05.802903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:05.815374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:05.817269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:05.826551 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9322dac-53e6-41e6-8d8f-e47df2c72346 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.643730 Mar 29 02:27:05.826551 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2062/3919] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:05 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:05.832064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:05.832679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: f947f40e-8500-48ed-b12c-7e32a8e8b4c6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:05.840264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.840728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.841514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.841944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.902258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. Mar 29 02:27:05.902870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance f947f40e-8500-48ed-b12c-7e32a8e8b4c6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:05.903956 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f17bb9f4-e7fe-4623-b326-d1a0337e73f3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6" status: 404 len: 111 microversion: 2.1 time: 0.084089 Mar 29 02:27:05.904869 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2063/3920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:05 2022] GET /compute/v2.1/servers/f947f40e-8500-48ed-b12c-7e32a8e8b4c6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:05.909507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:05.910127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:05.919896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.920377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:05.929322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:05.929787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.088337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:27:06.088815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:27:06.090724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:27:06.091150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:27:06.091574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:27:06.101146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.101593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.102385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.102814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.122387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:06.129281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:06.143172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:27:06.145927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:27:06.308690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36c19039-70e9-4f1b-9c50-f879836c1d01 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.281013 Mar 29 02:27:06.309906 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1858/3921] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:27:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:27:06.315354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.315921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.324293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.326125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.327146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.327721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.383045 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. Mar 29 02:27:06.383717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:06.384856 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f7b0303d-671e-4f22-abaf-261fc84f23d3 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 404 len: 111 microversion: 2.1 time: 0.073503 Mar 29 02:27:06.385515 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1859/3922] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:06 2022] DELETE /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:06.390406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:06.390899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.391162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.399527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.399683 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc78ca4a-5b15-4792-b969-f9d30f1fcccf tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.493669 Mar 29 02:27:06.400105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.402386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.402386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.402969 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2064/3923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:05 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:06.408821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.410098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.420278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.421455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.422469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.423121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.651522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:06.661086 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1adba815-7853-4350-97ae-5596d4183988 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.274506 Mar 29 02:27:06.661937 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1860/3924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:06 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:06.666525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a0c8430-165f-4baf-b6e4-246b8067ffae tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.667405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a0c8430-165f-4baf-b6e4-246b8067ffae tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.744641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a0c8430-165f-4baf-b6e4-246b8067ffae tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:06.752828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a0c8430-165f-4baf-b6e4-246b8067ffae tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1236 microversion: 2.1 time: 0.089661 Mar 29 02:27:06.753811 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1861/3925] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:06 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:06.758309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.758918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: ed3eebc6-e934-4947-9eec-edd26d59cb81] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.767274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.768397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.769273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.769801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.781102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:06.789837 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad1767ef-f274-4f85-865f-7d186f802284 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.384914 Mar 29 02:27:06.790703 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2065/3926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:06 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:06.822371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. Mar 29 02:27:06.822986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance ed3eebc6-e934-4947-9eec-edd26d59cb81 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:06.823820 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d03d0e24-6439-46dc-b8d1-b86cf41f01d7 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81" status: 404 len: 111 microversion: 2.1 time: 0.069079 Mar 29 02:27:06.824642 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1862/3927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:06 2022] GET /compute/v2.1/servers/ed3eebc6-e934-4947-9eec-edd26d59cb81 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:06.837545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:06.838164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:06.846383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.846789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:06.847812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:06.848247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:07.005256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-16af7863-0c04-4823-a710-4aecbeec4ef5 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.180487 Mar 29 02:27:07.005932 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2066/3928] 10.222.0.36 () {58 vars in 1127 bytes} [Tue Mar 29 02:27:06 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 29 02:27:07.023367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f43edeac-738b-4b33-9ce0-c7e32301e497 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Calling method '.version_select at 0x7f8724c6dd30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.056328 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f43edeac-738b-4b33-9ce0-c7e32301e497 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] HTTP exception thrown: Image not found. Mar 29 02:27:07.057267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f43edeac-738b-4b33-9ce0-c7e32301e497 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:07.058259 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f43edeac-738b-4b33-9ce0-c7e32301e497 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.046795 Mar 29 02:27:07.059082 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2067/3929] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Mar 29 02:27:07 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:07.069253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad74ff70-0c12-4c5d-a8b2-ad7fef9e8e50 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Calling method '.version_select at 0x7f87240d5310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.094589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ad74ff70-0c12-4c5d-a8b2-ad7fef9e8e50 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] HTTP exception thrown: Image not found. Mar 29 02:27:07.095199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad74ff70-0c12-4c5d-a8b2-ad7fef9e8e50 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:07.096304 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad74ff70-0c12-4c5d-a8b2-ad7fef9e8e50 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/9827b939-5ede-46fe-b100-7f5099bca5bj" status: 404 len: 62 microversion: 2.1 time: 0.031376 Mar 29 02:27:07.096904 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2068/3930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:07 2022] DELETE /compute/v2.1/images/9827b939-5ede-46fe-b100-7f5099bca5bj => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 29 02:27:07.108106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b5768df-68f9-4344-b99e-e0380bfb9e3b tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Calling method '.version_select at 0x7f8724172ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.129562 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-6b5768df-68f9-4344-b99e-e0380bfb9e3b tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] HTTP exception thrown: Image not found. Mar 29 02:27:07.130181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b5768df-68f9-4344-b99e-e0380bfb9e3b tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:07.131294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b5768df-68f9-4344-b99e-e0380bfb9e3b tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/275f4a90-88c6-49eb-a68a-738d68a8967c1" status: 404 len: 62 microversion: 2.1 time: 0.028900 Mar 29 02:27:07.132250 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2069/3931] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:07 2022] DELETE /compute/v2.1/images/275f4a90-88c6-49eb-a68a-738d68a8967c1 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:07.145175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f778a6e-f80c-4097-830c-c48827798c98 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Calling method '.version_select at 0x7f8724c6d430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.193118 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-3f778a6e-f80c-4097-830c-c48827798c98 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] HTTP exception thrown: Image not found. Mar 29 02:27:07.195255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f778a6e-f80c-4097-830c-c48827798c98 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:07.196179 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f778a6e-f80c-4097-830c-c48827798c98 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/tempest-invalid-1578133023" status: 404 len: 62 microversion: 2.1 time: 0.059059 Mar 29 02:27:07.200670 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2070/3932] 10.222.0.36 () {58 vars in 1205 bytes} [Tue Mar 29 02:27:07 2022] DELETE /compute/v2.1/images/tempest-invalid-1578133023 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:07.220160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b51ddbc-399d-4178-b8ef-2050dd44fc85 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Calling method '.version_select at 0x7f8724172a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.245450 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2b51ddbc-399d-4178-b8ef-2050dd44fc85 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] HTTP exception thrown: Image not found. Mar 29 02:27:07.246056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b51ddbc-399d-4178-b8ef-2050dd44fc85 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] Returning 404 to user: Image not found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:07.246883 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b51ddbc-399d-4178-b8ef-2050dd44fc85 tempest-ImagesDeleteNegativeTestJSON-288763604 tempest-ImagesDeleteNegativeTestJSON-288763604-project] 10.222.0.36 "DELETE /compute/v2.1/images/1a31fa08-c467-415e-8da9-2f27a9d83f14" status: 404 len: 62 microversion: 2.1 time: 0.030721 Mar 29 02:27:07.247443 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2071/3933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:07 2022] DELETE /compute/v2.1/images/1a31fa08-c467-415e-8da9-2f27a9d83f14 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:07.320331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:07.332125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:07.333837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:07.335152 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-545b2dc5-36d1-4a5e-ade0-701f50364ef6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.501844 Mar 29 02:27:07.336018 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1863/3934] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:06 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:27:07.419463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.420801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:07.434610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:07.435290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:07.436128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:07.436574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:07.693658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:07.693658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:07.710138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:07.710138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:07.710138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:07.710138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:07.999866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.008294 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d041716-3dc9-4fa9-b148-91bcb0b9ad9a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.333505 Mar 29 02:27:08.014384 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1864/3935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:07 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:08.020432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:08.021367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:08.030871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.031536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.034023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.034903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.091628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.107181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2fcbc437-52fb-49ee-b755-1ab9af9660be tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.691403 Mar 29 02:27:08.107696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2072/3936] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:07 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:08.122381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:08.123000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:08.138843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.139299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.140093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.140523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.180872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.192963 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a13cef6-acdd-4d4a-b604-4c992de843d5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1232 microversion: 2.1 time: 0.182551 Mar 29 02:27:08.194068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1865/3937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:08 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1232 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:08.354375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:08.354977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:08.363945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.364712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.366566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:08.367276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:08.540829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.554694 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-042ea4ce-a75d-4383-a989-dc036f0b412a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.445978 Mar 29 02:27:08.555524 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2073/3938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:08 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:08.746167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.760762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.762646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:08.763938 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fc322b3-d4f8-491c-8921-75bccaff9d9a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.413534 Mar 29 02:27:08.769384 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1866/3939] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:08 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:27:09.027535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.028707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.038036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.041573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.041573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.041573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.124588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.126160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.138939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.139680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.141330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.145118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.339293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:09.350642 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96506ced-6ed0-4803-a95b-6f16fcf2801e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.329045 Mar 29 02:27:09.361050 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2074/3940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:09.366306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.367170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.375210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.375920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.376945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.377547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.558871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:09.571223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c72eb129-eeb0-4e51-9e14-889666e449de tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1306 microversion: 2.1 time: 0.208799 Mar 29 02:27:09.573354 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2075/3941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1306 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:09.591145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.591145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.596932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.597589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.599059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.599661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.654195 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. Mar 29 02:27:09.655084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:09.656078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da581dcf-14aa-48b6-90b3-29b0f165fcb5 tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 404 len: 111 microversion: 2.1 time: 0.071840 Mar 29 02:27:09.657204 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2076/3942] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:09 2022] DELETE /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:09.661656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.662487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.670171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.670824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.671776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.672363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.761024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:09.772131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a3bee41-4002-44fc-9741-cc9ba7ff90cd tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1512 microversion: 2.1 time: 0.651245 Mar 29 02:27:09.788067 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1867/3943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:09.798420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.805571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] [instance: 51a4869d-3270-4784-ba92-e6dd6f6c5908] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.817322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.819870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.821189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.821790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.883551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] HTTP exception thrown: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. Mar 29 02:27:09.884623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] Returning 404 to user: Instance 51a4869d-3270-4784-ba92-e6dd6f6c5908 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:09.886723 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c0669b7a-9cfd-40d5-9cc7-baebeec2456b tempest-AttachVolumeNegativeTest-1976902448 tempest-AttachVolumeNegativeTest-1976902448-project] 10.222.0.36 "GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908" status: 404 len: 111 microversion: 2.1 time: 0.092451 Mar 29 02:27:09.887933 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1868/3944] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/51a4869d-3270-4784-ba92-e6dd6f6c5908 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:09.893371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:09.894233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:09.902576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.903563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:09.904601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:09.905287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:10.011137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:10.020394 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27db5ba8-4e80-400c-af8e-a0c012ca34a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.361975 Mar 29 02:27:10.021853 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2077/3945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:10.367738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:10.368604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:10.388193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:10.388931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:10.389902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:10.390648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:10.724020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:10.740022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:10.742347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:10.746965 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4fd97272-c4a3-4a5a-93d7-7c75fd3d2973 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.857745 Mar 29 02:27:10.747538 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1869/3946] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:09 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:10.866507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:10.884427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0122fe2-9bdc-4bef-98e3-a3b00b48b95a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.519975 Mar 29 02:27:10.885722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2078/3947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:10 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:10.890544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:10.892569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:10.901461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:10.902491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:10.904340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:10.905013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:10.947720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1310353895", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:11.064176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:27:11.121540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:11.147290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5f797bc-2c82-4b5c-9e72-0d6fdbe4e9ca tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1294 microversion: 2.1 time: 0.260298 Mar 29 02:27:11.157162 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2079/3948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:10 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1294 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:11.157162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:11.157578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:11.167370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:11.167818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:11.168975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:11.169316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:11.560775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:11.570802 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2793cb3-8c51-4260-a51e-f7ea61356bb0 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1489 microversion: 2.1 time: 0.417416 Mar 29 02:27:11.571374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2080/3949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:11 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1489 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:11.576381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:11.577195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:11.585098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:11.585900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:11.586957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:11.587565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.119590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:27:12.120953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:27:12.121698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:27:12.122321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:27:12.126553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:27:12.138055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.138607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.139576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.140035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.162870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Getting quotas for project 11766dc0c6e5418995cd62f1e49d6fca. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:12.171537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Getting quotas for user 1af0ccd3b29149d1902080b82581a292 and project 11766dc0c6e5418995cd62f1e49d6fca. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:12.190613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:27:12.195126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:27:12.197235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:12.207229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3637a93e-ac9a-458e-8fc2-c50be7a54bab tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.634666 Mar 29 02:27:12.219705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2081/3950] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:11 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:12.219705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2055398739"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:12.219705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:12.233218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.233951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.234924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.235372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.343415 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aa67fcb3-4c0c-4be7-a03c-2b5f47d7aa09 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584478 Mar 29 02:27:12.348441 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1870/3951] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:27:12.366959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:12.367939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:12.379754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.381925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.386919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.386919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.570180 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc20a213-1497-4c49-9020-1548a3d68291 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "PUT /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1062 microversion: 2.1 time: 0.357378 Mar 29 02:27:12.571768 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2082/3952] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:27:12 2022] PUT /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1062 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:12.585350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:12.585965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:12.611196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.611612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:12.614815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:12.614815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.136321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.156376 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87122488-8a22-4363-88da-7d868d4d323f tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1525 microversion: 2.1 time: 0.582956 Mar 29 02:27:13.159646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2083/3953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:12 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1525 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:13.163050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:13.163982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:13.184658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.192698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.192698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.192698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.318633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.328668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.330237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.331413 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a353845-34b7-4a6e-9094-34f0d09a478f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.981459 Mar 29 02:27:13.331973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1871/3954] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:12 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:13.346960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-613ce640-7d63-441a-b8ff-291929de5cc9 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:13.347721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-613ce640-7d63-441a-b8ff-291929de5cc9 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:13.469163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-613ce640-7d63-441a-b8ff-291929de5cc9 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.478732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-613ce640-7d63-441a-b8ff-291929de5cc9 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1216 microversion: 2.1 time: 0.145138 Mar 29 02:27:13.483481 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1872/3955] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:13 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:13.491739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:13.492433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:13.502927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.503651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.505219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.505808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.723562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.732016 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a98da4e7-24cd-4614-91ad-ad1470334185 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.573426 Mar 29 02:27:13.732813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2084/3956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:13 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:13.737516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:13.738123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:13.745468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.745912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.746682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.748418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:13.961631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:13.973624 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4677258b-ad56-414b-a9ef-da590720cdee tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1489 microversion: 2.1 time: 0.492977 Mar 29 02:27:13.983246 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1873/3957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:13 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1489 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:13.990087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:13.991021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:13.999061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:13.999810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.000636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.001099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.413719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:14.422871 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36c4b11f-eda0-45c1-81be-a67cd4ba325e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.688751 Mar 29 02:27:14.426534 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2085/3958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:13 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:14.438033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:14.439683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:14.449222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.450034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.451093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.451858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.739127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:14.760233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:14.772399 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e6beb34b-0c04-45ee-8717-18cf3ecc85bb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1505 microversion: 2.1 time: 0.344659 Mar 29 02:27:14.773454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a905a78-4f66-46b5-bd51-086fd2cc5b0e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1489 microversion: 2.1 time: 0.785927 Mar 29 02:27:14.773598 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2086/3959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:14 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:14.776124 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1874/3960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:13 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1489 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:14.788516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:14.790441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:14.802757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.803044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.803748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.804641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.806675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:14.811423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:14.831351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.832094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:14.833127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:14.833763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:15.062281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:15.077003 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88bd27d6-e2a8-453d-93ef-bc2cc435d672 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1268 microversion: 2.1 time: 0.299614 Mar 29 02:27:15.078234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1875/3961] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:14 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1268 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:15.082743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:15.095976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:15.104456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:15.105387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:15.107451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:15.108151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:15.659067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:15.679835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:15.685265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:15.688276 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1216a60b-d2a4-44cc-b173-ce2814fc4f71 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.912093 Mar 29 02:27:15.691394 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2087/3962] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:14 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:15.703150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:15.703902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:15.711648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:15.712908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:15.713375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:15.713965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:15.796806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:27:16.076671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:16.093125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c2556506-54f8-4a12-a34d-2ca227a6e34c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 1.014105 Mar 29 02:27:16.094029 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1876/3963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:15 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:16.099073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-809beb52-e97b-4a32-900d-9375a25ec0fb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'create', calling method: .version_select at 0x7f8725e0b670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-330345055", "description": "tempest-description-1993638259"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:16.303777 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ab1b558-7c01-4d22-96fc-fc875a9d09de tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 204 len: 0 microversion: 2.1 time: 0.610771 Mar 29 02:27:16.305578 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2088/3964] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:15 2022] DELETE /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:27:16.312714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:16.313394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:16.327219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:16.327871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:16.329816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:16.330361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:16.817445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:16.829277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1a95f80-a20f-47fa-8902-7171a449e099 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.522284 Mar 29 02:27:16.830527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2089/3965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:16 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:16.838952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-fbcdf0ef-6a01-41bb-9eda-a71cc1794061 req-2a30d3ea-a423-4692-a223-fbb31c58b749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bcada5-07ad-40f0-964c-d303c7d91936", "tag": "113d9942-8b7b-493d-a56c-6b4d4ee6aac5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:16.841037 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:16.841037 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:16.856797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fbcdf0ef-6a01-41bb-9eda-a71cc1794061 req-2a30d3ea-a423-4692-a223-fbb31c58b749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:16.857577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-fbcdf0ef-6a01-41bb-9eda-a71cc1794061 req-2a30d3ea-a423-4692-a223-fbb31c58b749 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:16.876899 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-fbcdf0ef-6a01-41bb-9eda-a71cc1794061 req-2a30d3ea-a423-4692-a223-fbb31c58b749 service nova] Creating event network-changed:113d9942-8b7b-493d-a56c-6b4d4ee6aac5 for instance b4bcada5-07ad-40f0-964c-d303c7d91936 on n-h1-828148-1 Mar 29 02:27:16.882437 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-fbcdf0ef-6a01-41bb-9eda-a71cc1794061 req-2a30d3ea-a423-4692-a223-fbb31c58b749 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050456 Mar 29 02:27:16.883606 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2090/3966] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:16.891839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:16.892821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:16.902142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:16.902870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:16.910377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:16.911286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.106033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-809beb52-e97b-4a32-900d-9375a25ec0fb tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.010862 Mar 29 02:27:17.108660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1877/3967] 10.222.0.36 () {60 vars in 1179 bytes} [Tue Mar 29 02:27:16 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:17.116659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:17.116858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:17.117298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:17.124663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.125389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.125743 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb7c6ee9-8d28-4c90-a768-8e4de506c9b4 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1274 microversion: 2.1 time: 0.239989 Mar 29 02:27:17.126530 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2091/3968] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:16 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:17.126756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.127347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.140216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:17.140907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:17.149042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.149481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.150240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.150661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.587576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:17.597305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-73c9b422-c1cd-4863-8ad0-548ddd249795 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1495 microversion: 2.1 time: 0.489651 Mar 29 02:27:17.598506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1878/3969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:17 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1495 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:17.621104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:17.621414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:17.636248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.636699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.640130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.664724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.836093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:17.853603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:17.855631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:17.856973 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9b0abdb-dd06-4439-87f5-4296c67a1f64 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.720264 Mar 29 02:27:17.857574 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2092/3970] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:17 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:17.862765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-330345055"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:17.863679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:17.876638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.876638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:17.876638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:17.876638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:18.266796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:18.284546 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fffd8348-21f8-4dde-b200-9fa60bb9465b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.679335 Mar 29 02:27:18.297725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1879/3971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:17 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:18.320729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:18.321615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:18.340266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:18.341026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:18.341987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:18.342675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:18.859131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Adding security group ab05361b-40be-4d63-8e69-38ce21f30378 to port ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 Mar 29 02:27:19.049580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:19.064405 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa78650e-899e-4a33-8694-71b803de7017 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.758914 Mar 29 02:27:19.064405 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1880/3972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:18 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:19.064405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b2b4ba35-86d5-4f31-ac2c-0e5641bad425 req-b311ced9-4b8b-4fcd-8906-b4b7496751e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "5439bc8e-6127-445f-b123-cba37ea6e3fc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:19.066553 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:19.066553 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:19.075559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b2b4ba35-86d5-4f31-ac2c-0e5641bad425 req-b311ced9-4b8b-4fcd-8906-b4b7496751e2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:19.076147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b2b4ba35-86d5-4f31-ac2c-0e5641bad425 req-b311ced9-4b8b-4fcd-8906-b4b7496751e2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:19.095250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b2b4ba35-86d5-4f31-ac2c-0e5641bad425 req-b311ced9-4b8b-4fcd-8906-b4b7496751e2 service nova] Creating event network-vif-plugged:5439bc8e-6127-445f-b123-cba37ea6e3fc for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:19.101112 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b2b4ba35-86d5-4f31-ac2c-0e5641bad425 req-b311ced9-4b8b-4fcd-8906-b4b7496751e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040905 Mar 29 02:27:19.102127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1881/3973] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:19.107914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:19.108748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:19.117102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:19.117854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:19.118824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:19.119411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:19.937833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:19.957470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ab2703b-47fe-462b-b886-cabaf4d3bafb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.853898 Mar 29 02:27:19.960554 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1882/3974] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:19 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:19.974335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:19.974970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:19.997192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:19.999448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.000163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:20.000629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.169973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:20.191817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e65107ce-d4d8-4c61-abb6-75e02f36c27e tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 200 len: 1453 microversion: 2.1 time: 0.228966 Mar 29 02:27:20.197939 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1883/3975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:19 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:20.209926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:20.210671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:20.222175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:20.222786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.223674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:20.224265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.845049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:20.859667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:20.872937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:20.874417 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc696a08-2539-4dbf-b52c-69137ddab525 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.671699 Mar 29 02:27:20.875017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1884/3976] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:20 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:20.880003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:20.882241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:20.902293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:20.903050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.903772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:20.904213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:20.989620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-117de120-336c-48b7-bd4b-7ebdd2d623f2 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action" status: 202 len: 0 microversion: 2.1 time: 3.129730 Mar 29 02:27:20.992332 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2093/3977] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:17 2022] POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action => generated 0 bytes in 3133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:20.996897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:20.997685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:21.015664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.016371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:21.018572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.018572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:21.451903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:21.467741 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4e3abb5-733f-4549-96d8-f11f98075616 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.591535 Mar 29 02:27:21.481003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1885/3978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:20 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:21.487387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-60b45e11-5b08-4aea-810f-ff8ed96e7cf4 req-8657fd91-fa96-4cec-b87c-15e40ae6b241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03c979dc-98fa-4453-8d4a-ce8dccb438ff", "name": "network-vif-deleted", "tag": "c92cd060-a06b-47a4-a8e6-3450fa3f1312"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:21.489301 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:21.489301 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:21.499934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-60b45e11-5b08-4aea-810f-ff8ed96e7cf4 req-8657fd91-fa96-4cec-b87c-15e40ae6b241 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.500770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-60b45e11-5b08-4aea-810f-ff8ed96e7cf4 req-8657fd91-fa96-4cec-b87c-15e40ae6b241 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:21.521772 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-60b45e11-5b08-4aea-810f-ff8ed96e7cf4 req-8657fd91-fa96-4cec-b87c-15e40ae6b241 service nova] Creating event network-vif-deleted:c92cd060-a06b-47a4-a8e6-3450fa3f1312 for instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff on n-h2-828148-1 Mar 29 02:27:21.528706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-60b45e11-5b08-4aea-810f-ff8ed96e7cf4 req-8657fd91-fa96-4cec-b87c-15e40ae6b241 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044935 Mar 29 02:27:21.529960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1886/3979] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:21.536217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:21.537361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:21.547211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.548997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:21.550044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.559357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:21.967919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:21.981574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01670d74-144d-40c2-b4c2-fac2148c154d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.989084 Mar 29 02:27:21.983894 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2094/3980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:20 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:21.990128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-330345055"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:21.993552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:21.999096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:21.999631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.000405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.000864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.113996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:22.130116 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3196660d-de8e-46e5-9874-f4a052443121 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.598352 Mar 29 02:27:22.130896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1887/3981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:21 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:22.135455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "23ae4153-d36c-4180-8450-7828198b373d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:22.138443 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:22.138443 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:22.152956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.155109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.193247 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] Creating event network-vif-plugged:d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:22.197429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] Creating event network-vif-plugged:23ae4153-d36c-4180-8450-7828198b373d for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:22.209442 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-262d3be7-26e0-4fc5-8b37-95d196d299f8 req-52fe03c8-a166-49f3-9c13-1ba84e9cc5ca service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077085 Mar 29 02:27:22.210567 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1888/3982] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:22.217263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:22.217970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:22.228192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.229058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.230522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.230522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.317874 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. Mar 29 02:27:22.318721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:22.320438 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31029b78-675a-43b1-bf53-df90d93301f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 404 len: 111 microversion: 2.1 time: 0.107843 Mar 29 02:27:22.328915 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1889/3983] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:22 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:22.340737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:22.341556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:22.351039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.351402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.352120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:22.352716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:22.459571 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Removing security group ab05361b-40be-4d63-8e69-38ce21f30378 from port ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 Mar 29 02:27:22.966054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:22.982958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:22.990863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:22.990863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50f5a797-3744-46d8-b469-8f95ad910568 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.664613 Mar 29 02:27:22.990863 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1890/3984] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:22 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:22.994617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:22.995644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:23.007004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.007878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.009937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.010722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.287574 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. Mar 29 02:27:23.292751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:23.292751 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d7cf708-382f-4665-bcb6-bb20ceef55e8 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 404 len: 111 microversion: 2.1 time: 0.299772 Mar 29 02:27:23.292751 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1891/3985] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:22 2022] DELETE /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:23.294487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:23.295095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:23.302426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.302884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.303675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.304092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.517722 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60a7a33f-3e06-4cc8-a9b1-8b5d1f8b7cc5 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action" status: 202 len: 0 microversion: 2.1 time: 1.531292 Mar 29 02:27:23.518197 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2095/3986] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:21 2022] POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:23.522925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:23.523581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:23.540880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.541627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.542903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.543666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.873221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:23.893243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc2f5f65-332f-4d82-8b52-84a61145a0b1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1521 microversion: 2.1 time: 0.373047 Mar 29 02:27:23.895549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2096/3987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:23 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:23.900476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:23.901318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:23.926677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.927183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.927993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.928431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.934140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:23.947044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fda0a681-bb61-4631-bca9-9be8034b54f3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.655395 Mar 29 02:27:23.948154 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1892/3988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:23 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:23.954620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:23.955357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 03c979dc-98fa-4453-8d4a-ce8dccb438ff] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:23.963223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.963794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:23.964919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:23.965457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:24.023068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. Mar 29 02:27:24.029691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 03c979dc-98fa-4453-8d4a-ce8dccb438ff could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:24.029691 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f1caf90-b2c7-43a2-bf83-1b797b64398a tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff" status: 404 len: 111 microversion: 2.1 time: 0.075074 Mar 29 02:27:24.029691 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1893/3989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:23 2022] GET /compute/v2.1/servers/03c979dc-98fa-4453-8d4a-ce8dccb438ff => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:24.032353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c223e044-09e4-469f-8b07-f6d83dadcc14 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'create', calling method: .version_select at 0x7f8724d4da60>, body: {"pool": null} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:24.419944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:24.429362 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b58ba8c-7d56-44ec-8f5d-38cc61a01226 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.532434 Mar 29 02:27:24.439436 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2097/3990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:23 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:24.439436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}, {"name": "network-changed", "server_uuid": "8bb9d0dd-d01b-416c-a60a-346654fca3db", "tag": "cdd4e98b-2def-44ad-9b34-890b4374a169"}, {"name": "network-changed", "server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:24.439436 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:24.439436 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:24.447378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:24.447893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:24.466685 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Creating event network-changed:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:27:24.466918 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Creating event network-changed:cdd4e98b-2def-44ad-9b34-890b4374a169 for instance 8bb9d0dd-d01b-416c-a60a-346654fca3db on n-h2-828148-1 Mar 29 02:27:24.467489 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] Creating event network-changed:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:27:24.476629 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f724ef4c-5b35-4549-92fa-6181d2daa23e req-4a07f5ad-36af-40a1-9eda-06895b6368d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.045113 Mar 29 02:27:24.477890 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2098/3991] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:24.483834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:24.484527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:24.504168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:24.504621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:24.505569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:24.505898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.038933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:25.050683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:25.052622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:25.053792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-419c41e3-ddca-4e22-b004-c118c5439cae tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.574970 Mar 29 02:27:25.054494 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2099/3992] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:24 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:25.061285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:25.062091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:25.070259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.070703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.071471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.072033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.126732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. Mar 29 02:27:25.127575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:25.128554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-28bb500a-e3a3-4b0a-b271-342d4a997743 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 404 len: 111 microversion: 2.1 time: 0.070729 Mar 29 02:27:25.129595 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2100/3993] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:25 2022] DELETE /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:25.134435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "15ceead5-ba63-4d0c-aa69-fe1a873c1813"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "36ac7136-8916-47de-9d81-73917be95fee"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "a3943a15-704e-4b26-9b7c-ce42e87e288b"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-plugged", "status": "completed", "tag": "cffc250d-42d3-48de-875e-040ce109f7cd"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:25.136760 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:25.136760 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:25.145547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.146175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.165033 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Creating event network-vif-plugged:15ceead5-ba63-4d0c-aa69-fe1a873c1813 for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:25.165540 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Creating event network-vif-plugged:36ac7136-8916-47de-9d81-73917be95fee for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:25.166096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Creating event network-vif-plugged:a3943a15-704e-4b26-9b7c-ce42e87e288b for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:25.166594 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] Creating event network-vif-plugged:cffc250d-42d3-48de-875e-040ce109f7cd for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:25.172155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-dd21fab7-7998-4e98-a772-77d9cdc99e4e req-6144202b-c50d-452a-95a3-d51cd321cffc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041119 Mar 29 02:27:25.173889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2101/3994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:25.180168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:25.181245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:25.189890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.190826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.198910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.199603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.697549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c824aee7-882a-433f-bad5-bd57ba1c3ec1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1501 microversion: 2.1 time: 0.537409 Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2102/3995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:25 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1501 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:25.843208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.153213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:26.165168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1ca0b9d-0c6e-4623-832b-bc4841e46426 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.446960 Mar 29 02:27:26.165982 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2103/3996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:25 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:26.170521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:26.171122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 305ce8f3-8864-420d-80ef-67c0816603aa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:26.179538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.185142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.185142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.185142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.256408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. Mar 29 02:27:26.257365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 305ce8f3-8864-420d-80ef-67c0816603aa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:26.258547 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a814125-57f3-4e91-b5ac-615b10d7d4f9 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa" status: 404 len: 111 microversion: 2.1 time: 0.091472 Mar 29 02:27:26.260092 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2104/3997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:26 2022] GET /compute/v2.1/servers/305ce8f3-8864-420d-80ef-67c0816603aa => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:26.265486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:26.266546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:26.276008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.276910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.278475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.279426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.520740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:26.530144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72c00d1b-031f-400e-8746-72574816ee10 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.268485 Mar 29 02:27:26.531051 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2105/3998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:26 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:26.536293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:26.536991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:26.544613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.545395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.546251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.546813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.775059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:26.784590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe7b80d1-c139-49ed-a7f3-574d46cd62cf tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1516 microversion: 2.1 time: 0.252246 Mar 29 02:27:26.785251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2106/3999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:26 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:26.797223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:26.797223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:26.798406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.798860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:26.799636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:26.800070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.061626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:27.073060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:27.074937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:27.076133 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b13724ac-201e-4c1a-aceb-d1efe87ffee2 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1874 microversion: 2.42 time: 0.289960 Mar 29 02:27:27.076718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2107/4000] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:26 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1874 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:27.085959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:27.086583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.094521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.095132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.095938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.096420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.147323 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. Mar 29 02:27:27.147323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:27.148292 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f218d041-bebb-4c6c-9446-b1e7b4e75497 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 404 len: 111 microversion: 2.1 time: 0.066114 Mar 29 02:27:27.148952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2108/4001] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:27 2022] DELETE /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:27.153497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7ca71bc-c81b-48dd-a2da-e3673226cdc4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:27.154839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e7ca71bc-c81b-48dd-a2da-e3673226cdc4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 0e245e17-ae45-4ce1-b326-bbc33ca42177] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.162013 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e7ca71bc-c81b-48dd-a2da-e3673226cdc4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Instance 0e245e17-ae45-4ce1-b326-bbc33ca42177 could not be found. Mar 29 02:27:27.162713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7ca71bc-c81b-48dd-a2da-e3673226cdc4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 404 to user: Instance 0e245e17-ae45-4ce1-b326-bbc33ca42177 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:27.163526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7ca71bc-c81b-48dd-a2da-e3673226cdc4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/0e245e17-ae45-4ce1-b326-bbc33ca42177/action" status: 404 len: 111 microversion: 2.1 time: 0.013853 Mar 29 02:27:27.168491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2109/4002] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:27 2022] POST /compute/v2.1/servers/0e245e17-ae45-4ce1-b326-bbc33ca42177/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:27.174514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:27.175458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 527416f8-471f-4abb-8ee7-b57f66e146fc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.188730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.188730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.188730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.188730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.252499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. Mar 29 02:27:27.253093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 527416f8-471f-4abb-8ee7-b57f66e146fc could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:27.253911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-497ea9b3-c8c0-4ec3-8bfd-ccc1e0f716f6 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc" status: 404 len: 111 microversion: 2.1 time: 0.084429 Mar 29 02:27:27.254440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2110/4003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:27 2022] GET /compute/v2.1/servers/527416f8-471f-4abb-8ee7-b57f66e146fc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:27.262570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:27.263095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.270756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.271198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.271955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.272384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.623264 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e03e9729-11b3-4045-9a1d-ebceed1307a4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action" status: 202 len: 0 microversion: 2.1 time: 0.363888 Mar 29 02:27:27.627182 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2111/4004] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:27 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:27.630853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:27.631617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.640031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.640493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.641344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.641784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.906645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:27.917118 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68137dce-77b3-41c1-8a43-2c25a5d24404 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.291219 Mar 29 02:27:27.928800 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2112/4005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:27 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:27.934501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-de9fb42e-adfc-467a-b70d-f8c23179a8a0 req-ddb5e83a-ab7f-4a9b-a689-9f233bc61147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bcada5-07ad-40f0-964c-d303c7d91936", "name": "network-vif-plugged", "status": "completed", "tag": "113d9942-8b7b-493d-a56c-6b4d4ee6aac5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:27.937948 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:27.937948 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:27.950376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-de9fb42e-adfc-467a-b70d-f8c23179a8a0 req-ddb5e83a-ab7f-4a9b-a689-9f233bc61147 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.950983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-de9fb42e-adfc-467a-b70d-f8c23179a8a0 req-ddb5e83a-ab7f-4a9b-a689-9f233bc61147 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.968361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-de9fb42e-adfc-467a-b70d-f8c23179a8a0 req-ddb5e83a-ab7f-4a9b-a689-9f233bc61147 service nova] Creating event network-vif-plugged:113d9942-8b7b-493d-a56c-6b4d4ee6aac5 for instance b4bcada5-07ad-40f0-964c-d303c7d91936 on n-h1-828148-1 Mar 29 02:27:27.975031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-de9fb42e-adfc-467a-b70d-f8c23179a8a0 req-ddb5e83a-ab7f-4a9b-a689-9f233bc61147 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044687 Mar 29 02:27:27.976426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2113/4006] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:27.981349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:27.982944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:27.991084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.991791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:27.993048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:27.994090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.055523 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. Mar 29 02:27:28.056156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:28.057207 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-76491ead-a4b3-48cb-9c9d-a4115854ea9c tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 404 len: 111 microversion: 2.1 time: 0.079640 Mar 29 02:27:28.061129 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2114/4007] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:27 2022] DELETE /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:28.066877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:28.067767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:28.076663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.076663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.077614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.078208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.408764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:28.417277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb2cdd21-c798-48f5-b53b-26323a178829 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.354756 Mar 29 02:27:28.418183 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2115/4008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:28 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:28.431412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:28.432408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:28.439743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.440194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.442006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.442006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.639905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:28.649057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-daeecb5c-abaa-4f93-b8f4-fdd37ffbeae1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1501 microversion: 2.1 time: 0.229945 Mar 29 02:27:28.661575 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2116/4009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:28 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:28.661575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:28.661575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 7beb6d84-1989-4aff-86dd-0025ee52ed07] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:28.665273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.671334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.671334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.671334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.731964 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. Mar 29 02:27:28.732572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 7beb6d84-1989-4aff-86dd-0025ee52ed07 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:28.733427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-77953f5d-3804-427f-94ba-ec36ca061668 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07" status: 404 len: 111 microversion: 2.1 time: 0.082536 Mar 29 02:27:28.734332 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2117/4010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:28 2022] GET /compute/v2.1/servers/7beb6d84-1989-4aff-86dd-0025ee52ed07 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:28.739055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:28.739661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:28.746992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.747431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:28.748351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:28.748773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.102533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:29.112291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:29.113833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:29.115023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2fdc0d2d-dded-485b-80e2-68700563fb50 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2834 microversion: 2.42 time: 0.379638 Mar 29 02:27:29.125170 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2118/4011] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:28 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2834 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:29.125170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:29.125170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.129391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.129834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.130793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.131224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.190916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'flavor' on Instance uuid d6c1b67e-5774-4151-a20e-4f0fba6162d0 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:27:29.240426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Cannot 'rescue' instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 while it is in vm_state paused Mar 29 02:27:29.241152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 409 to user: Cannot 'rescue' instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 while it is in vm_state paused {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:29.242196 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-14f66c3d-7263-468b-9d74-e854d6bee837 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action" status: 409 len: 144 microversion: 2.1 time: 0.125632 Mar 29 02:27:29.242773 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2119/4012] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:29 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action => generated 144 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:29.247107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:29.247596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.255555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.255998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.256907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.257333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.310898 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. Mar 29 02:27:29.311498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:29.312313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-793f9248-5140-4d2c-9c9d-38375d85245d tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 404 len: 111 microversion: 2.1 time: 0.068652 Mar 29 02:27:29.316385 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2120/4013] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:29 2022] DELETE /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:29.329286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:29.329286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.329471 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c223e044-09e4-469f-8b07-f6d83dadcc14 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.298956 Mar 29 02:27:29.329978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.329978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.330538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.330964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.333524 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1894/4014] 10.222.0.36 () {60 vars in 1169 bytes} [Tue Mar 29 02:27:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:29.338911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:29.339596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.347505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.348121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.348921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.349419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.551983 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c067bf9-32e5-4514-ad39-570507aec1b3 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.216786 Mar 29 02:27:29.552570 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1895/4015] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:27:29 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba/os-interface => generated 1832 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:29.562789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:29.563867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.571606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.572055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.572854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.573303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.819246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:29.827553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e965e943-557f-4992-8619-fc489c612403 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1362 microversion: 2.1 time: 0.510068 Mar 29 02:27:29.828116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2121/4016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:29 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:29.836958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:29.836958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 58040cdd-dbaa-4b7c-b436-ef0992f7e282] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.840082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.845017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.845017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.845017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.894873 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. Mar 29 02:27:29.895614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 58040cdd-dbaa-4b7c-b436-ef0992f7e282 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:29.896553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3d2ed61-c666-43d8-903f-508e4620fe92 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282" status: 404 len: 111 microversion: 2.1 time: 0.067484 Mar 29 02:27:29.900241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2122/4017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:29 2022] GET /compute/v2.1/servers/58040cdd-dbaa-4b7c-b436-ef0992f7e282 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:29.905416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.66"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:29.907268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.915614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.916054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.916826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.917459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.936672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63aca0c9-60c7-4dd4-9795-65d647e6ef3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action" status: 202 len: 0 microversion: 2.1 time: 0.378074 Mar 29 02:27:29.942735 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1896/4018] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:29 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:29.944479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:29.945756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:29.954836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.955550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.956523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:29.957003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:29.983833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Acquired lock "refresh_cache-0a1b6a41-715b-4ba4-88e8-d2239629ccc2" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:27:30.526608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:30.534875 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d6ec327-cf6b-456f-b70c-665e115d9e0a tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.595668 Mar 29 02:27:30.535453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1897/4019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:29 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:30.551488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:30.554845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:30.561897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:30.563357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:30.564315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:30.564628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:30.631984 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. Mar 29 02:27:30.632512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:30.633388 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c818fddd-f455-4196-a674-8727fb377621 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 404 len: 111 microversion: 2.1 time: 0.096809 Mar 29 02:27:30.636787 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1898/4020] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:30 2022] DELETE /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:30.640254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:30.640493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:30.649331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:30.649786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:30.650575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:30.651013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.077419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:31.087626 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-015da696-fca6-4d77-ac8c-a46864cf45f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1516 microversion: 2.1 time: 0.452176 Mar 29 02:27:31.095501 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1899/4021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:30 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1516 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:31.095501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fd5e226e-a5f6-4ec9-b040-332e05691cfd req-e5747114-a4ba-4b66-9c5a-60bb91584a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9d0dd-d01b-416c-a60a-346654fca3db", "name": "network-vif-plugged", "status": "completed", "tag": "cdd4e98b-2def-44ad-9b34-890b4374a169"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:31.095501 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:31.095501 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:31.122202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd5e226e-a5f6-4ec9-b040-332e05691cfd req-e5747114-a4ba-4b66-9c5a-60bb91584a61 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:31.122655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd5e226e-a5f6-4ec9-b040-332e05691cfd req-e5747114-a4ba-4b66-9c5a-60bb91584a61 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.168265 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fd5e226e-a5f6-4ec9-b040-332e05691cfd req-e5747114-a4ba-4b66-9c5a-60bb91584a61 service nova] Creating event network-vif-plugged:cdd4e98b-2def-44ad-9b34-890b4374a169 for instance 8bb9d0dd-d01b-416c-a60a-346654fca3db on n-h2-828148-1 Mar 29 02:27:31.176029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fd5e226e-a5f6-4ec9-b040-332e05691cfd req-e5747114-a4ba-4b66-9c5a-60bb91584a61 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086430 Mar 29 02:27:31.177289 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1900/4022] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:31.182840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:31.183732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 59f1e724-6f07-435a-8fc7-8dd2d218eb12] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:31.192627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:31.193103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.193887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:31.194321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.278426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. Mar 29 02:27:31.279316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 59f1e724-6f07-435a-8fc7-8dd2d218eb12 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:31.280245 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fc78951d-fc4d-4e8a-8c8b-9fb246e82bd3 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12" status: 404 len: 111 microversion: 2.1 time: 0.101707 Mar 29 02:27:31.280804 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1901/4023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:31 2022] GET /compute/v2.1/servers/59f1e724-6f07-435a-8fc7-8dd2d218eb12 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:31.289390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:31.290005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:31.298682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:31.300105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.300235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:31.300660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:31.970893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:31.991132 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4306a239-714c-455b-9fab-b68629333ff2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1548 microversion: 2.1 time: 0.706112 Mar 29 02:27:32.003379 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1902/4024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:31 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1548 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:32.008406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9a7bd36-a520-4748-904e-2ea9a98eaa22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:32.010206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9a7bd36-a520-4748-904e-2ea9a98eaa22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:32.017037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e9a7bd36-a520-4748-904e-2ea9a98eaa22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. Mar 29 02:27:32.017641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9a7bd36-a520-4748-904e-2ea9a98eaa22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:32.018711 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9a7bd36-a520-4748-904e-2ea9a98eaa22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec" status: 404 len: 111 microversion: 2.1 time: 0.013977 Mar 29 02:27:32.019610 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1903/4025] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:32 2022] DELETE /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:32.025077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:32.025698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:32.036068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.036551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.037351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.037839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.276364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:32.288565 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cfe676cf-bf03-4491-a461-5977e0c8654e tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1316 microversion: 2.1 time: 0.266647 Mar 29 02:27:32.289397 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1904/4026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:32 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:32.294823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:32.295370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:32.307126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.307587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.309037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.309606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.518522 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ab0944c-8731-44bd-8a31-f4295bf64de5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227907 Mar 29 02:27:32.525497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1905/4027] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:27:32 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:32.525497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20a8f540-6b38-491c-bfb5-4c9a16f2a385 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:32.525497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20a8f540-6b38-491c-bfb5-4c9a16f2a385 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:32.535224 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-20a8f540-6b38-491c-bfb5-4c9a16f2a385 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. Mar 29 02:27:32.536571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20a8f540-6b38-491c-bfb5-4c9a16f2a385 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:32.537780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20a8f540-6b38-491c-bfb5-4c9a16f2a385 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec" status: 404 len: 111 microversion: 2.1 time: 0.016862 Mar 29 02:27:32.542141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1906/4028] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:32 2022] GET /compute/v2.1/servers/e9bbe278-3fa2-4ff9-ba5e-8fd64a5f98ec => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:32.548302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-17b20fd3-a849-4ba8-aae6-fd1db5a5d09d req-ba7e9e5b-070b-4cee-b24f-bd89da45281c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "tag": "5439bc8e-6127-445f-b123-cba37ea6e3fc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:32.550300 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:32.550300 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:32.560914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-17b20fd3-a849-4ba8-aae6-fd1db5a5d09d req-ba7e9e5b-070b-4cee-b24f-bd89da45281c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.561514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-17b20fd3-a849-4ba8-aae6-fd1db5a5d09d req-ba7e9e5b-070b-4cee-b24f-bd89da45281c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.583177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-17b20fd3-a849-4ba8-aae6-fd1db5a5d09d req-ba7e9e5b-070b-4cee-b24f-bd89da45281c service nova] Creating event network-changed:5439bc8e-6127-445f-b123-cba37ea6e3fc for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:27:32.589463 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-17b20fd3-a849-4ba8-aae6-fd1db5a5d09d req-ba7e9e5b-070b-4cee-b24f-bd89da45281c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045646 Mar 29 02:27:32.590565 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1907/4029] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:32.597082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:32.597794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:32.650430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.650981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.652374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:32.652768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:32.786172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:27:33.198584 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-684a5c13-fe7d-4303-88ec-c76164c34e22 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 204 len: 0 microversion: 2.1 time: 0.606104 Mar 29 02:27:33.205661 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1908/4030] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:32 2022] DELETE /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:27:33.212269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:33.214025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:33.243196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:33.243657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:33.244450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:33.250955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:33.692665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:33.708918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fb86699-5d34-4acd-be11-260901033550 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1480 microversion: 2.1 time: 0.501638 Mar 29 02:27:33.709666 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1909/4031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:33 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1480 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:33.724174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:33.725116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:33.735948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:33.740912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:33.740912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:33.740912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:34.506148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:27:34.920861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:34.931018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af7ed3ed-7a21-4495-a9d4-ac9a4097de43 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1466 microversion: 2.1 time: 1.219949 Mar 29 02:27:34.934301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1910/4032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:33 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1466 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:34.945067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:34.951564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:34.962312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:34.966982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:34.967826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:34.968472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:35.029586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'flavor' on Instance uuid d6c1b67e-5774-4151-a20e-4f0fba6162d0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:27:35.409614 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c9929b6-5d06-426b-8458-57db236905f6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action" status: 200 len: 32 microversion: 2.1 time: 0.473298 Mar 29 02:27:35.410341 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1911/4033] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:34 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action => generated 32 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:27:35.419622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-939869e1-02fc-4f0a-bab3-ab097a746f27 req-d21bc284-693b-4795-90f4-ca95ba2fedf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:35.430453 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:35.430453 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:35.443946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-939869e1-02fc-4f0a-bab3-ab097a746f27 req-d21bc284-693b-4795-90f4-ca95ba2fedf9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:35.444386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-939869e1-02fc-4f0a-bab3-ab097a746f27 req-d21bc284-693b-4795-90f4-ca95ba2fedf9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:35.490596 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-939869e1-02fc-4f0a-bab3-ab097a746f27 req-d21bc284-693b-4795-90f4-ca95ba2fedf9 service nova] Creating event network-changed:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:27:35.495401 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-939869e1-02fc-4f0a-bab3-ab097a746f27 req-d21bc284-693b-4795-90f4-ca95ba2fedf9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079674 Mar 29 02:27:35.496138 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1912/4034] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:35.501810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:35.514186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:35.522127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:35.523057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:35.523515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:35.524040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:36.958904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Updating instance_info_cache with network_info: [{"id": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6", "address": "fa:16:3e:8b:72:3e", "network": {"id": "8b33351c-6eaf-4e79-b73a-4270ff8cd867", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1238486971-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6bd1bdc45f7b49d793ec358f4b9c1797", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapebe3664e-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:27:37.038630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f9c4272809f40bb9bd72d426340581c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6df2a3fdc322462b9efa2b63c348d28c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:37.047425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Releasing lock "refresh_cache-0a1b6a41-715b-4ba4-88e8-d2239629ccc2" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:27:37.050053 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1aaeeb1e-3871-4eba-8cfc-99ff3367911c tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action" status: 202 len: 0 microversion: 2.1 time: 7.146903 Mar 29 02:27:37.055669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2123/4035] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:29 2022] POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action => generated 0 bytes in 7150 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:27:37.055826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd66613d-749a-488d-8285-b2fd8abfac33 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 200 len: 1480 microversion: 2.1 time: 1.553258 Mar 29 02:27:37.055826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1913/4036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:35 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 1480 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:37.058985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:37.060097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:37.070039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.070286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:37.070558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:37.071296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.072575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.073555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.089826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.091297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.092111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.092556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.229940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:27:37.621014 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4138ad47-bc2d-4564-9b99-bd7b355892ed tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 204 len: 0 microversion: 2.1 time: 0.556445 Mar 29 02:27:37.621599 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2124/4037] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:37 2022] DELETE /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:27:37.627754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6168daa0-82ff-4aa1-a771-5a716238ca83 req-9d266c8e-454b-4cb4-ae2d-268e3a4f99ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4bcada5-07ad-40f0-964c-d303c7d91936", "tag": "113d9942-8b7b-493d-a56c-6b4d4ee6aac5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:37.629331 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:37.629331 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:37.642955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6168daa0-82ff-4aa1-a771-5a716238ca83 req-9d266c8e-454b-4cb4-ae2d-268e3a4f99ff service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.648317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6168daa0-82ff-4aa1-a771-5a716238ca83 req-9d266c8e-454b-4cb4-ae2d-268e3a4f99ff service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.690225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6168daa0-82ff-4aa1-a771-5a716238ca83 req-9d266c8e-454b-4cb4-ae2d-268e3a4f99ff service nova] Creating event network-changed:113d9942-8b7b-493d-a56c-6b4d4ee6aac5 for instance b4bcada5-07ad-40f0-964c-d303c7d91936 on n-h1-828148-1 Mar 29 02:27:37.698394 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6168daa0-82ff-4aa1-a771-5a716238ca83 req-9d266c8e-454b-4cb4-ae2d-268e3a4f99ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075392 Mar 29 02:27:37.705415 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2125/4038] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:37.714538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.66"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:37.755742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:37.775217 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec80b3fd-b046-4767-93c8-b2813204e1c4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.721467 Mar 29 02:27:37.775816 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1914/4039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:37 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:37.784585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-84b2b93a-916c-476c-9bee-057ddca03bd2 req-0ed0e4e4-22ca-4a04-a002-54744fd9e109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2337d514-cf06-40a1-9234-0cd27ead41f7", "name": "network-vif-deleted", "tag": "457b5f5b-ce5f-4030-9a74-0ebf3133fce0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:37.786174 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:37.786174 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:37.804640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-84b2b93a-916c-476c-9bee-057ddca03bd2 req-0ed0e4e4-22ca-4a04-a002-54744fd9e109 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.805116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-84b2b93a-916c-476c-9bee-057ddca03bd2 req-0ed0e4e4-22ca-4a04-a002-54744fd9e109 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.834615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-84b2b93a-916c-476c-9bee-057ddca03bd2 req-0ed0e4e4-22ca-4a04-a002-54744fd9e109 service nova] Creating event network-vif-deleted:457b5f5b-ce5f-4030-9a74-0ebf3133fce0 for instance 2337d514-cf06-40a1-9234-0cd27ead41f7 on n-h2-828148-1 Mar 29 02:27:37.851655 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-84b2b93a-916c-476c-9bee-057ddca03bd2 req-0ed0e4e4-22ca-4a04-a002-54744fd9e109 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074572 Mar 29 02:27:37.852621 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1915/4040] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:27:37.857804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:37.858510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:37.872414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.872893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.873681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.874119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.969752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:37.978324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.979107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:37.980388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:37.981090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:38.511621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Acquired lock "refresh_cache-0a1b6a41-715b-4ba4-88e8-d2239629ccc2" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Mar 29 02:27:38.919526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:38.930080 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf28988b-fc9a-43d2-983f-4183ed35a4bc tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1472 microversion: 2.1 time: 1.067625 Mar 29 02:27:38.930080 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1916/4041] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:37 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1472 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:38.939698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:38.954407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] [instance: 2337d514-cf06-40a1-9234-0cd27ead41f7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:38.970884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:38.970884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:38.970884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:38.970884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:39.113037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] HTTP exception thrown: Instance 2337d514-cf06-40a1-9234-0cd27ead41f7 could not be found. Mar 29 02:27:39.113037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] Returning 404 to user: Instance 2337d514-cf06-40a1-9234-0cd27ead41f7 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:39.113037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d88af610-95a2-4d19-8f16-7153c30a18f2 tempest-ServersTestJSON-641742162 tempest-ServersTestJSON-641742162-project] 10.222.0.36 "GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7" status: 404 len: 111 microversion: 2.1 time: 0.181553 Mar 29 02:27:39.124070 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1917/4042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:38 2022] GET /compute/v2.1/servers/2337d514-cf06-40a1-9234-0cd27ead41f7 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:39.124070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:39.124070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:39.143746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:39.144207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:39.151021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:39.151021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:39.878531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:39.888901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a30a8b11-e61c-4831-ac67-216ce9a1d1ec tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.770794 Mar 29 02:27:39.889784 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1918/4043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:39 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:39.944081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:39.945058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:39.963787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:39.964124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:39.966170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:39.967885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:40.707288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:40.715681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5d1f3a2-7efa-45ec-a166-74dc8a408ebf tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1472 microversion: 2.1 time: 0.780794 Mar 29 02:27:40.716487 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1919/4044] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:39 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1472 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:40.911670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:40.911670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:40.919628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:40.920339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:40.921303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:40.922449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:41.163814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:41.174885 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a6a4c25-5375-46cb-8c3a-c9f7dadfbedb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.268315 Mar 29 02:27:41.175911 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1920/4045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:40 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:41.485609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Building network info cache for instance {{(pid=103513) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1847}} Mar 29 02:27:41.556967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1ad29b9e-2ed3-4b25-8d0e-4c36d86d8b65 req-2d9ed085-e527-4a85-ad10-7339da3a0a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:41.559011 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:41.559011 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:41.576186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ad29b9e-2ed3-4b25-8d0e-4c36d86d8b65 req-2d9ed085-e527-4a85-ad10-7339da3a0a86 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:41.580134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ad29b9e-2ed3-4b25-8d0e-4c36d86d8b65 req-2d9ed085-e527-4a85-ad10-7339da3a0a86 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:41.623776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1ad29b9e-2ed3-4b25-8d0e-4c36d86d8b65 req-2d9ed085-e527-4a85-ad10-7339da3a0a86 service nova] Creating event network-changed:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:27:41.631432 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1ad29b9e-2ed3-4b25-8d0e-4c36d86d8b65 req-2d9ed085-e527-4a85-ad10-7339da3a0a86 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077943 Mar 29 02:27:41.634883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1921/4046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:27:41.734937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:41.735950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:41.751288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:41.751885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:41.752658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:41.753123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:42.004421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1af0ccd3b29149d1902080b82581a292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11766dc0c6e5418995cd62f1e49d6fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:42.013411 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7e690fd-d2e8-4c45-a88f-3b749d559246 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 200 len: 1430 microversion: 2.1 time: 0.283461 Mar 29 02:27:42.017154 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1922/4047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:41 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 1430 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:42.193197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:42.197800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:42.207889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:42.211872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:42.212914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:42.213533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:42.740177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:42.752163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-55d81222-d958-4e26-bb09-a020b848befa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.562985 Mar 29 02:27:42.752752 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1923/4048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:42 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:43.001117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Updating instance_info_cache with network_info: [{"id": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6", "address": "fa:16:3e:8b:72:3e", "network": {"id": "8b33351c-6eaf-4e79-b73a-4270ff8cd867", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1238486971-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6bd1bdc45f7b49d793ec358f4b9c1797", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapebe3664e-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "meta": {"delegate_create": true}}] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:27:43.008730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Releasing lock "refresh_cache-0a1b6a41-715b-4ba4-88e8-d2239629ccc2" {{(pid=103513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Mar 29 02:27:43.011279 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b51079df-fe9c-4d21-8dfd-2f27f308e17e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action" status: 202 len: 0 microversion: 2.1 time: 5.304565 Mar 29 02:27:43.019195 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2126/4049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:37 2022] POST /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2/action => generated 0 bytes in 5313 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Mar 29 02:27:43.027858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63c0c075-bd95-48b9-88ad-ca7a5ecb0780 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '.version_select at 0x7f87240d5280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:43.055850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:43.057095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:43.084544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.088516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.090010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.090607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.194603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. Mar 29 02:27:43.197653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.198674 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a62abdc4-9c13-4c59-8955-5aed970cb8a8 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 404 len: 111 microversion: 2.1 time: 0.166243 Mar 29 02:27:43.199390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2127/4050] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:43 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:43.209348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-900102377", "metadata": {"image_type": "test"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:43.210648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:43.224879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.225657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.226590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.227030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.291712 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. Mar 29 02:27:43.292557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.293531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-67f4ad90-12b6-41af-8fca-d867b4dfa9d7 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "POST /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db/action" status: 404 len: 111 microversion: 2.1 time: 0.088407 Mar 29 02:27:43.294395 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2128/4051] 10.222.0.36 () {60 vars in 1278 bytes} [Tue Mar 29 02:27:43 2022] POST /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db/action => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:43.319175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b578629-aa3a-4700-9c6c-791fb636721b tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-968280601", "metadata": {"image_type": "test"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:43.321316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8b578629-aa3a-4700-9c6c-791fb636721b tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Failed to fetch instance by id tempest-invalid-1407017241 {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:27:43.323885 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8b578629-aa3a-4700-9c6c-791fb636721b tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance tempest-invalid-1407017241 could not be found. Mar 29 02:27:43.327038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b578629-aa3a-4700-9c6c-791fb636721b tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance tempest-invalid-1407017241 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.337861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8b578629-aa3a-4700-9c6c-791fb636721b tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "POST /compute/v2.1/servers/tempest-invalid-1407017241/action" status: 404 len: 101 microversion: 2.1 time: 0.028861 Mar 29 02:27:43.346931 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2129/4052] 10.222.0.36 () {60 vars in 1248 bytes} [Tue Mar 29 02:27:43 2022] POST /compute/v2.1/servers/tempest-invalid-1407017241/action => generated 101 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:43.364699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fbdd92e-a61d-42ae-98d8-dd9dfe3b68ea tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2046913800"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:43.366035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fbdd92e-a61d-42ae-98d8-dd9dfe3b68ea tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:27:43.366713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-7fbdd92e-a61d-42ae-98d8-dd9dfe3b68ea tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 29 02:27:43.367430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fbdd92e-a61d-42ae-98d8-dd9dfe3b68ea tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.369089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7fbdd92e-a61d-42ae-98d8-dd9dfe3b68ea tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011625 Mar 29 02:27:43.369795 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2130/4053] 10.222.0.36 () {60 vars in 1274 bytes} [Tue Mar 29 02:27:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:43.380912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-404376d8-bfcf-40fa-a3ba-b20e3fa98aeb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-301340405"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:43.383963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-404376d8-bfcf-40fa-a3ba-b20e3fa98aeb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2819}} Mar 29 02:27:43.383963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-404376d8-bfcf-40fa-a3ba-b20e3fa98aeb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Mar 29 02:27:43.386243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-404376d8-bfcf-40fa-a3ba-b20e3fa98aeb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.387231 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-404376d8-bfcf-40fa-a3ba-b20e3fa98aeb tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.011444 Mar 29 02:27:43.387944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2131/4054] 10.222.0.36 () {60 vars in 1280 bytes} [Tue Mar 29 02:27:43 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:43.398845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:43.400445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:43.427356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.427806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.428596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.429117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.522224 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. Mar 29 02:27:43.523083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.524344 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51ac226a-6bd0-4f9e-b10e-860e3480b1b2 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 404 len: 111 microversion: 2.1 time: 0.130654 Mar 29 02:27:43.525559 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2132/4055] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:43 2022] DELETE /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:27:43.539633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:43.540770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] [instance: 8bb9d0dd-d01b-416c-a60a-346654fca3db] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:43.559724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.560253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.561432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.562470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.668686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] HTTP exception thrown: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. Mar 29 02:27:43.669318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] Returning 404 to user: Instance 8bb9d0dd-d01b-416c-a60a-346654fca3db could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:43.675560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f30d8611-6c8a-4845-a6ab-5e9a9d28be22 tempest-ImagesNegativeTestJSON-1649784119 tempest-ImagesNegativeTestJSON-1649784119-project] 10.222.0.36 "GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db" status: 404 len: 111 microversion: 2.1 time: 0.145102 Mar 29 02:27:43.677348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2133/4056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:43 2022] GET /compute/v2.1/servers/8bb9d0dd-d01b-416c-a60a-346654fca3db => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:27:43.717340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cd3ca3a1-0793-4408-b880-427a8bc94b53 req-6560be21-1371-4990-9d5a-74fe4f95af8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bb9d0dd-d01b-416c-a60a-346654fca3db", "name": "network-vif-deleted", "tag": "cdd4e98b-2def-44ad-9b34-890b4374a169"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:43.719037 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:43.719037 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:27:43.733433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cd3ca3a1-0793-4408-b880-427a8bc94b53 req-6560be21-1371-4990-9d5a-74fe4f95af8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.734383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cd3ca3a1-0793-4408-b880-427a8bc94b53 req-6560be21-1371-4990-9d5a-74fe4f95af8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.766223 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cd3ca3a1-0793-4408-b880-427a8bc94b53 req-6560be21-1371-4990-9d5a-74fe4f95af8d service nova] Creating event network-vif-deleted:cdd4e98b-2def-44ad-9b34-890b4374a169 for instance 8bb9d0dd-d01b-416c-a60a-346654fca3db on n-h2-828148-1 Mar 29 02:27:43.771280 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cd3ca3a1-0793-4408-b880-427a8bc94b53 req-6560be21-1371-4990-9d5a-74fe4f95af8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058107 Mar 29 02:27:43.772360 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2134/4057] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:27:43.777995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:43.778690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:43.787164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.787831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:43.788606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:43.789062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:44.058845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:44.071212 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3682e911-0e28-4b31-9260-ec585adc08b4 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.297279 Mar 29 02:27:44.080690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2135/4058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:43 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:45.098272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:45.098272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:45.098272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:45.098272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:45.102228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:45.102228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:45.501313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:45.511977 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b91aac35-3870-4e70-8d88-c1353d08194b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.428437 Mar 29 02:27:45.513649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2136/4059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:45 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:45.675966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1542954374", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:45.788423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:27:45.789018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:27:45.789549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:27:45.790030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:27:45.790521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:27:45.800188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:45.800722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:45.801646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:45.802153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:45.823641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Getting quotas for project 2b9df080e97e4750989b490d3654017b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:45.829761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Getting quotas for user e8f9d617207a40fbb7b65f04331c3d0c and project 2b9df080e97e4750989b490d3654017b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:45.842336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:27:45.845486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:27:45.974827 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25c8ea6c-f71a-4a34-b140-0b403dd922d5 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.437621 Mar 29 02:27:45.986084 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2137/4060] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 29 02:27:45.991373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:45.991999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:46.104658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:46.119110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:46.121556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:46.123646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5aa6f41e-f795-4394-84fa-89c8dfb5910c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1278 microversion: 2.57 time: 0.135456 Mar 29 02:27:46.125094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2138/4061] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:45 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:46.341238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63c0c075-bd95-48b9-88ad-ca7a5ecb0780 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "DELETE /compute/v2.1/os-floating-ips/4803bbba-69cc-44ab-b9c5-0e2bf0201ec2" status: 202 len: 0 microversion: 2.1 time: 3.317517 Mar 29 02:27:46.342703 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1924/4062] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:27:43 2022] DELETE /compute/v2.1/os-floating-ips/4803bbba-69cc-44ab-b9c5-0e2bf0201ec2 => generated 0 bytes in 3319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:46.350747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-586f0053-f5a9-41fe-bb27-8c7e09a1c24a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '.version_select at 0x7f87240d5af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:46.537021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:46.537021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:46.557010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:46.557010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:46.557010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:46.557010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:46.810797 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-586f0053-f5a9-41fe-bb27-8c7e09a1c24a tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "DELETE /compute/v2.1/os-security-groups/ab05361b-40be-4d63-8e69-38ce21f30378" status: 202 len: 0 microversion: 2.1 time: 0.456140 Mar 29 02:27:46.822737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2139/4063] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Mar 29 02:27:46 2022] DELETE /compute/v2.1/os-security-groups/ab05361b-40be-4d63-8e69-38ce21f30378 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:46.822737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:46.822737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:46.831302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:46.852938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:46.852938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:46.852938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:46.916217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:27:47.157747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:47.182472 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36780092-a13f-47cc-9ae0-532faad943f8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.647260 Mar 29 02:27:47.197003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1925/4064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:46 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:47.197003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:47.197003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:47.276401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:47.295475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:47.297281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:47.297281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb9a7b2e-2d76-4c5b-8db8-309ccc21115c tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1278 microversion: 2.57 time: 0.111294 Mar 29 02:27:47.309239 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1926/4065] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:47 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:47.410809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a48a36ba-4fe0-41a9-98b5-3af260f776be tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 204 len: 0 microversion: 2.1 time: 0.582425 Mar 29 02:27:47.410809 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2140/4066] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:27:46 2022] DELETE /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:27:47.415588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:47.415588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:47.436610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:47.436610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:47.436610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:47.436610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:47.829788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e979deef-ebdb-46f6-a56a-e244779fc053 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8724c6daf0>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:47.838900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e979deef-ebdb-46f6-a56a-e244779fc053 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Mar 29 02:27:47.838900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e979deef-ebdb-46f6-a56a-e244779fc053 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:47.838900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e979deef-ebdb-46f6-a56a-e244779fc053 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.292443 Mar 29 02:27:47.838900 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2141/4067] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:27:47 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:27:47.865295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8717ed6a60>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1384594557", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:47.891447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:47.901563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:47.923702 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 29 02:27:47.923702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:47.923702 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72b4a017-1dfc-48c6-b961-ec7c33a14b18 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.079360 Mar 29 02:27:47.923702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2142/4068] 10.222.0.36 () {60 vars in 1159 bytes} [Tue Mar 29 02:27:47 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Mar 29 02:27:47.951601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8724b09430>, body: {"keypair": {"name": "tempest-keypair-1720730223"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:47.979050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:47.979050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:48.142908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:48.194470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f1e775d-e0a1-44ae-8352-6cdc220d5296 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1511 microversion: 2.1 time: 0.771422 Mar 29 02:27:48.194470 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1927/4069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:47 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1511 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:48.194470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:48.194470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:48.204853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:48.204853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:48.204853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:48.210402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:48.513180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:48.523351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:48.562716 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eedf4029-82fe-483f-80b4-9e4b98a1a709 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.631683 Mar 29 02:27:48.570814 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2143/4070] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:27:47 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:48.588318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:48.596799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:48.603751 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd7e580d-3e17-491d-a7cf-80fe7c4ec7a0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.393444 Mar 29 02:27:48.616190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:48.619515 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1928/4071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:48 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:48.619515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8724d5caf0>, body: {"keypair": {"name": "tempest-keypair-1720730223"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:48.622909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:48.622909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:48.622909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:48.635331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:48.649460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:48.667900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:48.847892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:48.860254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:48.863146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:48.866987 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2fc10412-141a-45d6-9312-f0681f74f9cb tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1330 microversion: 2.57 time: 0.297877 Mar 29 02:27:48.868618 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2144/4072] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:48 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1330 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:48.945104 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Key pair 'tempest-keypair-1720730223' already exists. Mar 29 02:27:48.946936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 409 to user: Key pair 'tempest-keypair-1720730223' already exists. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:48.947056 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f48a2fae-0160-4cb8-9845-151efe465015 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.365845 Mar 29 02:27:48.948200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1929/4073] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:27:48 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 367 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:48.956503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc83af1e-c1f4-48e6-b16b-f72f8e71f749 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Calling method '.version_select at 0x7f87240cf3a0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:49.038719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc83af1e-c1f4-48e6-b16b-f72f8e71f749 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720730223" status: 202 len: 0 microversion: 2.1 time: 0.086351 Mar 29 02:27:49.039298 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2145/4074] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:27:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720730223 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:49.049938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec6dfd0b-0450-4b78-a89b-811fbb8c0747 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8724d4da60>, body: {"keypair": {"name": ""}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:49.051152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec6dfd0b-0450-4b78-a89b-811fbb8c0747 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:49.051936 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec6dfd0b-0450-4b78-a89b-811fbb8c0747 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.006431 Mar 29 02:27:49.052445 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1930/4075] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:27:49 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:27:49.062790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f87240d5c10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1976226817", "public_key": " "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:49.088269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:49.094144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:49.112726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 29 02:27:49.113361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:49.114176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9d2e92f-3b63-4a11-bc45-ba66f65ac544 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.056534 Mar 29 02:27:49.114873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2146/4076] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:27:49 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 29 02:27:49.128386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b3ff13cc-9a7f-41a8-9072-1b89ceffc090 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f872405d040>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:49.131320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b3ff13cc-9a7f-41a8-9072-1b89ceffc090 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:49.131800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b3ff13cc-9a7f-41a8-9072-1b89ceffc090 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.011201 Mar 29 02:27:49.132800 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1931/4077] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Mar 29 02:27:49 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:27:49.143309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Action: 'create', calling method: .version_select at 0x7f8724c43310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-662215892", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:49.167528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:27:49.173302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Getting quotas for user afb1a216366c489d88a6b27304284f8b and project 944fdf7572814fc59954f800f59dcc09. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:27:49.192706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:49.193631 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Mar 29 02:27:49.193939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:49.194823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:49.194952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cb0b63e-1fc3-42a9-b008-d0f986410304 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.056494 Mar 29 02:27:49.195856 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2147/4078] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Mar 29 02:27:49 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Mar 29 02:27:49.204508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcfee5f9-8c78-4e75-b439-1e54e4edbaf8 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Calling method '.version_select at 0x7f87240d5550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:49.223759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bcfee5f9-8c78-4e75-b439-1e54e4edbaf8 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-312467943 not found for user afb1a216366c489d88a6b27304284f8b Mar 29 02:27:49.224648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcfee5f9-8c78-4e75-b439-1e54e4edbaf8 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] Returning 404 to user: Keypair tempest-keypair-non-existent-312467943 not found for user afb1a216366c489d88a6b27304284f8b {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:49.225638 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcfee5f9-8c78-4e75-b439-1e54e4edbaf8 tempest-KeyPairsNegativeTestJSON-1358281885 tempest-KeyPairsNegativeTestJSON-1358281885-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-312467943" status: 404 len: 144 microversion: 2.1 time: 0.024747 Mar 29 02:27:49.226683 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2148/4079] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-312467943 => generated 144 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:49.234239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.235175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:49.238218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.238780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:49.522669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:49.532353 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-655c188a-5717-4dff-bca6-0e5454db0dfe tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1511 microversion: 2.1 time: 0.343902 Mar 29 02:27:49.535515 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1932/4080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:49 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:49.601639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:49.602860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:49.615136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.617237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:49.622532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.623207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:49.887144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:49.889121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:49.901700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.902219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:49.903005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:49.903442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:50.047804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:50.062637 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f951b4a8-e9dc-4e49-9c37-29c63060bf30 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.467918 Mar 29 02:27:50.063611 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2149/4081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:49 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:50.498443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:50.508355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:50.509966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:50.511458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56dd18fc-a200-407e-b81a-dd575b48b92f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1336 microversion: 2.57 time: 0.628793 Mar 29 02:27:50.512787 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1933/4082] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:49 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1336 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:50.551437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:50.553072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:50.565274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:50.566246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:50.567295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:50.568005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:51.080581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:51.080581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:51.097798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:51.097798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:51.098450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:51.098887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:51.324471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:51.355230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ddfe654-1e15-405a-9730-38e4aa52334d tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1511 microversion: 2.1 time: 0.808368 Mar 29 02:27:51.365266 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2150/4083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:50 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1511 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:51.540059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:51.541433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:51.559393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:51.563901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:51.563901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:51.565494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:51.788369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:51.797506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:51.804906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:51.807847 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbb68d15-6fea-41a0-8123-b1861dc24b18 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1336 microversion: 2.57 time: 0.279243 Mar 29 02:27:51.809832 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2151/4084] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:51 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1336 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:27:52.280067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:52.300460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16abfc5a-d0c8-4d04-aa44-c8f6631d6316 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 1.224669 Mar 29 02:27:52.310134 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1934/4085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:51 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:52.372926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:52.373549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:52.394221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:52.394221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:52.394221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:52.394221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:52.834728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:52.836310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:52.856368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:52.856368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:52.868476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:52.868476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:52.871684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:52.935478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a886eed1-0f3f-4157-9825-4ee5429a0e9e tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1511 microversion: 2.1 time: 0.515046 Mar 29 02:27:52.935478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2152/4086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:52 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:53.328779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:53.328779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:53.341031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:53.341031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:53.341031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:53.341031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:53.542310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:53.557228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:53.563977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:53.573617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf2a65da-c660-4176-bff9-064d1fe1eac2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1357 microversion: 2.57 time: 0.741898 Mar 29 02:27:53.573617 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1935/4087] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:52 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1357 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:53.577488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9afc677e-3101-4dfd-9725-ae6a815f6901 req-df402151-74bf-4398-8553-e05196a51b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1b6a41-715b-4ba4-88e8-d2239629ccc2", "name": "network-vif-deleted", "tag": "ebe3664e-d41d-4abf-a3ad-570e43bfa6a6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:53.583678 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:27:53.583678 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:27:53.606132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9afc677e-3101-4dfd-9725-ae6a815f6901 req-df402151-74bf-4398-8553-e05196a51b6b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:53.606650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9afc677e-3101-4dfd-9725-ae6a815f6901 req-df402151-74bf-4398-8553-e05196a51b6b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:53.634196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9afc677e-3101-4dfd-9725-ae6a815f6901 req-df402151-74bf-4398-8553-e05196a51b6b service nova] Creating event network-vif-deleted:ebe3664e-d41d-4abf-a3ad-570e43bfa6a6 for instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 on n-h1-828148-1 Mar 29 02:27:53.634196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9afc677e-3101-4dfd-9725-ae6a815f6901 req-df402151-74bf-4398-8553-e05196a51b6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058046 Mar 29 02:27:53.641956 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1936/4088] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:53.661009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:53.832912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:27:53.833331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:27:53.833991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:27:53.834560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:27:53.834970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:27:54.034611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:54.046882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc5b3fa3-4ef6-4270-a582-3a43d6fa502d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1502 microversion: 2.1 time: 0.729831 Mar 29 02:27:54.046882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2153/4089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:53 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1502 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:54.249474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:54.276780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.278005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.280037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.281929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.292351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:54.294307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.295028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.296716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.297190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.342789 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2177c474-ff0c-4ed2-8ea2-40a80e975b80 tempest-AZV2TestJSON-280975099 tempest-AZV2TestJSON-280975099-project] 10.222.0.36 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.290029 Mar 29 02:27:54.343380 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2154/4090] 10.222.0.36 () {58 vars in 1163 bytes} [Tue Mar 29 02:27:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:27:54.351286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:54.352006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:54.362804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.363325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.364256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.365044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.433684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c648d8e3-ea30-43b9-b030-9ca3df9df0c0 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "POST /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced/action" status: 202 len: 1138 microversion: 2.57 time: 0.792335 Mar 29 02:27:54.446744 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1937/4091] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Mar 29 02:27:53 2022] POST /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced/action => generated 1138 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 29 02:27:54.453925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2cae599-00a2-4563-8bee-b7a4d926d57f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:54.455164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:54.466047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.466520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.466983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lazy-loading 'fault' on Instance uuid 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:27:54.469505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.469505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.470432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.470937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.553822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a9d81442d049ea91cd80ce56f93af5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bd1bdc45f7b49d793ec358f4b9c1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:54.564134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86549e04-5a78-426c-a316-1b845a62dd89 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 200 len: 1313 microversion: 2.1 time: 0.219649 Mar 29 02:27:54.564901 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2155/4092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:54 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:54.593280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:54.594307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:54.602752 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Cannot 'attach_volume' instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 while it is in vm_state rescued Mar 29 02:27:54.606894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 409 to user: Cannot 'attach_volume' instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 while it is in vm_state rescued {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:54.617910 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-862395f5-2c6f-49df-9a70-181b6b9daa3e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.161629 Mar 29 02:27:54.618376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.618376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.618544 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1938/4093] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:27:54 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/os-volume_attachments => generated 152 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:27:54.618632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.618632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.627065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:27:54.631341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:54.658389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.661278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.662808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:54.675904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:54.891660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:54.931889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:54.937821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:54.944423 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad1edd5a-3f42-4f7d-a7ed-5e3d4346be72 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.367998 Mar 29 02:27:54.945206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2156/4094] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:54 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:55.153845 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f53b75f1-8c52-41bf-be96-f91d0820e098 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action" status: 202 len: 0 microversion: 2.1 time: 0.525187 Mar 29 02:27:55.153845 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1939/4095] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:27:54 2022] POST /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:27:55.166276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:55.166276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:55.184539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.184539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:55.184539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.184539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:55.545850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:55.555058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4fffa7fe-18d2-4f1f-a873-e1b5c3c93055 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1510 microversion: 2.1 time: 0.403579 Mar 29 02:27:55.555632 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2157/4096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:55 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:55.586436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:55.586436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] [instance: 0a1b6a41-715b-4ba4-88e8-d2239629ccc2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:55.596813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.596813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:55.596813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.596813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:55.705205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] HTTP exception thrown: Instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 could not be found. Mar 29 02:27:55.705205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] Returning 404 to user: Instance 0a1b6a41-715b-4ba4-88e8-d2239629ccc2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:27:55.705205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a1860c12-9a27-47e4-a657-f92868b90ba4 tempest-ServerRescueTestJSONUnderV235-1474436374 tempest-ServerRescueTestJSONUnderV235-1474436374-project] 10.222.0.36 "GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2" status: 404 len: 111 microversion: 2.1 time: 0.128088 Mar 29 02:27:55.706915 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1940/4097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:55 2022] GET /compute/v2.1/servers/0a1b6a41-715b-4ba4-88e8-d2239629ccc2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:27:55.963498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:55.964084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:55.979996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.980460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:55.981281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:55.981978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:56.264831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:56.308753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:56.312443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:56.323054 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2eb43bc9-c096-47cc-9c44-a0ec45669822 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.363130 Mar 29 02:27:56.328326 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2158/4098] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:55 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:56.573241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:56.573857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:56.583231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:56.583478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:56.584269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:56.584806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:56.851833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:56.861522 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e313055-7cfe-4b11-a120-33ab3e55c78c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1510 microversion: 2.1 time: 0.292457 Mar 29 02:27:56.867312 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1941/4099] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:56 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:27:57.343613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:57.344238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:57.352133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:57.352589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:57.359149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:57.359149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:57.656050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:57.664699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:57.666465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:57.667774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8fbdd20a-e71b-4ddb-b1f3-74f9454bdd65 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.328172 Mar 29 02:27:57.679392 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2159/4100] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:57 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:57.879039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:57.879630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:57.887254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:57.887703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:57.888470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:57.888927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:58.105377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:58.115110 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a1c1c68d-1f19-41a0-93f2-337f17bca76d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1510 microversion: 2.1 time: 0.239766 Mar 29 02:27:58.115668 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1942/4101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:57 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:58.686943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:58.689762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:58.697239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:58.697678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:58.702457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:58.702457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:58.908944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:58.917980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:58.919554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:58.921269 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f890d227-98cc-4983-81d6-115044c8612e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.237878 Mar 29 02:27:58.921982 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2160/4102] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:58 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:27:59.132395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:59.133033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:59.140697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:59.141189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:59.141956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:59.142390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:59.615768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:27:59.615768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-90881e56-27a0-44b7-81b4-d9e164b4bcf7 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1516 microversion: 2.1 time: 0.246363 Mar 29 02:27:59.615768 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1943/4103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:27:59 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:27:59.940505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:27:59.941276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:27:59.950318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:59.950318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:27:59.950817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:27:59.951250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:00.212114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:00.212916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:00.214580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:00.217601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dd1e8da-711d-4517-9b43-1cb7051e2eaf tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.279702 Mar 29 02:28:00.233726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2161/4104] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:27:59 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:01.238664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:01.239432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:01.248976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:01.249617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:01.250996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:01.251437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:01.548219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:01.563434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:01.563434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:01.563434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c91107d-4826-4d33-87a9-d32c8ffa5b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.330941 Mar 29 02:28:01.575285 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1944/4105] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:01 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:02.579966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:02.580580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:02.590613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:02.591003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:02.592674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:02.592769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:02.606755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: .version_select at 0x7f872436dd30>, body: {"keypair": {"name": "tempest-keypair-2081745045"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:02.659068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:02.670818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for user 2efd8e6056cd4a27a715e3b54eca605d and project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:02.914815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:02.934434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:02.938400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:02.938400 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d55924f-69e3-43d4-a147-b1c5ed04fb30 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.362386 Mar 29 02:28:02.944278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2162/4106] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:02 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:03.285474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:03.300301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for user 2efd8e6056cd4a27a715e3b54eca605d and project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:03.335220 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-703c33f3-db77-4ab4-bc55-19991816df93 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.732472 Mar 29 02:28:03.336173 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1945/4107] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:28:02 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:03.963726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:03.965594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:03.981373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:03.982066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:03.983589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:03.986729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:04.562024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:04.590773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:04.593269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:04.601509 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6eb3761-cb3e-448f-a4bf-dade5a07ce6b tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.640812 Mar 29 02:28:04.603922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2163/4108] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:03 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:05.621671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:05.623140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:05.631276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:05.637664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:05.637664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:05.637664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:05.937596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:05.958899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:05.965097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:05.967521 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-324d81dc-7433-497e-83a0-bf7f0a6f2d80 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.349640 Mar 29 02:28:05.969187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1946/4109] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:05 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:06.987504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:06.988127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:06.997078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:06.998398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:07.004584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:07.004584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:07.202386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:07.216406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:07.218173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:07.219880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ee33157-7db8-4fdc-a82d-f2787b5a8b5e tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.235969 Mar 29 02:28:07.233196 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2164/4110] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:06 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:08.242402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:08.242402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:08.255787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:08.256392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:08.257313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:08.257971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:08.684188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:08.703988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:08.709627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:08.709627 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b47e81db-0d5d-4eda-8e71-7e1740665cab tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.472988 Mar 29 02:28:08.709627 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1947/4111] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:08 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:09.725151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:09.726476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:09.736085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:09.736548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:09.737374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:09.738129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:09.976338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:09.987328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:09.989139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:09.990414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ee85961-c864-41f1-a496-7f6c9fb9bf74 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.268912 Mar 29 02:28:09.991473 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2165/4112] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:09 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:11.010829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:11.010829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:11.031348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:11.031923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:11.036516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:11.037762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:11.285517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:11.313856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:11.320101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:11.327480 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f40c198-0791-490b-a44e-47534b0e5f85 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.317255 Mar 29 02:28:11.329140 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1948/4113] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:11 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:12.347278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:12.348405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:12.356687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:12.357634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:12.358663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:12.360040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:12.585472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:12.596697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:12.598230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:12.599669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a75f44c8-f87c-42aa-aa38-01a942e5e3f7 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.256269 Mar 29 02:28:12.629069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2166/4114] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:12 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:13.622520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:13.624010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:13.644259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:13.644710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:13.649996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:13.650386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:13.740655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1557217751", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "214316d3-612e-4541-ac7e-127e5bf6dc4c"}], "security_groups": [{"name": "tempest-securitygroup--1742139711"}], "key_name": "tempest-keypair-2081745045", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:14.207330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] validate_networks() for [('214316d3-612e-4541-ac7e-127e5bf6dc4c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:28:14.398869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:14.414150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:14.415638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:14.416761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63459ae4-8aa7-4877-b5e7-5bed66086da4 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.798369 Mar 29 02:28:14.423255 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1949/4115] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:13 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:14.625108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-410570125", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:14.749809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:28:14.750235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:28:14.750712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:28:14.751123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:28:14.751536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:28:14.763451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:14.768483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:14.768483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:14.768483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:14.786830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:14.795578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for user 90af6dbbb6e94429a5bf275213c22960 and project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:14.811052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:28:14.813808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:28:14.953120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c86b6879-c30f-420c-86fd-7e6d2460dde5 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.434503 Mar 29 02:28:14.954418 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1950/4116] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 29 02:28:14.967704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:14.968402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:15.256194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.273009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.275189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.276581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2cad3f45-c6f3-4472-8a22-421fe97f9f53 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1277 microversion: 2.54 time: 0.315098 Mar 29 02:28:15.277407 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1951/4117] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:14 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1277 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:15.444174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:15.445840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:15.458743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:15.460506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:15.467893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:15.469471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:15.656428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.674311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.679431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:15.683928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d6949a8c-85f0-4f86-8174-eb19548d305a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.243182 Mar 29 02:28:15.685513 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1952/4118] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:15 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:16.294776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:16.295984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:16.314965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:28:16.314965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:28:16.314965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:28:16.314965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:28:16.314965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:28:16.331321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:16.331763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:16.332735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:16.333305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:16.355539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:16.361963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Getting quotas for user 2efd8e6056cd4a27a715e3b54eca605d and project 4f2ae2fbff9a45d28765f19e7e87a2b1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:16.378257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:28:16.381378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:28:16.407947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:16.416908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:16.436671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:16.438043 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53a7a3ae-f134-482d-b9bc-7ad52954e86f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1277 microversion: 2.54 time: 0.146905 Mar 29 02:28:16.438628 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1953/4119] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:16 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:16.604227 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-163ccd61-5c1c-445e-aa8f-7210aa19c4de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.867759 Mar 29 02:28:16.605412 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2167/4120] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:28:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:28:16.619384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15576192-4032-4f6d-8df3-f8cabe6c9fff tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:16.620012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-15576192-4032-4f6d-8df3-f8cabe6c9fff tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:16.707813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:16.707813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:16.722295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:16.722773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:16.725923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:16.726378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:17.116391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-15576192-4032-4f6d-8df3-f8cabe6c9fff tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.130463 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-15576192-4032-4f6d-8df3-f8cabe6c9fff tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1246 microversion: 2.1 time: 0.518399 Mar 29 02:28:17.138749 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1954/4121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:16 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1246 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:17.293733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.304039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.309762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.311963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ab5c03c-0a3c-499e-a7dd-debf50a1e2d2 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.613136 Mar 29 02:28:17.313134 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2168/4122] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:16 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:17.457104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:17.458306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:17.471093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:17.475964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:17.480816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:17.480816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:17.639348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.655808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.657691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:17.659068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-290042c8-d453-41c9-a64a-ccfe235cb9c1 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1329 microversion: 2.54 time: 0.205630 Mar 29 02:28:17.672046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1955/4123] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:17 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1329 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:18.148183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:18.152644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:18.166164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.166612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.173389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.184346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.330218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:18.334514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:18.376794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.376794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.376794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.382807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.496774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:18.514072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2cc0690-d92a-4058-978f-f73e55e3dd88 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1250 microversion: 2.1 time: 0.369607 Mar 29 02:28:18.530767 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2169/4124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:18 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1250 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:18.685797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:18.686423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:18.719873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.722915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.724690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:18.725189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:18.819847 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:28:18.901687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:18.926384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:18.929601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:18.932960 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-912fbaef-39b9-4e27-9939-5a0cf3c12642 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.606748 Mar 29 02:28:18.934127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1956/4125] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:18 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:19.017179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:19.030127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:19.033248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:19.035319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-59e69c0f-f007-428d-ac69-b84c7babca14 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1347 microversion: 2.54 time: 0.360864 Mar 29 02:28:19.037180 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2170/4126] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:18 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1347 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:19.538903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:19.540705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:19.550675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:19.551121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:19.551931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:19.552330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:19.731534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:19.752408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-625bc1ce-73fd-486d-bf07-b35603ff7491 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1298 microversion: 2.1 time: 0.217122 Mar 29 02:28:19.765320 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1957/4127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:19 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1298 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:19.952171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:19.953857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:19.973827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:19.974585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:19.975374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:19.975864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:20.047368 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 40890. Mar 29 02:28:20.056477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:20.057118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:20.076086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:20.076570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:20.077394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:20.077833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:20.239714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.257000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.260258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.261696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3945930e-961e-4dc2-8475-05a3a9944729 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.314014 Mar 29 02:28:20.275524 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2171/4128] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:19 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:20.607733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.625842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.636098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:20.636098 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbbdc0ea-2cee-4b7a-81f5-48331a66122e tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1335 microversion: 2.54 time: 0.580278 Mar 29 02:28:20.636098 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1958/4129] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:20 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1335 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:20.770446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:20.771230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:20.790574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:20.790809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:20.791944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:20.794092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:21.014598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.019065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7eae693e-3a58-4768-b219-bdbd600ac53d tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1304 microversion: 2.1 time: 0.249844 Mar 29 02:28:21.019679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2172/4130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:20 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1304 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:21.279556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:21.280442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:21.296990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:21.297440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:21.298429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:21.300775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:21.619398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.643533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.650776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.655682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:21.658393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:21.659550 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49537cac-70b8-493f-bce4-b0cbda21319f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1366 microversion: 2.57 time: 0.380610 Mar 29 02:28:21.660762 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1959/4131] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:21 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1366 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:21.676684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:21.677345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:21.678279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:21.678995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:21.884214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.894011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.895521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:21.896590 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4bcb474-6ffe-4ef4-afe5-16686ec98373 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1335 microversion: 2.54 time: 0.246670 Mar 29 02:28:21.897479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2173/4132] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:21 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1335 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:22.038834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:22.039563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:22.050040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.050640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:22.051798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.052113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:22.286634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:22.318287 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2aca3d4f-5c1e-4451-9133-56bcf72ec288 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1304 microversion: 2.1 time: 0.284931 Mar 29 02:28:22.321097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1960/4133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:22 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1304 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:22.680163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:22.681536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:22.697182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.697182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:22.697182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.697182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:22.888262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:22.898164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:22.900062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:22.901374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-40057118-a947-4c42-a207-8c27064cecb6 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1372 microversion: 2.57 time: 0.226265 Mar 29 02:28:22.902414 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2174/4134] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:22 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:22.919440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:22.920124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:22.927934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.928612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:22.929593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:22.930216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:23.124797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:23.142573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:23.144339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:23.145838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7e3f4345-1996-41a0-b418-9ca29231bd07 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1335 microversion: 2.54 time: 0.231296 Mar 29 02:28:23.147069 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1961/4135] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:22 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1335 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:23.337488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:23.337686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:23.349913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:23.350319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:23.351100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:23.352507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:23.929875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:23.929875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:23.935994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:23.936671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:23.937865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:23.938502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:24.163871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.177234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.177706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.181961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.184030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3946455e-24db-4813-b46b-d935ac610077 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1372 microversion: 2.57 time: 0.260955 Mar 29 02:28:24.186002 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1962/4136] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:23 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1372 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:24.193713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0cdadb50-4b9e-4da6-bc7c-db6c29f5d64e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.856422 Mar 29 02:28:24.194219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:24.194219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:24.194417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2175/4137] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:23 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:24.224333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:24.224333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:24.224333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:24.224333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:24.445331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.460621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.460621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:24.461653 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd76e7c4-cf64-4289-8872-fdcf45939815 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1356 microversion: 2.54 time: 0.274319 Mar 29 02:28:24.465430 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1963/4138] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:24 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1356 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:24.482762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Action: 'create', calling method: .version_select at 0x7f8724b09940>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-66730982"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:24.515715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:24.542883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for user 90af6dbbb6e94429a5bf275213c22960 and project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:24.969348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:24.975489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Getting quotas for user 90af6dbbb6e94429a5bf275213c22960 and project 9ebafe4d87b44c45bae347134e0bbdb2. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:24.991200 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3e896a32-2056-4a05-901d-43475758cdbf tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2333 microversion: 2.54 time: 0.513038 Mar 29 02:28:24.992313 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2176/4139] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:28:24 2022] POST /compute/v2.1/os-keypairs => generated 2333 bytes in 515 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:28:25.002743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-66730982", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:25.004360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:25.014474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.019350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.019350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.019350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.159226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:28:25.159451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:28:25.161768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:28:25.162267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:28:25.162752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:28:25.213281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-059ef667-4775-4170-97db-c95b133a4d6a req-80c50f0b-c9c4-44d8-8c56-57f50a8553ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:25.219771 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:25.219771 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:28:25.233047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-059ef667-4775-4170-97db-c95b133a4d6a req-80c50f0b-c9c4-44d8-8c56-57f50a8553ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.233842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-059ef667-4775-4170-97db-c95b133a4d6a req-80c50f0b-c9c4-44d8-8c56-57f50a8553ed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.266585 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-059ef667-4775-4170-97db-c95b133a4d6a req-80c50f0b-c9c4-44d8-8c56-57f50a8553ed service nova] Creating event network-changed:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:28:25.270856 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-059ef667-4775-4170-97db-c95b133a4d6a req-80c50f0b-c9c4-44d8-8c56-57f50a8553ed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061469 Mar 29 02:28:25.271552 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2177/4140] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:25.282650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:25.283629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:25.297283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.297785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.298742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.299182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.610746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:25.623257 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed9444ec-ef4b-4e1d-ab0e-5f48591a9f0f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.349247 Mar 29 02:28:25.623694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2178/4141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:25 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:25.628913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:25.629545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:25.642038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.642540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.643471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.643905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.669559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:25.687851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.689032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.692320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.693140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.869244 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1d60561-9f06-44cf-bf6a-c5eebc5d8486 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "POST /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b/action" status: 202 len: 1137 microversion: 2.54 time: 0.868215 Mar 29 02:28:25.870679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1964/4142] 10.222.0.36 () {62 vars in 1319 bytes} [Tue Mar 29 02:28:24 2022] POST /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b/action => generated 1137 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 29 02:28:25.886349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:25.887155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:25.902954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.903888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.904698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:25.905163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:25.984063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:25.998262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.000095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.001669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8aeb45e-e54d-4a49-8ad2-6983eb083329 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1357 microversion: 2.57 time: 0.377028 Mar 29 02:28:26.003078 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2179/4143] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:25 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:26.027056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:26.027560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:26.040040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.040040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.040040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.040388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.114339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:28:26.117046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.146319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.148335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.153788 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9defeff7-4360-4d2f-9b69-1953ab897cb6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.271981 Mar 29 02:28:26.154568 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1965/4144] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:25 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:26.527938 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80372e44-004c-4685-886a-6146038d8af3 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 204 len: 0 microversion: 2.57 time: 0.504712 Mar 29 02:28:26.529747 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2180/4145] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:28:26 2022] DELETE /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:28:26.539914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:26.540702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:26.545658 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:28:26.561080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.563937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.565260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.567103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.650488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:26.651937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:26.681473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.683036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.691786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:26.691786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:26.884164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.893395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.894879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:26.895999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78996023-b066-4610-af08-b8a581ace82a tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1363 microversion: 2.57 time: 0.362023 Mar 29 02:28:26.896546 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1966/4146] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:26 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1363 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:27.141765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:27.148734 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-373b7010-0ff6-4ad4-9651-097503a8b9ca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.505788 Mar 29 02:28:27.153242 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2181/4147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:26 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:27.173626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:27.174452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:27.182652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:27.192085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:27.192085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:27.192085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:27.307236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:27.317592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:27.319208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:27.320315 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a5a8d7e-57a2-423c-99e3-b9a2c6ae199a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.150413 Mar 29 02:28:27.321373 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1967/4148] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:27 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:27.916030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:27.916030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:27.929006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:27.929380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:27.934378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:27.934957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:28.177720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:28.179106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.180715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:28.192007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.195113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.201895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:28.202372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:28.203159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:28.204663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-92270977-94e0-46b9-bc7d-76e194c8e15f tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1363 microversion: 2.57 time: 0.293505 Mar 29 02:28:28.205479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:28.205844 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2182/4149] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:27 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:28.341320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:28.341320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:28.354120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:28.354565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:28.355332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:28.355762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:28.369036 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41078. Mar 29 02:28:28.502963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.516973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.520979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:28.522423 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-448076ee-1542-48e7-9baf-08a5a8779c8d tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.187593 Mar 29 02:28:28.523074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2183/4150] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:28 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:29.197245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.207478 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2c989a4-36f0-426c-b204-9935c9fc1638 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 1.045221 Mar 29 02:28:29.213566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1968/4151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:28 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:29.227070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:29.227766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:29.246942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:29.247533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:29.249086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:29.249727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:29.335581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:29.335945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:29.336401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lazy-loading 'fault' on Instance uuid f664bb5f-e742-49f7-8635-72e50d49cced {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:28:29.540714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:29.541450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:29.554705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:29.555539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:29.556241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.557168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:29.558532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:29.573097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.574608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f9d617207a40fbb7b65f04331c3d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b9df080e97e4750989b490d3654017b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.576320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ff1815df-18fa-4212-86ff-dd83ba082b10 tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 200 len: 1368 microversion: 2.57 time: 0.354851 Mar 29 02:28:29.577468 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2184/4152] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:29 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:29.769250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.779368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.780929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:29.782013 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c9207c64-36ec-47c1-a49d-20ca839709ae tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.245121 Mar 29 02:28:29.782566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1969/4153] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:29 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:30.226285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:30.226904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:30.240395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.243399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:30.244258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.244743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:30.532321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:30.540663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63cbb215-96f4-4a93-b304-1ddab43eca0b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.318812 Mar 29 02:28:30.541261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2185/4154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:30 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:30.595930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:30.596567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] [instance: f664bb5f-e742-49f7-8635-72e50d49cced] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:30.603917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.604685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:30.605702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.606924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:30.735030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] HTTP exception thrown: Instance f664bb5f-e742-49f7-8635-72e50d49cced could not be found. Mar 29 02:28:30.735640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] Returning 404 to user: Instance f664bb5f-e742-49f7-8635-72e50d49cced could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:28:30.736486 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e2dbeac-f765-4c0e-9c32-6b66ca55e1ee tempest-ServerShowV257Test-886894679 tempest-ServerShowV257Test-886894679-project] 10.222.0.36 "GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced" status: 404 len: 111 microversion: 2.57 time: 0.144531 Mar 29 02:28:30.740866 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1970/4155] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:30 2022] GET /compute/v2.1/servers/f664bb5f-e742-49f7-8635-72e50d49cced => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:28:30.802436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:30.803489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:30.818515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.819729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:30.821943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:30.822695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:31.022098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:31.034808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:31.036432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:31.038338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48bdb63b-c0ce-4a56-9f88-d2459e7ec8f2 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.240156 Mar 29 02:28:31.039426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2186/4156] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:30 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:31.187326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-494829064", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:31.261629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:28:31.558263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:31.558813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:31.567373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:31.568088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:31.568773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:31.569225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:31.830268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:31.839831 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0915db2d-0644-4c83-8cd3-56f9e22194a8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.284984 Mar 29 02:28:31.850758 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2187/4157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:31 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:32.059932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:32.061519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:32.069245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.072585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.072585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.072585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.204898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:32.214161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:32.219412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:32.235339 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e26bdf91-f321-4ff1-a2d3-e22a4c4a5630 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.178234 Mar 29 02:28:32.246579 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2188/4158] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:32 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:32.465790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:28:32.466285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:28:32.466651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:28:32.467054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:28:32.467463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:28:32.476245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.476704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.477538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.477970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.497552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:32.502746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:32.514849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:28:32.517047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:28:32.698992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddf8800d-fb11-4359-8ea6-36172a65bdfd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.721652 Mar 29 02:28:32.700180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1971/4159] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:28:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:28:32.711433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3aa1f5b-462f-44f1-a6cd-79003b1340ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:32.712055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3aa1f5b-462f-44f1-a6cd-79003b1340ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:32.859357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:32.860162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:32.868575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3aa1f5b-462f-44f1-a6cd-79003b1340ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:32.875400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.876093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.877241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:32.877871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:32.878294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3aa1f5b-462f-44f1-a6cd-79003b1340ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1214 microversion: 2.1 time: 0.170722 Mar 29 02:28:32.879215 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2189/4160] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:32 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:33.257027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:33.263047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:33.279864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:33.280957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:33.282865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:33.283673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:33.406209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:33.427468 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bce0c6e7-6197-47cc-b472-18f4e6897f40 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.572919 Mar 29 02:28:33.429969 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1972/4161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:32 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:33.593194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:33.608093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:33.610509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:33.613042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c298de05-b9e3-4855-9d9f-39aef1e5ca19 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.361436 Mar 29 02:28:33.623473 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2190/4162] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:33 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:33.895292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:33.896480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:33.909303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:33.909569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:33.910460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:33.912916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.039932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:34.050190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7fb2aa8-3c25-4d2b-92de-4c4160a62db7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1218 microversion: 2.1 time: 0.158481 Mar 29 02:28:34.050989 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1973/4163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:33 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1218 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:34.446303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:34.447688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:34.457816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:34.461005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.466507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:34.467195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.630808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:34.631865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:34.640894 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:34.641879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.643033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:34.643679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.825334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:34.836616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:34.838945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:34.841343 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24c8a415-dba5-4a2c-9856-96ca8328179f tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.213586 Mar 29 02:28:34.842453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1974/4164] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:34 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:34.857024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e4a72951-6b5c-48c2-9df1-98deec59c406 req-1965d0ce-349c-413d-82e8-af3eb1b9df80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "name": "network-vif-plugged", "status": "completed", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:34.859352 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:34.859352 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:28:34.870632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e4a72951-6b5c-48c2-9df1-98deec59c406 req-1965d0ce-349c-413d-82e8-af3eb1b9df80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:34.871856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e4a72951-6b5c-48c2-9df1-98deec59c406 req-1965d0ce-349c-413d-82e8-af3eb1b9df80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:34.895374 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e4a72951-6b5c-48c2-9df1-98deec59c406 req-1965d0ce-349c-413d-82e8-af3eb1b9df80 service nova] Creating event network-vif-plugged:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:28:34.903951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e4a72951-6b5c-48c2-9df1-98deec59c406 req-1965d0ce-349c-413d-82e8-af3eb1b9df80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058075 Mar 29 02:28:34.905486 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1975/4165] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:34.962098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:34.971663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd44f129-1280-44e8-b5fe-b529a8d8adca tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.529061 Mar 29 02:28:34.973132 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2191/4166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:34 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:35.068280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:35.069003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:35.078572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:35.079336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:35.080338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:35.081034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:35.232492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:35.241163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9b618b7-0117-41cc-92a3-b477f64ed4d2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1266 microversion: 2.1 time: 0.177132 Mar 29 02:28:35.242159 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1976/4167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:35 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:35.860569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:35.861215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:35.869834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:35.870598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:35.871962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:35.872613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:35.989253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:35.989989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:36.003535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:36.005587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:36.006484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:36.007963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:36.131902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:36.148678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:36.151229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:36.156035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-113153ec-1243-41de-a377-5f4d0bd9cc1a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.300208 Mar 29 02:28:36.158425 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2192/4168] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:35 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:36.258283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:36.258909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:36.275780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:36.276473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:36.277494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:36.281483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:36.422021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:36.432002 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bcb4b391-f91e-4688-a26b-2dc24db6a49c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1372 microversion: 2.1 time: 0.447310 Mar 29 02:28:36.442928 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1977/4169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:35 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1372 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:36.557023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:36.565747 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-469b129f-19fa-49ae-ac90-938c84f529e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1272 microversion: 2.1 time: 0.311098 Mar 29 02:28:36.566321 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2193/4170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:36 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1272 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:37.178349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:37.179281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:37.194537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.195257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.196374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.197047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.376674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:37.388417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:37.397265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:37.401212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb3851fc-72f5-4039-abfc-0a0a0102bf12 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.228486 Mar 29 02:28:37.413828 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1978/4171] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:37 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:37.450971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:37.452432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:37.463717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.464443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.465356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.465986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.583666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:37.584791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:37.596125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.596777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.597771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:37.598368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:37.751932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:37.762417 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-055c1090-4f08-4934-85a7-510d442cdbda tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1272 microversion: 2.1 time: 0.183078 Mar 29 02:28:37.764534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1979/4172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:37 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:38.002428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:38.011279 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d86f1156-36de-4b28-a2c0-a5a386b06bd1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1566 microversion: 2.1 time: 0.565566 Mar 29 02:28:38.012430 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2194/4173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:37 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1566 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:38.029419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:38.029922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:38.037418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.037877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:38.038820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.039267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:38.283140 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43241417-b1d5-4bd6-8016-4984f3607fe9 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257252 Mar 29 02:28:38.283965 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1980/4174] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:28:38 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:38.420743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:38.421402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:38.429256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.429827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:38.430602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.431035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:38.780657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:38.783022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:38.787227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:38.795157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.805489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:38.806309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:38.809416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:38.814837 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ada4e95b-334a-44e7-8c31-42ca400af60a tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.396060 Mar 29 02:28:38.814837 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2195/4175] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:38 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:38.828588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:38.829377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:39.275498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:39.276491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:39.286456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:39.288325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:39.291513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:39.292328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:39.393115 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c03c9c97-fb7d-4971-b17f-340d3b3e2788 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/ips" status: 200 len: 145 microversion: 2.1 time: 0.121891 Mar 29 02:28:39.393860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2196/4176] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:28:39 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/ips => generated 145 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:28:39.430555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:39.447952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-685fcf74-cdd5-4c9a-8902-c9494380d116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 0.669092 Mar 29 02:28:39.450204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1981/4177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:38 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:39.836549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:39.837205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:39.844511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-68092683", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "0bffd127-362d-4287-9174-94a40a09f50c"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:39.847028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:39.847501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:39.848303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:39.848732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:39.958386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] validate_networks() for [('0bffd127-362d-4287-9174-94a40a09f50c', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:28:40.225530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:40.252266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:40.254306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:40.256269 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5d403687-a6d6-45bd-b585-416a82a4fd74 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.423973 Mar 29 02:28:40.260146 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1982/4178] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:39 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:40.467571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:40.472643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:40.504128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:40.506271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:40.509783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:40.511005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.064289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:28:41.064787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:28:41.065717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:28:41.066711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:28:41.067702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:28:41.090180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:41.090835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.091801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:41.092394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.115826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Getting quotas for project 16e6bd8150754b10ab7a9bc5e94a8bbc. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:28:41.121609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Getting quotas for user a1b5c75c669a459aa105c58e6279da42 and project 16e6bd8150754b10ab7a9bc5e94a8bbc. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:28:41.136644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:28:41.139359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:28:41.301041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-284ea9b8-cf43-43bd-b6c7-4d27923a6a86 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.815867 Mar 29 02:28:41.302098 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2197/4179] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:28:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:28:41.308928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c8ae3839-4800-4d5e-a18f-2798ea6911a4 req-4339e0dc-49c5-46df-bc5c-5f627f372533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd459e0a-897b-4859-aea5-ae71fcfd4904", "tag": "3a2f7b94-b6ae-4494-9f7d-3677e7d0454c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:41.312414 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:41.312414 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:28:41.323397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8ae3839-4800-4d5e-a18f-2798ea6911a4 req-4339e0dc-49c5-46df-bc5c-5f627f372533 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:41.324724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8ae3839-4800-4d5e-a18f-2798ea6911a4 req-4339e0dc-49c5-46df-bc5c-5f627f372533 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.354388 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c8ae3839-4800-4d5e-a18f-2798ea6911a4 req-4339e0dc-49c5-46df-bc5c-5f627f372533 service nova] Creating event network-changed:3a2f7b94-b6ae-4494-9f7d-3677e7d0454c for instance dd459e0a-897b-4859-aea5-ae71fcfd4904 on n-h2-828148-1 Mar 29 02:28:41.370663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c8ae3839-4800-4d5e-a18f-2798ea6911a4 req-4339e0dc-49c5-46df-bc5c-5f627f372533 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067017 Mar 29 02:28:41.371369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2198/4180] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:41.376682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:41.377437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:41.390630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:41.390630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.390819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:41.391193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:41.471044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:41.486166 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd1fb87c-b4be-41dc-a417-5a8fc8850b1a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 1.023032 Mar 29 02:28:41.497071 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1983/4181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:40 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:41.502263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e485a08b-0ebe-474c-afdd-45aa6ccd1ee1 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:41.502877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e485a08b-0ebe-474c-afdd-45aa6ccd1ee1 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:41.623497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e485a08b-0ebe-474c-afdd-45aa6ccd1ee1 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:41.637615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e485a08b-0ebe-474c-afdd-45aa6ccd1ee1 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1226 microversion: 2.1 time: 0.138853 Mar 29 02:28:41.638202 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1984/4182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:41 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1226 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:41.679923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:41.692095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:41.695899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:41.699855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0d2a28b-3066-4e2f-a663-872c9b5424ed tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.326559 Mar 29 02:28:41.699855 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2199/4183] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:41 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:41.990844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cfdfafcf-6945-4743-b6c8-f8f39f0393b1 req-74d3ec26-cafe-4183-9ef1-8c873b5f3785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:41.992180 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:41.992180 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:28:42.001862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cfdfafcf-6945-4743-b6c8-f8f39f0393b1 req-74d3ec26-cafe-4183-9ef1-8c873b5f3785 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:42.002299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cfdfafcf-6945-4743-b6c8-f8f39f0393b1 req-74d3ec26-cafe-4183-9ef1-8c873b5f3785 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:42.025938 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cfdfafcf-6945-4743-b6c8-f8f39f0393b1 req-74d3ec26-cafe-4183-9ef1-8c873b5f3785 service nova] Creating event network-changed:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:28:42.027779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cfdfafcf-6945-4743-b6c8-f8f39f0393b1 req-74d3ec26-cafe-4183-9ef1-8c873b5f3785 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370721 Mar 29 02:28:42.028742 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1985/4184] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:42.513548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:42.514861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:42.529533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:42.533176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:42.533176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:42.535098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:42.657528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f20c62e5-34fc-46b3-a051-0eb938486de4 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:42.658971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f20c62e5-34fc-46b3-a051-0eb938486de4 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:43.097873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f20c62e5-34fc-46b3-a051-0eb938486de4 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:43.114043 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f20c62e5-34fc-46b3-a051-0eb938486de4 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1226 microversion: 2.1 time: 0.460090 Mar 29 02:28:43.119650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1986/4185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:42 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1226 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:43.131031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:43.132424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:43.153373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:43.154101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:43.155841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:43.156537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:43.666639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:43.679825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:43.692895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:43.693993 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-378ba963-243d-4613-b8a1-79f5182d2d59 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 1.184354 Mar 29 02:28:43.709041 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2200/4186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:42 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:43.712297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:43.713771 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c1f076f-a8f5-4b10-871f-5f432905edb4 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.597185 Mar 29 02:28:43.724404 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1987/4187] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:43 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:44.131644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:44.132260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:44.141316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.141767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.142538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.142974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.330390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:44.340308 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b548be66-43e9-472a-b17f-e6b8cdbe913b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1278 microversion: 2.1 time: 0.212556 Mar 29 02:28:44.349570 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2201/4188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:44 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1278 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:44.717900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:44.719244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:44.737497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.739929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.740903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.741478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.747774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:44.749098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:44.766123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.772046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.773884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:44.782355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:44.945418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:44.967073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:44.967073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:44.967073 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9b213a3f-c3c8-4dc4-b76e-7ea30ba4cee0 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.215440 Mar 29 02:28:44.967073 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2202/4189] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:44 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:45.039454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:45.049516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26f98c49-1b90-4350-8708-aa6deba55750"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:45.050685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:45.055863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7b8d8f7-9e97-4275-8222-e8785d1a77b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 0.344068 Mar 29 02:28:45.060934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.061620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:45.062500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.063052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:45.065687 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1988/4190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:44 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:45.358506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:45.359204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:45.368739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.368739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:45.368739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.368739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:45.516252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:45.526740 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c41fe5a3-7b98-4a13-8b43-916c7a966cbf tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1284 microversion: 2.1 time: 0.172397 Mar 29 02:28:45.539670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1989/4191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:45 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:45.978619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:45.979168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:45.986634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.987332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:45.988715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:45.988715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:46.161642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:46.186007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:46.187344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:46.189381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-df8cbda5-423f-471d-a448-6d83fa897913 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.214993 Mar 29 02:28:46.190577 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1990/4192] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:45 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:46.196243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:46.197252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:46.207974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:46.208682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:46.210639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:46.211379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:46.388449 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e400808-cdcc-44de-88ce-42ccb292ac95 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.342714 Mar 29 02:28:46.389497 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2203/4193] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:28:45 2022] POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments => generated 194 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:28:46.546198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:46.555863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:46.573096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:46.579260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:46.582194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:46.584322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:47.539240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:47.548515 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-987c679c-d334-4295-87b0-f7946392a859 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 1.008599 Mar 29 02:28:47.559046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2204/4194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:46 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:47.565082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:47.566381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:47.575751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:47.579374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:47.579374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:47.579374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:47.874152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:47.886284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:47.889992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:47.891523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:47.892672 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-096c8d89-eccc-45ed-ae9f-f5f2196bcc40 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.338539 Mar 29 02:28:47.893243 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2205/4195] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:47 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:47.898320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9aa3f020-ef7f-4812-88a0-29fc39f75b19 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 1.705952 Mar 29 02:28:47.901028 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1991/4196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:46 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:48.186942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c8b779ce-65ab-4b81-89e1-0262a5705085 req-1c16cfa0-e414-4a8f-9df3-922f6f6dc040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "766e6c6e-0379-4ce5-95bd-ebd8a366b8a2", "tag": "06a2192b-178a-4625-be8b-bfce278918af"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:48.187218 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:48.187218 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:28:48.208295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8b779ce-65ab-4b81-89e1-0262a5705085 req-1c16cfa0-e414-4a8f-9df3-922f6f6dc040 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:48.208759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8b779ce-65ab-4b81-89e1-0262a5705085 req-1c16cfa0-e414-4a8f-9df3-922f6f6dc040 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:48.262692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c8b779ce-65ab-4b81-89e1-0262a5705085 req-1c16cfa0-e414-4a8f-9df3-922f6f6dc040 service nova] Creating event network-changed:06a2192b-178a-4625-be8b-bfce278918af for instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 on n-h2-828148-1 Mar 29 02:28:48.267956 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c8b779ce-65ab-4b81-89e1-0262a5705085 req-1c16cfa0-e414-4a8f-9df3-922f6f6dc040 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087255 Mar 29 02:28:48.269553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2206/4197] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:48.571171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:48.571790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:48.590272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:48.590272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:48.590272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:48.590272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:48.924657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:48.925393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:48.952987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:48.952987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:48.952987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:48.952987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:49.231085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:49.257771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:49.260595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:49.261918 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-daa207db-0c4e-48ce-9a03-5a6bb350fa30 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.345326 Mar 29 02:28:49.262485 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2207/4198] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:48 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:49.271634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:49.279858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:49.290784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:49.291232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:49.292020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:49.293344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:49.521415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:49.537018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f003f199-4123-4546-9154-dc56bc68985a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.969365 Mar 29 02:28:49.538066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1992/4199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:48 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:50.025879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:50.032705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-160cdbfd-b953-4837-80d1-be4d21094b35 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 0.769108 Mar 29 02:28:50.033325 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2208/4200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:49 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:50.242971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fbd0d947-7940-4c90-a519-3b2d8a4cf12e req-194d1b48-b004-441e-9555-5c6494cdfefa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd459e0a-897b-4859-aea5-ae71fcfd4904", "name": "network-vif-plugged", "status": "completed", "tag": "3a2f7b94-b6ae-4494-9f7d-3677e7d0454c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:50.248906 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:50.248906 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:28:50.281012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:50.281650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:50.281818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fbd0d947-7940-4c90-a519-3b2d8a4cf12e req-194d1b48-b004-441e-9555-5c6494cdfefa service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:50.282357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fbd0d947-7940-4c90-a519-3b2d8a4cf12e req-194d1b48-b004-441e-9555-5c6494cdfefa service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:50.292117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:50.292730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:50.293422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:50.293856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:50.332056 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fbd0d947-7940-4c90-a519-3b2d8a4cf12e req-194d1b48-b004-441e-9555-5c6494cdfefa service nova] Creating event network-vif-plugged:3a2f7b94-b6ae-4494-9f7d-3677e7d0454c for instance dd459e0a-897b-4859-aea5-ae71fcfd4904 on n-h2-828148-1 Mar 29 02:28:50.338177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fbd0d947-7940-4c90-a519-3b2d8a4cf12e req-194d1b48-b004-441e-9555-5c6494cdfefa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100327 Mar 29 02:28:50.340351 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1993/4201] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:50.554271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:50.554985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:50.567069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:50.567520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:50.568548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:50.568772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:50.583847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:50.595697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:50.600524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:50.604999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d71d73c-d7d1-4783-98f2-89195a433d41 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.327153 Mar 29 02:28:50.605715 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2209/4202] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:50 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:51.053226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:51.053992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:51.073286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:51.077531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:51.082926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:51.083676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:51.223959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:51.235264 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6f6c10c-af89-4cde-ba8e-b4a16cc7bd6d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.684586 Mar 29 02:28:51.236797 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1994/4203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:50 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:51.366833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:51.376378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5985844e-3ce9-4634-9f64-b98a5568027a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1314 microversion: 2.1 time: 0.330560 Mar 29 02:28:51.376981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2210/4204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:51 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:51.635909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:51.640578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:51.667545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:51.671126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:51.672041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:51.672551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:51.835090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:51.846121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:51.848002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:51.849182 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4360b9e3-99fb-4626-b8a6-fef248c687bb tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.221429 Mar 29 02:28:51.856986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1995/4205] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:51 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:52.252539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:52.254553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:52.264562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.265702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:52.268035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.268680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:52.407208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:52.408574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:52.426621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.430832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:52.430832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.430832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:52.568330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:52.576061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5266ca95-0278-468f-a28e-79e886dc464f tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.328280 Mar 29 02:28:52.576773 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2211/4206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:52 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:52.868679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:52.869546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:52.877181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.877745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:52.878746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:52.879397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.046872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:53.055832 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a326c5b7-8fbc-4904-89c7-42bde4afbf11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1501 microversion: 2.1 time: 0.666136 Mar 29 02:28:53.056526 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1996/4207] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:52 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1501 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:53.076380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:53.078418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:53.100580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.101756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.102049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.102490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.182107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:28:53.199253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:53.211791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:53.215387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:53.217017 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31a0962e-a439-465b-a033-32377a422de7 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1406 microversion: 2.54 time: 0.352308 Mar 29 02:28:53.217898 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2212/4208] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:52 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:53.593404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:53.594707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:53.602676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.603361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.604449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.605579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.614292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b3b35822-d1d2-4763-b0ef-c59cc76f6313 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 204 len: 0 microversion: 2.1 time: 0.542383 Mar 29 02:28:53.614292 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1997/4209] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:28:53 2022] DELETE /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:28:53.623481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:53.624184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:53.641059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.642461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:53.644981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:53.645909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:54.039630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:54.057137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:54.058508 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02d319ab-0b39-4629-a128-ff6680014e99 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.468632 Mar 29 02:28:54.059087 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2213/4210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:53 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:54.087201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c690e5a9-d5b6-46a8-9c58-038c0d75f068 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1507 microversion: 2.1 time: 0.469075 Mar 29 02:28:54.090539 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1998/4211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:53 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:54.237432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:54.238328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:54.246580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:54.247338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:54.248335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:54.248971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:54.491434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:54.507842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:54.509887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:54.512361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01b85866-5594-46fc-bcc6-3997a8fd539c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1412 microversion: 2.54 time: 0.280183 Mar 29 02:28:54.525882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2214/4212] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:54 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1412 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:55.083286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:55.085667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:55.093829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.094512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.095298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.095730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.110039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:55.110827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:55.118689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.119146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.119930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.120938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.383737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:55.393200 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f3f6dee5-cd88-4404-8191-07200d002afc tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.314757 Mar 29 02:28:55.394552 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 1999/4213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:55 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:55.534777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:55.535686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:55.583004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.583502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.584292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.584726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.811172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:55.821441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:55.826689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:55.827870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bf9009e4-61a7-4b91-bfe2-aae97e9d2b21 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1412 microversion: 2.54 time: 0.298848 Mar 29 02:28:55.828412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2000/4214] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:55 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1412 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:28:55.845360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6954b66b-93fd-4ecf-b444-4b2d0d0f10ad tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:55.861076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6954b66b-93fd-4ecf-b444-4b2d0d0f10ad tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:55.862148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6954b66b-93fd-4ecf-b444-4b2d0d0f10ad tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:55.943308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6954b66b-93fd-4ecf-b444-4b2d0d0f10ad tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Going to try to stop instance {{(pid=103514) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:28:56.003715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:56.021178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e8cb485-f6dc-48c0-aa27-2c3bef99913c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1507 microversion: 2.1 time: 0.912059 Mar 29 02:28:56.022026 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2215/4215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:55 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1507 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:56.209198 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6954b66b-93fd-4ecf-b444-4b2d0d0f10ad tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action" status: 202 len: 0 microversion: 2.1 time: 0.376307 Mar 29 02:28:56.210097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2001/4216] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:28:55 2022] POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:28:56.218151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:56.222849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:56.237660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.237982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:56.238813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.242746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:56.410763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:56.413007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:56.421167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.421839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:56.424438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.424438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:56.612617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:56.624798 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a574ccd-a472-4f2e-bc20-ee343d9b691e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.410550 Mar 29 02:28:56.626649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2216/4217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:56 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:56.829610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:56.841349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ec4bd0c-6809-4a1b-8387-87d92fd8fa13 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.434520 Mar 29 02:28:56.848404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:56.849254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:56.852449 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2002/4218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:56 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:56.865544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.866236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:56.867268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:56.867891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.041140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:57.054257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:57.056000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:57.057249 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49ada5c7-c698-4ae4-b87c-e410acc7fdcc tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1412 microversion: 2.54 time: 0.212604 Mar 29 02:28:57.058796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2217/4219] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:56 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1412 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:57.059322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8975970b-d48e-48a3-b526-2ecaac5eb949 req-d77ee2e6-352f-4767-9907-7279248c397f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd459e0a-897b-4859-aea5-ae71fcfd4904", "name": "network-vif-deleted", "tag": "3a2f7b94-b6ae-4494-9f7d-3677e7d0454c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:57.061613 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:57.061613 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:28:57.068169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:57.068169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:57.076901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.077582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.078513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.079088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.083046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8975970b-d48e-48a3-b526-2ecaac5eb949 req-d77ee2e6-352f-4767-9907-7279248c397f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.083549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8975970b-d48e-48a3-b526-2ecaac5eb949 req-d77ee2e6-352f-4767-9907-7279248c397f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.119765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8975970b-d48e-48a3-b526-2ecaac5eb949 req-d77ee2e6-352f-4767-9907-7279248c397f service nova] Creating event network-vif-deleted:3a2f7b94-b6ae-4494-9f7d-3677e7d0454c for instance dd459e0a-897b-4859-aea5-ae71fcfd4904 on n-h2-828148-1 Mar 29 02:28:57.130775 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8975970b-d48e-48a3-b526-2ecaac5eb949 req-d77ee2e6-352f-4767-9907-7279248c397f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276603 Mar 29 02:28:57.139584 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2003/4220] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:28:57.440544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ad661f60-adaa-481c-b602-474dcc4e99f8 req-761683a6-6b02-4433-b605-3232d9c8ef4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766e6c6e-0379-4ce5-95bd-ebd8a366b8a2", "name": "network-vif-plugged", "status": "completed", "tag": "06a2192b-178a-4625-be8b-bfce278918af"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:57.443799 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:28:57.443799 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:28:57.465511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ad661f60-adaa-481c-b602-474dcc4e99f8 req-761683a6-6b02-4433-b605-3232d9c8ef4a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.466015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ad661f60-adaa-481c-b602-474dcc4e99f8 req-761683a6-6b02-4433-b605-3232d9c8ef4a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.488659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ad661f60-adaa-481c-b602-474dcc4e99f8 req-761683a6-6b02-4433-b605-3232d9c8ef4a service nova] Creating event network-vif-plugged:06a2192b-178a-4625-be8b-bfce278918af for instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 on n-h2-828148-1 Mar 29 02:28:57.502821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ad661f60-adaa-481c-b602-474dcc4e99f8 req-761683a6-6b02-4433-b605-3232d9c8ef4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144947 Mar 29 02:28:57.503653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2004/4221] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:28:57.643260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:57.644324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:57.672378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.684165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.685018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.685471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.693140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:57.710556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef031021-0e45-4ce3-b641-ad6c30be404b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 200 len: 1299 microversion: 2.1 time: 0.645906 Mar 29 02:28:57.711631 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2218/4222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:57 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 1299 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:57.859641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:57.860262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:57.878131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.882212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:57.883210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:57.889514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.281042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:58.291366 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d09a6cc3-370b-4738-a891-eccd88907f31 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.652249 Mar 29 02:28:58.297099 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2005/4223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:57 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:28:58.310005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:58.310639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:58.328385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.328385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.333104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.333630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.507186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:58.517176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:58.519216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:58.524913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4b845f5-8c73-4080-955b-c66114d65417 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1397 microversion: 2.54 time: 0.223457 Mar 29 02:28:58.524913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2006/4224] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:28:58 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1397 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:28:58.546987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edf09a7a-dc85-4390-8302-f3d4c2d16b3c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '.version_select at 0x7f8724d1bb80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:58.571614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:28:58.589603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c97c2588-2f64-450d-b7ef-054dd6126f5d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1326 microversion: 2.1 time: 0.733271 Mar 29 02:28:58.591252 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2219/4225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:57 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1326 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:28:58.687407 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edf09a7a-dc85-4390-8302-f3d4c2d16b3c tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-66730982" status: 204 len: 0 microversion: 2.54 time: 0.151338 Mar 29 02:28:58.699038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2007/4226] 10.222.0.36 () {60 vars in 1312 bytes} [Tue Mar 29 02:28:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-66730982 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 29 02:28:58.701875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:58.702588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:58.712292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.713111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.714582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.715002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.735725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:58.735725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:58.746290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.747139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.748033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:58.751201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:58.792612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:28:58.843346 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. Mar 29 02:28:58.844269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:28:58.846851 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a725a365-3b01-4f34-b0f8-8d92c537f03d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 404 len: 111 microversion: 2.1 time: 0.122222 Mar 29 02:28:58.860071 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2008/4227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:58 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:28:58.987803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-612230209", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:28:59.121597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:28:59.404712 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d6160aa-a37a-4c27-9c91-a460dbaa31df tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 204 len: 0 microversion: 2.54 time: 0.707140 Mar 29 02:28:59.405604 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2220/4228] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:28:58 2022] DELETE /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:28:59.413907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:28:59.414598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:28:59.422441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:59.423109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:28:59.424025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:28:59.424636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.011713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:00.023351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66cf5d70-8229-47d4-a39c-82816b61e4e6 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.613511 Mar 29 02:29:00.024600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2221/4229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:28:59 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:00.029617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:00.030822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:00.039917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.043878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.044954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.045597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.253338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:00.270828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:00.270828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:00.270828 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7dccfcc3-8254-49ed-88b1-ee73f6452218 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1403 microversion: 2.54 time: 0.241516 Mar 29 02:29:00.270828 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2222/4230] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:29:00 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1403 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:29:00.290144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:00.292648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:00.300602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.301080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.301854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.302336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.750459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:00.764815 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-955bd804-3aa6-4b67-b4dc-dbbbf1be666c tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1525 microversion: 2.1 time: 0.484629 Mar 29 02:29:00.777053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2223/4231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:00 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1525 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:00.782864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:00.783950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:00.792199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.793057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:00.794072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:00.794720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.196707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:01.217858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a132a822-e7d2-4209-894d-90b6bba4d72a tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1525 microversion: 2.1 time: 0.438488 Mar 29 02:29:01.230023 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2224/4232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:00 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1525 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:01.235718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:01.236484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:01.253520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.254059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:29:01.254509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:29:01.254960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:29:01.255376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:29:01.255535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.255808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:29:01.256549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.259455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.274888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.274888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.274888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.274888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.321537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:29:01.334256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:29:01.364158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:29:01.366307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:29:01.564640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e0a2424-d7cc-44b6-95e5-07aa877f3010 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.577817 Mar 29 02:29:01.580269 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2009/4233] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:29:01.864225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:01.864947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:01.875530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.885199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.903064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.904247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.939955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:01.960954 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70f204ae-c87c-4ad3-9077-792aa5516c4a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.725351 Mar 29 02:29:01.960954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2225/4234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:01 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:01.974366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:01.975273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:01.996099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:01.996759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:01.997893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.007271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] HTTP exception thrown: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Returning 404 to user: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-881acde2-e76c-4c22-8017-5f131613f81c tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] 10.222.0.36 "DELETE /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 404 len: 111 microversion: 2.1 time: 0.454914 Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2010/4235] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:29:01 2022] DELETE /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 111 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7145488f-d600-4c93-97db-e26feb6524ec tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:02.051855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7145488f-d600-4c93-97db-e26feb6524ec tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:02.160450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7145488f-d600-4c93-97db-e26feb6524ec tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:02.175949 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7145488f-d600-4c93-97db-e26feb6524ec tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1214 microversion: 2.1 time: 0.130996 Mar 29 02:29:02.176942 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2011/4236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:02 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:02.188930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:02.191602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:02.211633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.216208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.217401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.217923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.417745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:02.431688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:02.450994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '90af6dbbb6e94429a5bf275213c22960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebafe4d87b44c45bae347134e0bbdb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:02.450994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a78b396-8227-4116-8939-6becec347319 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 200 len: 1403 microversion: 2.54 time: 0.475093 Mar 29 02:29:02.450994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2226/4237] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:29:01 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 1403 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:29:02.885624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:02.903329 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a75078f4-9273-4255-94f5-7e5e3c55dc94 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1525 microversion: 2.1 time: 0.720792 Mar 29 02:29:02.903329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2012/4238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:02 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1525 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:02.916063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Action: 'update', calling method: >, body: {"server": {"name": "766e6c6e-0379-4ce5-95bd-ebd8a366b8a2_new"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:02.918028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:02.939239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.939975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.941671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.943444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.974766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:02.975311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:02.993193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.995336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:02.998535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:02.999076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.018753 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] HTTP exception thrown: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. Mar 29 02:29:03.019888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] Returning 404 to user: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:03.026939 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e9863c1-59cb-47dd-a21d-14482f725167 tempest-ServersNegativeTestMultiTenantJSON-1633822164 tempest-ServersNegativeTestMultiTenantJSON-1633822164-project] 10.222.0.36 "PUT /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 404 len: 111 microversion: 2.1 time: 0.109131 Mar 29 02:29:03.026939 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2227/4239] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:29:02 2022] PUT /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:29:03.033276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:03.034147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:03.043221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.043805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.044764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.045327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.166573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:29:03.562990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:03.573899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a054486-cab3-4bbc-9716-a23cc365bbd5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.602881 Mar 29 02:29:03.583645 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2013/4240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:02 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:03.589296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:03.590163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:03.598528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.599224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.600243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.600742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.638868 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d14d8da1-68f1-4f8a-853a-21a6d9ea0e98 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "DELETE /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 204 len: 0 microversion: 2.1 time: 0.609463 Mar 29 02:29:03.639449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2228/4241] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:29:03 2022] DELETE /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:29:03.645024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:03.645928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] [instance: 1c21c57c-0531-49bc-a698-2320c34e763b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:03.663515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.664908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.674421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.674421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.811960 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] HTTP exception thrown: Instance 1c21c57c-0531-49bc-a698-2320c34e763b could not be found. Mar 29 02:29:03.819917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] Returning 404 to user: Instance 1c21c57c-0531-49bc-a698-2320c34e763b could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:03.826569 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2de20e28-a909-4979-a133-7ff230d3eef6 tempest-ServerShowV254Test-1380300702 tempest-ServerShowV254Test-1380300702-project] 10.222.0.36 "GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b" status: 404 len: 111 microversion: 2.54 time: 0.185620 Mar 29 02:29:03.827334 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2229/4242] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:29:03 2022] GET /compute/v2.1/servers/1c21c57c-0531-49bc-a698-2320c34e763b => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:29:03.841627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:03.841627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:03.851423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.852171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:03.853397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:03.854110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:04.055656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:04.067146 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12f67164-1ee3-4baa-a042-d24cbff84ca8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1210 microversion: 2.1 time: 0.481865 Mar 29 02:29:04.079532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2014/4243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:03 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1210 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:04.348462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:04.361243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c594ea44-fe5d-4c4b-b8c6-226d468b4db0 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1531 microversion: 2.1 time: 0.532512 Mar 29 02:29:04.362596 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2230/4244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:03 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1531 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:04.591241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:04.592510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:04.602956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:04.606027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:04.606027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:04.606027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:05.093993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:05.096377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:05.102122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:05.102897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:05.103892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:05.104616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:05.105319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:05.124300 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53870b3f-0949-4bb0-b057-d8d452f26f80 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.536777 Mar 29 02:29:05.141706 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2015/4245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:04 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:05.356431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:05.367765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61f7fbf8-2f51-474f-a8eb-b748db3e3bd9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1284 microversion: 2.1 time: 0.276261 Mar 29 02:29:05.369102 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2231/4246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:05 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1284 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:29:05.382896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:05.383548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:05.392484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:05.392959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:05.393766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:05.394208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:05.727643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:05.737122 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43b9a81d-f1ba-4991-8fc3-399c4aec4d2b tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1531 microversion: 2.1 time: 0.358423 Mar 29 02:29:05.737840 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2016/4247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:05 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1531 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:06.140746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:06.141330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:06.149440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.158538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:06.158538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.158538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:06.385739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:06.386358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:06.394257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.394758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:06.395478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.396086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:06.546097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:06.556250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-123b11ed-1da3-442a-9777-af9480776afe tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1272 microversion: 2.1 time: 0.174906 Mar 29 02:29:06.557398 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2017/4248] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:06 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:06.790732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:06.790732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:06.798142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.799068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:06.799958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:06.800866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:07.257118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:07.270650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01f5a9b1-18bf-4497-95db-47f86c10a952 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 1.133528 Mar 29 02:29:07.272163 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2232/4249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:06 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:07.319584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:07.331455 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-162c6337-21e5-441b-98b4-13283bc83ea8 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1531 microversion: 2.1 time: 0.565318 Mar 29 02:29:07.341993 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2018/4250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:06 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1531 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:07.573485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:07.574423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:07.583652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:07.584417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:07.585444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:07.586036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:07.953658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:07.958855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88e84c9f-8807-4b4f-a2ac-57334069a600 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1272 microversion: 2.1 time: 0.388467 Mar 29 02:29:07.960004 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2233/4251] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:07 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1272 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:08.314915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:08.317684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:08.346150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.346612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.347403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.347839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.351010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:08.352099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:08.365865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.366958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.368604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.370164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.684234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:08.698951 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86915a26-d3f6-4df1-bffd-d49c15fe3358 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1489 microversion: 2.1 time: 0.351996 Mar 29 02:29:08.700072 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2234/4252] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:08 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1489 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:08.707531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6843b412-b0ed-4a51-aee3-1040d80d03a3 req-84d13b77-d5d2-41b0-951b-02744c1ba8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "766e6c6e-0379-4ce5-95bd-ebd8a366b8a2", "name": "network-vif-deleted", "tag": "06a2192b-178a-4625-be8b-bfce278918af"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:08.710440 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:29:08.710440 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:29:08.721388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6843b412-b0ed-4a51-aee3-1040d80d03a3 req-84d13b77-d5d2-41b0-951b-02744c1ba8e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.721901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6843b412-b0ed-4a51-aee3-1040d80d03a3 req-84d13b77-d5d2-41b0-951b-02744c1ba8e7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.752506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6843b412-b0ed-4a51-aee3-1040d80d03a3 req-84d13b77-d5d2-41b0-951b-02744c1ba8e7 service nova] Creating event network-vif-deleted:06a2192b-178a-4625-be8b-bfce278918af for instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 on n-h2-828148-1 Mar 29 02:29:08.757632 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6843b412-b0ed-4a51-aee3-1040d80d03a3 req-84d13b77-d5d2-41b0-951b-02744c1ba8e7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055519 Mar 29 02:29:08.758775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2235/4253] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:08.977469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:08.979072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:08.990028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.990984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:08.991908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:08.992426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:09.076702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:09.091503 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e39c22b1-b899-4aeb-acad-06f926600a5f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.800700 Mar 29 02:29:09.092604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2019/4254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:08 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:09.716536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:09.718705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:09.730781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:09.731695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:09.736007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:09.738319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:09.845026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:09.845565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:09.846083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lazy-loading 'fault' on Instance uuid 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:29:09.906381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:09.915342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38061b20-8cd2-455e-89c6-4dd0acb74a0b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.941723 Mar 29 02:29:09.921830 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2236/4255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:08 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:29:10.039703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1b5c75c669a459aa105c58e6279da42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e6bd8150754b10ab7a9bc5e94a8bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:10.050671 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-340bda24-da9a-4c07-aaa8-c31732e59b02 tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 200 len: 1316 microversion: 2.1 time: 0.338603 Mar 29 02:29:10.052410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2020/4256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:09 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:10.109169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:10.109959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:10.117445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:10.117904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:10.118679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:10.119115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:10.535649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:10.545176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72130e51-3722-4069-8a1e-65b3bdb8753f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.439780 Mar 29 02:29:10.545763 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2237/4257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:10 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:10.878381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b1b0c2d1-90f2-460c-a968-8ea5c585e31a req-fcb4adb1-4e7a-46f1-9b10-328db78e2858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93826ed0-0fd6-4652-8603-ba461565cad0", "tag": "f03bdbd5-8418-4d0c-9f09-33a5b812d55c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:10.879935 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:29:10.879935 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:29:10.897075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1b0c2d1-90f2-460c-a968-8ea5c585e31a req-fcb4adb1-4e7a-46f1-9b10-328db78e2858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:10.897075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1b0c2d1-90f2-460c-a968-8ea5c585e31a req-fcb4adb1-4e7a-46f1-9b10-328db78e2858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:10.906157 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b1b0c2d1-90f2-460c-a968-8ea5c585e31a req-fcb4adb1-4e7a-46f1-9b10-328db78e2858 service nova] Creating event network-changed:f03bdbd5-8418-4d0c-9f09-33a5b812d55c for instance 93826ed0-0fd6-4652-8603-ba461565cad0 on n-h2-828148-1 Mar 29 02:29:10.910706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b1b0c2d1-90f2-460c-a968-8ea5c585e31a req-fcb4adb1-4e7a-46f1-9b10-328db78e2858 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035954 Mar 29 02:29:10.911304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2021/4258] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:10.938231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:10.939188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:10.946728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:10.947175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:10.948785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:10.949240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:11.068043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:11.068742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] [instance: 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:11.076678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:11.077161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:11.079258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:11.080321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:11.132424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] HTTP exception thrown: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. Mar 29 02:29:11.137810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] Returning 404 to user: Instance 766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:11.137810 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0bb973e4-2718-462d-a373-8b819dec314d tempest-ServersNegativeTestMultiTenantJSON-588866888 tempest-ServersNegativeTestMultiTenantJSON-588866888-project] 10.222.0.36 "GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2" status: 404 len: 111 microversion: 2.1 time: 0.070620 Mar 29 02:29:11.137810 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2022/4259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:11 2022] GET /compute/v2.1/servers/766e6c6e-0379-4ce5-95bd-ebd8a366b8a2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:29:11.503956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:11.513214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-67287407-8433-4da3-9cc7-585efca47bb4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.578846 Mar 29 02:29:11.514106 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2238/4260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:10 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:11.562445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:11.563038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:11.570425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:11.570878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:11.571652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:11.572084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:12.539118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:12.539118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:12.539668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:12.540322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:12.540770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:12.542057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:12.542497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:12.543728 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1722 microversion: 2.1 time: 0.985118 Mar 29 02:29:12.544440 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2023/4261] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:11 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1722 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:12.859896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:12.874544 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a050d542-5a4e-439e-a562-d162ccd76a88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.345457 Mar 29 02:29:12.886701 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2239/4262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:12 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:13.059175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:13.060127 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88a1c556-d409-49b3-aaa8-347ff71d7690 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001306 Mar 29 02:29:13.060457 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2024/4263] 10.222.0.36 () {56 vars in 885 bytes} [Tue Mar 29 02:29:13 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Mar 29 02:29:13.560269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:13.565992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:13.568526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:13.569004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:13.570113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:13.570759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:13.891649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:13.892327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:13.903675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:13.904130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:13.904945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:13.905382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:14.196809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:14.214882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30fc797f-da43-492e-bd42-2d53209e066f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1699 microversion: 2.1 time: 0.658261 Mar 29 02:29:14.228818 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2240/4264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:13 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1699 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:14.234245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6a2f7c7f-76f1-4f46-9969-32b4d8eed7df tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:14.242766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a2f7c7f-76f1-4f46-9969-32b4d8eed7df tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:14.243519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a2f7c7f-76f1-4f46-9969-32b4d8eed7df tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:14.331123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6a2f7c7f-76f1-4f46-9969-32b4d8eed7df tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Going to try to start instance {{(pid=103513) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 02:29:14.616119 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6a2f7c7f-76f1-4f46-9969-32b4d8eed7df tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action" status: 202 len: 0 microversion: 2.1 time: 0.385379 Mar 29 02:29:14.617685 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2241/4265] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:29:14 2022] POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:29:14.627471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:14.628468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:14.649680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:14.649680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:14.649680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:14.649680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:14.851762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:14.866985 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f774ea28-35a8-4c92-aaa1-1ad829b7bfce tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.978955 Mar 29 02:29:14.868118 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2025/4266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:13 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:29:14.910363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:14.920162 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0e14fdc-b433-40d3-9275-638551d2e218 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1708 microversion: 2.1 time: 0.297762 Mar 29 02:29:14.920748 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2242/4267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:14 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1708 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:15.884797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:15.884797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:15.889095 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:29:15.902553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:15.903005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:15.903808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:15.904253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:15.937174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:15.937794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:15.956464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:15.956588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:15.957409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:15.957845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:16.351995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:16.365724 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f652ae8-35c3-490f-99ec-f4ac07546dc1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1708 microversion: 2.1 time: 0.432090 Mar 29 02:29:16.377273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2243/4268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:15 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1708 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:29:16.901133 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 41988. Mar 29 02:29:17.311311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:17.349935 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80c48615-a2bd-42a1-ae0d-46ba79277387 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 1.470217 Mar 29 02:29:17.355636 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2026/4269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:15 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:17.383539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:17.384475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:17.398263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:17.398263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:17.399267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:17.399805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:18.051884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:18.067220 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f28fe168-ca5e-4638-9f99-2397066fecb3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1708 microversion: 2.1 time: 0.686090 Mar 29 02:29:18.069440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2244/4270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:17 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1708 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:18.372577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:18.373388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:18.395104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:18.395104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:18.395104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:18.395104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:18.986626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:19.000094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56326079-d72f-42e4-b44c-533f6043dd2e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.629520 Mar 29 02:29:19.003003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2027/4271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:18 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:19.089920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:19.090530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:19.097933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:19.098494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:19.099492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:19.099648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:19.398343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:19.407804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63fcc6f2-6ab4-48ca-af6b-7c3068b8db57 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1712 microversion: 2.1 time: 0.322097 Mar 29 02:29:19.408404 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2245/4272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:19 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1712 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:20.016268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:20.017225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:20.032043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:20.034654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:20.034654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:20.034654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:20.166159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d9d159a-ab36-42a4-8d10-a1da651a9555 tempest-ExtensionsTest-1347855582 tempest-ExtensionsTest-1347855582-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:20.168892 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d9d159a-ab36-42a4-8d10-a1da651a9555 tempest-ExtensionsTest-1347855582 tempest-ExtensionsTest-1347855582-project] 10.222.0.36 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.148155 Mar 29 02:29:20.169391 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2246/4273] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:29:20 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:20.176901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6350e9da-eeb3-44c0-963d-8ef403e27ea9 tempest-ExtensionsTest-1347855582 tempest-ExtensionsTest-1347855582-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:20.179519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6350e9da-eeb3-44c0-963d-8ef403e27ea9 tempest-ExtensionsTest-1347855582 tempest-ExtensionsTest-1347855582-project] 10.222.0.36 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006292 Mar 29 02:29:20.180908 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2247/4274] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Mar 29 02:29:20 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:29:20.482846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e4b7b7b1-c394-46fa-91f3-8066aac34014 req-4c2ad402-3e3c-4fa3-bb1d-f6666a6bcd30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93826ed0-0fd6-4652-8603-ba461565cad0", "name": "network-vif-plugged", "status": "completed", "tag": "f03bdbd5-8418-4d0c-9f09-33a5b812d55c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:20.485098 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:29:20.485098 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:29:20.496510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e4b7b7b1-c394-46fa-91f3-8066aac34014 req-4c2ad402-3e3c-4fa3-bb1d-f6666a6bcd30 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:20.497208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e4b7b7b1-c394-46fa-91f3-8066aac34014 req-4c2ad402-3e3c-4fa3-bb1d-f6666a6bcd30 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:20.516953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e4b7b7b1-c394-46fa-91f3-8066aac34014 req-4c2ad402-3e3c-4fa3-bb1d-f6666a6bcd30 service nova] Creating event network-vif-plugged:f03bdbd5-8418-4d0c-9f09-33a5b812d55c for instance 93826ed0-0fd6-4652-8603-ba461565cad0 on n-h2-828148-1 Mar 29 02:29:20.522825 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e4b7b7b1-c394-46fa-91f3-8066aac34014 req-4c2ad402-3e3c-4fa3-bb1d-f6666a6bcd30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045957 Mar 29 02:29:20.524094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2248/4275] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:20.772381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:20.780906 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1b308ec-9f47-4a2f-bb83-0b42f5db739a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.768351 Mar 29 02:29:20.792270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2028/4276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:20 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:21.798373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:21.799733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:21.814284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:21.814284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:21.814284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:21.814284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:22.246429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:22.254877 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21130570-6ddf-4b21-9b3a-4a988cfa0873 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1314 microversion: 2.1 time: 0.460685 Mar 29 02:29:22.277259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2249/4277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:21 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:23.283957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:23.283957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:23.292582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:23.293632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:23.294104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:23.294392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:24.054440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:24.068878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4243710-8acd-46a9-a0c7-fd165fff9740 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1501 microversion: 2.1 time: 0.789115 Mar 29 02:29:24.079013 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2029/4278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:23 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1501 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:27.393808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e29790ed-9228-4daa-8e1c-fd9d549c6449 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f87241728b0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:27.491345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4aa3d57-34cf-4524-8bc2-1611831ab708"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:27.492076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:27.516994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:27.516994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:27.516994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:27.516994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:27.560954 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e29790ed-9228-4daa-8e1c-fd9d549c6449 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/328b8ad9-cee3-403e-9efb-ee33aa5cf224" status: 200 len: 351 microversion: 2.1 time: 0.176634 Mar 29 02:29:27.570512 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2250/4279] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:29:27 2022] GET /compute/v2.1/os-volumes/328b8ad9-cee3-403e-9efb-ee33aa5cf224 => generated 351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:28.624495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3feb4d6-aef6-4a7c-a896-f1df6c282a60 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.137536 Mar 29 02:29:28.627209 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2030/4280] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:29:27 2022] POST /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0/os-volume_attachments => generated 194 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:30.703862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41cb678b-96eb-4ae6-afff-5ac95ff8d888 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717e79040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:30.851275 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-41cb678b-96eb-4ae6-afff-5ac95ff8d888 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7ef1e42f-2c98-4b67-b4eb-469232bffa1d" status: 200 len: 350 microversion: 2.1 time: 0.163153 Mar 29 02:29:30.851275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2251/4281] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:29:30 2022] GET /compute/v2.1/os-volumes/7ef1e42f-2c98-4b67-b4eb-469232bffa1d => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:34.058050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3409f38-57b6-435f-a3b4-e6f8927cd589 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717e55ee0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.183787 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a3409f38-57b6-435f-a3b4-e6f8927cd589 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/5b660593-7b3f-4c7e-aa2f-60254bd25b32" status: 200 len: 350 microversion: 2.1 time: 0.135301 Mar 29 02:29:34.184887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2031/4282] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes/5b660593-7b3f-4c7e-aa2f-60254bd25b32 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:34.196673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-664062c8-2b76-4c74-aeed-a147c990f7e0 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717e79f70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.313876 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-664062c8-2b76-4c74-aeed-a147c990f7e0 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.121532 Mar 29 02:29:34.314450 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2252/4283] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:34.327229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5decd70-2976-4c5b-b783-43282c935c3a tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8724d1b9d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.425650 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5decd70-2976-4c5b-b783-43282c935c3a tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102085 Mar 29 02:29:34.440002 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2032/4284] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:34.443775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5ac2ab8-779a-434f-975f-ec6c743d29a1 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717e79550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.537106 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5ac2ab8-779a-434f-975f-ec6c743d29a1 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099756 Mar 29 02:29:34.537792 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2253/4285] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:34.549852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6abd4a73-b7d5-4517-80a5-e038e8bdcdf0 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8724d1b0d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.756603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6abd4a73-b7d5-4517-80a5-e038e8bdcdf0 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.210474 Mar 29 02:29:34.765898 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2033/4286] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:34.774585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da2c54fd-b70e-4d92-8ced-350bd00c358a tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717e82e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:34.924697 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da2c54fd-b70e-4d92-8ced-350bd00c358a tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.157523 Mar 29 02:29:34.925291 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2254/4287] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:29:34.944955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec21558e-48b8-4892-902e-72820bf6d5dd tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8717d57310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:35.061445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec21558e-48b8-4892-902e-72820bf6d5dd tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.125407 Mar 29 02:29:35.065315 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2034/4288] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:29:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:35.075166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-939c4829-5ca3-44ef-ab33-bbb31bb1e6b9 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8724c6df70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:35.199100 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-939c4829-5ca3-44ef-ab33-bbb31bb1e6b9 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.129263 Mar 29 02:29:35.211806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9618d02a-f6f2-4c7c-b8f5-1f0032f58289 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] Calling method '.version_select at 0x7f8724059dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:35.213518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2255/4289] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Mar 29 02:29:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:35.322333 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9618d02a-f6f2-4c7c-b8f5-1f0032f58289 tempest-VolumesTestJSON-544390962 tempest-VolumesTestJSON-544390962-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.114019 Mar 29 02:29:35.329997 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2035/4290] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:29:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:38.400938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:38.407047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:38.415824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:38.416982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:38.425813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:38.425813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:38.510142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:29:38.991041 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bf2b9ee-2c7d-4a9e-9514-59104f4a6ff6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 204 len: 0 microversion: 2.1 time: 0.594020 Mar 29 02:29:38.995184 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2256/4291] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:29:38 2022] DELETE /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:29:39.001374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:39.002186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:39.019613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:39.019613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:39.019613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:39.019613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:39.314066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:39.327637 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cada833d-53fb-42ce-b5c1-1275a588f786 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1553 microversion: 2.1 time: 0.330930 Mar 29 02:29:39.328331 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2036/4292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:38 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:40.347773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:40.348509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:40.365012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:40.378234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:40.383003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:40.383865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:41.002860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:41.015816 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6eea85c-8db3-43c6-a87f-36d79e3e6e0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1553 microversion: 2.1 time: 0.672487 Mar 29 02:29:41.018656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2257/4293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:40 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1553 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:42.036772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:42.038239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:42.053298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:42.054483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:42.057556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:42.062913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:42.346403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:42.375791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ac202163-0526-4d35-a62e-ed495820dd09 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1511 microversion: 2.1 time: 0.343380 Mar 29 02:29:42.390096 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2037/4294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:42 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1511 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:42.558525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a900ffd2-0d2b-4b18-9b4d-075b99f7e674 req-53cb124b-3fe7-416f-83fd-f446ff34a943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93826ed0-0fd6-4652-8603-ba461565cad0", "name": "network-vif-deleted", "tag": "f03bdbd5-8418-4d0c-9f09-33a5b812d55c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:42.560056 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:29:42.560056 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:29:42.568981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a900ffd2-0d2b-4b18-9b4d-075b99f7e674 req-53cb124b-3fe7-416f-83fd-f446ff34a943 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:42.569966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a900ffd2-0d2b-4b18-9b4d-075b99f7e674 req-53cb124b-3fe7-416f-83fd-f446ff34a943 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:42.630286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a900ffd2-0d2b-4b18-9b4d-075b99f7e674 req-53cb124b-3fe7-416f-83fd-f446ff34a943 service nova] Creating event network-vif-deleted:f03bdbd5-8418-4d0c-9f09-33a5b812d55c for instance 93826ed0-0fd6-4652-8603-ba461565cad0 on n-h2-828148-1 Mar 29 02:29:42.651861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a900ffd2-0d2b-4b18-9b4d-075b99f7e674 req-53cb124b-3fe7-416f-83fd-f446ff34a943 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095081 Mar 29 02:29:42.656328 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2258/4295] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:43.396413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:43.403087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:43.415195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:43.417085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:43.418090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:43.420162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:43.823620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:43.861602 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-955c2788-d916-4455-b362-cc65699a6eaf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1345 microversion: 2.1 time: 0.449717 Mar 29 02:29:43.861602 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2038/4296] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:43 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1345 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:44.846555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49f9d245-eb6d-4100-aafb-85be76fa6aa4"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:44.848437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:44.875407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:44.875949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:44.890158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:44.892450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:44.896220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:44.907289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:44.907642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:44.907716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:44.907716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:44.910828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:45.306397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:45.309061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:45.316285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'fault' on Instance uuid 93826ed0-0fd6-4652-8603-ba461565cad0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:29:45.532629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:45.566247 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6070d313-e2ba-4f1f-86e8-488db6db4dc8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 200 len: 1304 microversion: 2.1 time: 0.695915 Mar 29 02:29:45.567245 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2039/4297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:44 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 1304 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:29:46.444351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d7bddcd-0ded-48fe-8cf0-662db5a677ee tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.601956 Mar 29 02:29:46.445833 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2259/4298] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:29:44 2022] POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments => generated 194 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:29:46.584562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:46.585306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:46.628735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:46.629241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:46.631870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:46.632341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:46.769419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. Mar 29 02:29:46.772145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:46.773292 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f56f9156-8aba-47d5-8738-3dee19437e39 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 404 len: 111 microversion: 2.1 time: 0.193232 Mar 29 02:29:46.774178 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2260/4299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:46 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:29:47.126192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:47.127281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:47.150371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:47.151245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:47.159235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:47.159235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:47.196648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:47.198414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:47.215077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:47.216439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:47.217919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:47.219965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:47.313575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. Mar 29 02:29:47.314380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:47.315377 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6a5aca5-21a5-4b95-acde-bf8382abf8c6 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.193082 Mar 29 02:29:47.316594 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2261/4300] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:29:47 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0/os-volume_attachments => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:29:47.900335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2085408458", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:48.037928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:29:48.437535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:48.455160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:48.457199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:48.457929 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c11f20dd-1415-4e95-a15a-a8039d7c490f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2952 microversion: 2.42 time: 1.985391 Mar 29 02:29:48.458494 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2040/4301] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:29:46 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2952 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:29:48.497728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:48.498228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:48.516915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:48.516915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:48.516915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:48.516915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:49.511722 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddb992af-81c0-4fd4-a35b-b992e527f633 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba/os-interface" status: 200 len: 1832 microversion: 2.42 time: 1.017596 Mar 29 02:29:49.524436 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2041/4302] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:29:48 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba/os-interface => generated 1832 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:29:50.567633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:29:50.568617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:29:50.569233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:29:50.570212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:29:50.571066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:29:50.583598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:50.584251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:50.585238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:50.586301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:50.609475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:29:50.615580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:29:50.665149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:29:50.667485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:29:50.892163 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68c32e58-6768-4430-be8e-0bfc5615b3a4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.991606 Mar 29 02:29:50.894123 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2262/4303] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:29:50.905120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bcaf8ce-3643-4da3-9634-13d9c1218c3a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:50.905724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bcaf8ce-3643-4da3-9634-13d9c1218c3a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:51.010160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bcaf8ce-3643-4da3-9634-13d9c1218c3a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:51.023903 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bcaf8ce-3643-4da3-9634-13d9c1218c3a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1" status: 200 len: 1215 microversion: 2.1 time: 0.121756 Mar 29 02:29:51.035097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2042/4304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:50 2022] GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:51.040687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:51.041215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:51.075645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:29:51.897162 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.scheduler.client.report [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Deleted allocation for instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 Mar 29 02:29:51.910261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Instance Mapping does not exist while attempting local delete cleanup. Mar 29 02:29:51.911647 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87e015a3-d251-48b7-ab9d-59c5d96d9184 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1" status: 204 len: 0 microversion: 2.1 time: 0.874855 Mar 29 02:29:51.918417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2263/4305] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:29:51 2022] DELETE /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:29:51.923284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ac9ae32-cfeb-4b0a-889d-3847ef4fb20f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:51.924443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ac9ae32-cfeb-4b0a-889d-3847ef4fb20f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:51.942148 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-3ac9ae32-cfeb-4b0a-889d-3847ef4fb20f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. Mar 29 02:29:51.942148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ac9ae32-cfeb-4b0a-889d-3847ef4fb20f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:29:51.948321 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ac9ae32-cfeb-4b0a-889d-3847ef4fb20f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1" status: 404 len: 111 microversion: 2.1 time: 0.021717 Mar 29 02:29:51.948321 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2043/4306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:51 2022] GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:29:52.119743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1278799805", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:52.243239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:29:54.452073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:29:54.452808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:29:54.453047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:29:54.453677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:29:54.453827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:29:54.497459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:54.497459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:54.497459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:54.497459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:54.527177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:29:54.548888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:29:54.563036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:29:54.565932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:29:54.811379 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e459c95c-3cf8-4e9b-9b0f-86c657f5ef82 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.696409 Mar 29 02:29:54.813251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2264/4307] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:29:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:29:54.832012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab41c4e2-dc62-4482-aa29-a1e547444f6f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:54.832569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab41c4e2-dc62-4482-aa29-a1e547444f6f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:55.012185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab41c4e2-dc62-4482-aa29-a1e547444f6f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:55.024242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab41c4e2-dc62-4482-aa29-a1e547444f6f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1215 microversion: 2.1 time: 0.203644 Mar 29 02:29:55.024242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2044/4308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:54 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:56.059654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c92a173-14f2-4710-b84b-907aac3234cb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:56.059654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c92a173-14f2-4710-b84b-907aac3234cb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:56.325540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c92a173-14f2-4710-b84b-907aac3234cb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:56.342092 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c92a173-14f2-4710-b84b-907aac3234cb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1215 microversion: 2.1 time: 0.306069 Mar 29 02:29:56.355066 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2265/4309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:56 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:57.360088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:57.360823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:57.374858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:57.375414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:57.382798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:57.382798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:57.508577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:29:57.509810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:57.518093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:57.518690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:57.519809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:57.520306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:57.604114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'flavor' on Instance uuid 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:29:57.707731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:57.718362 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec334e1a-79bf-40b1-b44e-cdaa03167f7d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1267 microversion: 2.1 time: 0.362482 Mar 29 02:29:57.747692 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2045/4310] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:57 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1267 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:58.335859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7ea1530-a49d-401a-894e-f8a947a421e0 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/action" status: 200 len: 32 microversion: 2.1 time: 0.837701 Mar 29 02:29:58.339355 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2266/4311] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:29:57 2022] POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/action => generated 32 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:29:58.347674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:58.348288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:58.373588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:58.374267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:58.374907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:58.375330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:58.762306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:29:58.763016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:29:58.775125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:58.784452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:58.784798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:29:58.786374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:29:59.094749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:59.098663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:29:59.114674 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-652013e3-a795-463a-a0c2-e492153c3ab5 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.764232 Mar 29 02:29:59.117127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2046/4312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:58 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:29:59.129974 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e925bbd-c165-47a9-ab74-0f837224079b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1273 microversion: 2.1 time: 0.372399 Mar 29 02:29:59.139856 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2267/4313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:29:58 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:00.132179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:00.132791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:00.143611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:00.144323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:00.145139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:00.145581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:00.148054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:00.148683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:00.161957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:00.162434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:00.163788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:00.164221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:01.029970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:01.042870 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-767708ab-232a-45c2-bfc2-850e58220325 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.897672 Mar 29 02:30:01.044273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2268/4314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:00 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:01.154999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:01.171378 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2562e520-43b6-49f0-bc55-ca6901dab60a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 1.042959 Mar 29 02:30:01.172612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2047/4315] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:00 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:02.062095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:02.063395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:02.078934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:02.079488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:02.081927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:02.082460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:02.195006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:02.195780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:02.219269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:02.219722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:02.221767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:02.229690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:02.611924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:02.638067 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-274200d9-76e1-48c1-ab01-e7551358280e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.576836 Mar 29 02:30:02.651933 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2269/4316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:02 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:02.651933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-13164e2b-af22-4305-936d-d6e4be954685 req-5bda06ab-0963-4580-8aae-5074a769f9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5011319a-67dc-42f5-ba72-584c3a97cfe6", "tag": "8eedd387-1433-45e5-8fc9-6eaf0f077201"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:02.654573 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:02.654573 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:30:02.692964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-13164e2b-af22-4305-936d-d6e4be954685 req-5bda06ab-0963-4580-8aae-5074a769f9a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:02.693656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-13164e2b-af22-4305-936d-d6e4be954685 req-5bda06ab-0963-4580-8aae-5074a769f9a3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:02.717943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-13164e2b-af22-4305-936d-d6e4be954685 req-5bda06ab-0963-4580-8aae-5074a769f9a3 service nova] Creating event network-changed:8eedd387-1433-45e5-8fc9-6eaf0f077201 for instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 on n-h2-828148-1 Mar 29 02:30:02.724750 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-13164e2b-af22-4305-936d-d6e4be954685 req-5bda06ab-0963-4580-8aae-5074a769f9a3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080582 Mar 29 02:30:02.726493 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2270/4317] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:03.301746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:03.334019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-006a5481-9bf9-4a2e-b976-f68b68fec100 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 1.145636 Mar 29 02:30:03.337298 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2048/4318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:02 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:03.660104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:03.660926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:03.679504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:03.679860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:03.681359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:03.681871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:04.354115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:04.355483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:04.367081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:04.372342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:04.373667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:04.375756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:04.639372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:04.649322 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea384b02-baf7-44fc-bff7-10d16a97c5ee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.993324 Mar 29 02:30:04.663180 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2271/4319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:03 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:04.834804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:04.847483 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-067fdb08-2b3e-492d-8605-51dfdeed50dc tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.498018 Mar 29 02:30:04.849500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2049/4320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:04 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:05.670098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:05.670785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:05.682571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:05.683013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:05.685183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:05.686852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:05.866216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:05.866817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:05.882067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:05.883557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:05.885786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:05.888660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:06.437334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:06.448809 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34e99815-b246-4a5b-9e94-e1f0cd26b0bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.782673 Mar 29 02:30:06.452364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2272/4321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:05 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:06.566415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:06.576433 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30731c34-f4bb-4faf-ba74-983faf2d4b2a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.713903 Mar 29 02:30:06.578949 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2050/4322] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:05 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:07.466962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:07.467581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:07.482031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:07.482031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:07.482031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:07.482031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:07.599177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:07.599788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:07.619306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:07.619306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:07.621088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:07.621542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:07.989055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:08.001526 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c9f63c5a-726a-4160-a082-2e27e60c425b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.405919 Mar 29 02:30:08.018903 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2051/4323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:07 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:08.555189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:08.563262 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f16d1fc-337c-4b95-83bd-84a2eaf2b8be tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 1.100281 Mar 29 02:30:08.564887 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2273/4324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:07 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:09.019861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:09.020560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:09.041943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:09.045342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:09.048289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:09.050064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:09.580430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:09.583491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:09.589433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:09.590183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:09.591149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:09.591741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:09.996724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:10.009635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5ea4567-940b-4909-9b23-3172cbb31b31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.993927 Mar 29 02:30:10.017329 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2052/4325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:09 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:10.039592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:10.050798 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5004985-612b-460b-8169-635604f86410 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.474952 Mar 29 02:30:10.052206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2274/4326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:09 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:11.028718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:11.029357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:11.036673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:11.041285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:11.042104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:11.042541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:11.068345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:11.070097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:11.085426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:11.086125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:11.087066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:11.087650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:11.374419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:11.384158 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-556ae652-2a20-45ff-9f1f-6ee519b3132e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.359191 Mar 29 02:30:11.384929 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2053/4327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:11 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:11.389472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8f91558f-79b8-40ab-b995-d9c77871683e req-efcd1aa0-02b0-46f3-a624-046b90213fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5011319a-67dc-42f5-ba72-584c3a97cfe6", "name": "network-vif-plugged", "status": "completed", "tag": "8eedd387-1433-45e5-8fc9-6eaf0f077201"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:11.391320 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:11.391320 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:30:11.399955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8f91558f-79b8-40ab-b995-d9c77871683e req-efcd1aa0-02b0-46f3-a624-046b90213fcf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:11.408761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8f91558f-79b8-40ab-b995-d9c77871683e req-efcd1aa0-02b0-46f3-a624-046b90213fcf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:11.417867 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8f91558f-79b8-40ab-b995-d9c77871683e req-efcd1aa0-02b0-46f3-a624-046b90213fcf service nova] Creating event network-vif-plugged:8eedd387-1433-45e5-8fc9-6eaf0f077201 for instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 on n-h2-828148-1 Mar 29 02:30:11.432602 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8f91558f-79b8-40ab-b995-d9c77871683e req-efcd1aa0-02b0-46f3-a624-046b90213fcf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046226 Mar 29 02:30:11.433454 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2054/4328] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:11.869902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:11.891277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcd3635e-adcc-4c00-b1bc-76757f4cbe88 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.826404 Mar 29 02:30:11.891876 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2275/4329] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:11 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:12.404119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:12.405726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:12.426619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:12.427127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:12.429209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:12.429658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:12.908159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:12.909607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:12.922816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:12.923522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:12.929933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:12.930728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:13.181933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:13.197800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c99dd158-c8a3-4549-9a2d-ef2130c1150c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.797715 Mar 29 02:30:13.199342 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2055/4330] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:12 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:13.290111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:13.291825 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dab686a-5f92-4870-a1f5-84b247c251e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1315 microversion: 2.1 time: 0.387225 Mar 29 02:30:13.292557 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2276/4331] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:12 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:14.232140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:14.234188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:14.244544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.245194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.250526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.253361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.309574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:14.310259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:14.323107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.323472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.324259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.324690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.764952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:14.779639 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2ac37f9-41ca-43fd-af99-371fa16093ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1501 microversion: 2.1 time: 0.473653 Mar 29 02:30:14.780486 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2277/4332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:14 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1501 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:14.790762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:14.794512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:14.812548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.813310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.814281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.814905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.860108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:14.869082 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59ce1947-6752-4d03-a14e-0b71a54e5636 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.657288 Mar 29 02:30:14.882654 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2056/4333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:14 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:14.888276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:14.889359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:14.899234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.899843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:14.900796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:14.901444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:15.094067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lazy-loading 'services' on Instance uuid b4bcada5-07ad-40f0-964c-d303c7d91936 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:30:15.192896 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-def6c78f-a9d2-4c3d-9147-4dac2a9f9a7e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6/action" status: 202 len: 0 microversion: 2.1 time: 0.308671 Mar 29 02:30:15.194512 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2057/4334] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:30:14 2022] POST /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:15.202787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:15.205352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:15.222155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:15.222610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:15.225317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:15.226545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:15.502407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2887a4df-9279-4acd-b570-1e9a8e068475 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments/26f98c49-1b90-4350-8708-aa6deba55750" status: 202 len: 0 microversion: 2.1 time: 0.720397 Mar 29 02:30:15.503019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2278/4335] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:30:14 2022] DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments/26f98c49-1b90-4350-8708-aa6deba55750 => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:15.808542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:15.822443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c28cedd-79d7-47b1-9be6-cae61539931d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1506 microversion: 2.1 time: 0.623735 Mar 29 02:30:15.823606 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2058/4336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:15 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:15.886714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:15.887422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:15.895867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:15.902998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:15.902998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:15.902998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:16.180001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:16.194571 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d93d5ec-7a95-4569-938f-c783cb7f0371 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.309890 Mar 29 02:30:16.227943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2279/4337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:15 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:16.840717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:16.841371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:16.858132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:16.858959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:16.862120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:16.863128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.211233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:17.211857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:17.236494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.238526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.241503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.242298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.455773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:17.465729 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8466c5b3-236e-4c53-a08f-6b3496533855 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1486 microversion: 2.1 time: 0.629596 Mar 29 02:30:17.466813 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2059/4338] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:16 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1486 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:17.471973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d9f373c-981f-4b0d-97c9-5579155d2b91 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:17.480627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d9f373c-981f-4b0d-97c9-5579155d2b91 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.482296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d9f373c-981f-4b0d-97c9-5579155d2b91 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.577914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d9f373c-981f-4b0d-97c9-5579155d2b91 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Going to try to stop instance {{(pid=103514) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:30:17.646034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:17.674723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-67aa036f-6e3d-4faa-93c6-6bdd9c0c9f68 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.468179 Mar 29 02:30:17.689111 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2280/4339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:17 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:17.702568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:17.706181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:17.717677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.717677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.717677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.717677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.844440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:30:17.883597 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d9f373c-981f-4b0d-97c9-5579155d2b91 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action" status: 202 len: 0 microversion: 2.1 time: 0.415394 Mar 29 02:30:17.886756 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2060/4340] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:30:17 2022] POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:17.893017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:17.896005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:17.905935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.906388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:17.907454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:17.907939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:18.234889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58cffb55-6ee4-47e7-903a-995696804efc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 204 len: 0 microversion: 2.1 time: 0.543944 Mar 29 02:30:18.235617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2281/4341] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:30:17 2022] DELETE /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:30:18.243901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:18.244786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:18.262279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:18.262818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:18.263693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:18.264141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:18.465856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:18.475345 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-099e341e-9a20-431d-8360-7030361d1ec9 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.586459 Mar 29 02:30:18.476480 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2061/4342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:17 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:18.653086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:18.663024 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db0f8f81-6269-4309-b772-fa04df6094c2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1492 microversion: 2.1 time: 0.423023 Mar 29 02:30:18.673914 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2282/4343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:18 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1492 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:18.704651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:18.705299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:18.716608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:18.717088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:18.721041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:18.721476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:19.314171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:19.323090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d51dfcd-0b22-4838-8555-13581ead5e3b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1736 microversion: 2.1 time: 0.622219 Mar 29 02:30:19.333110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2062/4344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:18 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1736 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:19.493921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:19.494866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:19.502846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:19.503296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:19.510277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:19.510277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:19.680694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:19.681434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:19.701146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:19.702345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:19.705136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:19.706630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:19.926736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:19.948033 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9194663a-bf98-4686-bbc8-41a13094de21 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.456606 Mar 29 02:30:19.950519 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2283/4345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:19 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:20.340747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:20.341406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:20.355625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:20.356450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:20.357487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:20.359434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:20.360098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:20.365609 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d70902d3-d702-4957-9b6a-d059f7afe21b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1492 microversion: 2.1 time: 0.689296 Mar 29 02:30:20.366193 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2063/4346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:19 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1492 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:20.816592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:20.829028 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-779151d3-1fd2-427a-8c94-7df9ca636e7f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1716 microversion: 2.1 time: 0.492035 Mar 29 02:30:20.829605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2284/4347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:20 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1716 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:20.970830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:20.972254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:20.999025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:20.999480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.000417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.001238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.146965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:21.151059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:21.199325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.204226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.207452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.216136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.453252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Cannot 'detach_volume' instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 while it is in vm_state rescued Mar 29 02:30:21.454055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 409 to user: Cannot 'detach_volume' instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 while it is in vm_state rescued {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:30:21.455696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e535ccbb-c324-496b-9ce5-4d09aaf63945 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments/49f9d245-eb6d-4100-aafb-85be76fa6aa4" status: 409 len: 152 microversion: 2.1 time: 0.316841 Mar 29 02:30:21.458700 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2285/4348] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:30:21 2022] DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments/49f9d245-eb6d-4100-aafb-85be76fa6aa4 => generated 152 bytes in 319 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:30:21.466317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:21.467087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:21.477298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.478085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.479143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.479844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.712751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:21.729117 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86d5bff8-c11e-4a31-8b50-ef307791e5c4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1450 microversion: 2.1 time: 0.271359 Mar 29 02:30:21.731881 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2286/4349] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:21 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1450 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:21.743323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-18c431bd-1356-4baf-a567-bb548a1f481a req-11d66018-529c-4b20-a6e9-e2389ecf5704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5011319a-67dc-42f5-ba72-584c3a97cfe6", "name": "network-vif-deleted", "tag": "8eedd387-1433-45e5-8fc9-6eaf0f077201"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:21.744926 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:21.744926 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:30:21.760721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18c431bd-1356-4baf-a567-bb548a1f481a req-11d66018-529c-4b20-a6e9-e2389ecf5704 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.761278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18c431bd-1356-4baf-a567-bb548a1f481a req-11d66018-529c-4b20-a6e9-e2389ecf5704 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.783047 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-18c431bd-1356-4baf-a567-bb548a1f481a req-11d66018-529c-4b20-a6e9-e2389ecf5704 service nova] Creating event network-vif-deleted:8eedd387-1433-45e5-8fc9-6eaf0f077201 for instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 on n-h2-828148-1 Mar 29 02:30:21.788172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-18c431bd-1356-4baf-a567-bb548a1f481a req-11d66018-529c-4b20-a6e9-e2389ecf5704 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049061 Mar 29 02:30:21.788993 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2287/4350] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:21.794703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:21.795362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:21.808541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.809085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:21.810157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:21.811052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.002653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:22.015046 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-afcf867c-0301-4416-a0df-26768fe13847 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 1.052100 Mar 29 02:30:22.025909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2064/4351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:20 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:22.198938 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-955457aa-b70a-4c5f-89a4-eccfbfe0d524 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/action" status: 202 len: 0 microversion: 2.1 time: 0.408391 Mar 29 02:30:22.199652 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2288/4352] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:30:21 2022] POST /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:22.208792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:22.209519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:22.219943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:22.220398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.221216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:22.221846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.637503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:22.647617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-595696c9-e25e-47a0-b83e-65bdda1b49eb tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1724 microversion: 2.1 time: 0.443508 Mar 29 02:30:22.648189 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2065/4353] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:22 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1724 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:22.749257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:22.750188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:22.759935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:22.760770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.761751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:22.762353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.853945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:22.854663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:22.855113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'fault' on Instance uuid 5011319a-67dc-42f5-ba72-584c3a97cfe6 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:30:22.947202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:22.959290 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87b6a3ba-0d3d-4201-ab5c-2e29d737e086 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 200 len: 1305 microversion: 2.1 time: 0.213383 Mar 29 02:30:22.960402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2289/4354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:22 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 1305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:23.035215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:23.038545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:23.060974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.061519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:23.062348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.062795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:23.665209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:23.670433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:23.691532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.692625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:23.695065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.696768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:23.778615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:23.786992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-339a74e8-abec-4645-8284-051d1163cefc tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.758060 Mar 29 02:30:23.800753 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2066/4355] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:23 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:23.976709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:23.977588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:23.985753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.986091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:23.987258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:23.988248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:24.050448 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. Mar 29 02:30:24.051739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:30:24.052795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7740506-3c63-405c-a508-fed82aed568c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 404 len: 111 microversion: 2.1 time: 0.080122 Mar 29 02:30:24.053853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2067/4356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:23 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:30:24.241932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-649646670", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:24.362194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:30:24.895317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:24.904533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9637db4e-587c-4ae8-a752-56b637b4dd31 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1724 microversion: 2.1 time: 1.243563 Mar 29 02:30:24.913355 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2290/4357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:23 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1724 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:24.919697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:24.919697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:24.926718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:24.927660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:24.928434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:24.929098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:25.150774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:25.161853 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-97d7331e-18c2-48fc-8c63-78cc6feb3a9b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.247163 Mar 29 02:30:25.171674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2291/4358] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:24 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:25.272632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:30:25.273137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:30:25.273759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:30:25.274325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:30:25.274838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:30:25.283887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:25.284627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:25.285906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:25.287104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:25.306830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:30:25.312632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:30:25.324694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:30:25.327249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:30:25.443081 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d747669-683e-4266-87e5-477919fb4b0f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206827 Mar 29 02:30:25.444988 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2068/4359] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:30:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:30:25.456104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ac049f1-b768-40a4-af9c-4e29e9c29b70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:25.458030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ac049f1-b768-40a4-af9c-4e29e9c29b70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:25.785721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ac049f1-b768-40a4-af9c-4e29e9c29b70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:25.801197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ac049f1-b768-40a4-af9c-4e29e9c29b70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1214 microversion: 2.1 time: 0.350225 Mar 29 02:30:25.801780 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2292/4360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:25 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:25.922846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:25.923459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:25.940747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:25.941244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:25.942030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:25.942478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:26.179871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:26.180539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:26.194498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:26.194967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:26.195768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:26.196209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:26.224432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:26.238759 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51be077e-12df-4303-accb-d6b80618abb8 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1724 microversion: 2.1 time: 0.320346 Mar 29 02:30:26.239549 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2069/4361] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:25 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:26.785937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:26.798483 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f22679a-a052-4124-9e17-f70f226118f2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.623163 Mar 29 02:30:26.808622 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2293/4362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:26 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:26.818362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:26.818977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:26.830844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:26.831298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:26.832081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:26.832526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:26.967769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:26.981840 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b804af9d-b2fd-4414-ae45-610414ebb872 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1218 microversion: 2.1 time: 0.167619 Mar 29 02:30:26.985671 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2070/4363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:26 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:27.257832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:27.259948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:27.269013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.269546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:27.270512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.271523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:27.774427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:27.781630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f80f4791-6331-402f-a38f-d04aa3943302 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1730 microversion: 2.1 time: 0.528916 Mar 29 02:30:27.782542 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2294/4364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:27 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1730 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:27.799172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:27.799659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:27.808087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.808781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:27.809770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.820703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:27.824426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:27.831618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:27.845410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.848008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:27.849504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:27.851777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:28.008384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a945c0b-237f-4ee2-9378-c984dfea72ac tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.213311 Mar 29 02:30:28.009469 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2071/4365] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:30:27 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:28.016691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:28.023520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:28.029320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:28.030726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:28.031968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:28.032636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:28.249477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:28.262733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eeaff198-cce1-4575-85d1-472e81deab11 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1274 microversion: 2.1 time: 0.251656 Mar 29 02:30:28.273187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2072/4366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:28 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:28.751872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:28.760617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cf3e03c-dc76-45f1-9cfb-1a7c99048b2e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1676 microversion: 2.1 time: 0.949050 Mar 29 02:30:28.762253 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2295/4367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:27 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1676 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:29.282497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:29.283734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:29.303437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:29.305186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:29.309208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:29.310997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:29.610988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:29.639986 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ef2557d-4242-4d4a-aaef-20a7f4f859fd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1272 microversion: 2.1 time: 0.361799 Mar 29 02:30:29.647229 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2073/4368] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:29 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1272 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:29.779612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:29.780378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:29.789242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:29.790042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:29.791034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:29.792006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:30.492022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:30.506646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39719a21-9d19-4642-8c03-f7b3fd82c81b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1653 microversion: 2.1 time: 0.731288 Mar 29 02:30:30.510557 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2296/4369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:29 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1653 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:30.533524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a040ab5a-89eb-412f-ac48-49a10c271972 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:30.545728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a040ab5a-89eb-412f-ac48-49a10c271972 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:30.546492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a040ab5a-89eb-412f-ac48-49a10c271972 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:30.664242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:30.665044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:30.689523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:30.691304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:30.692238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:30.695629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:30.763617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a040ab5a-89eb-412f-ac48-49a10c271972 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Going to try to start instance {{(pid=103514) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 02:30:31.043821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a040ab5a-89eb-412f-ac48-49a10c271972 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action" status: 202 len: 0 microversion: 2.1 time: 0.516209 Mar 29 02:30:31.044795 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2074/4370] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:30:30 2022] POST /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:31.052753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b0b21166-2325-426d-a91a-0388fab0f0f1 req-774fca8e-8c71-480d-b0a1-1ebc73fbefdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:31.057359 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:31.057359 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:30:31.079099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b0b21166-2325-426d-a91a-0388fab0f0f1 req-774fca8e-8c71-480d-b0a1-1ebc73fbefdc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:31.079793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b0b21166-2325-426d-a91a-0388fab0f0f1 req-774fca8e-8c71-480d-b0a1-1ebc73fbefdc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:31.112218 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b0b21166-2325-426d-a91a-0388fab0f0f1 req-774fca8e-8c71-480d-b0a1-1ebc73fbefdc service nova] Creating event network-changed:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:30:31.120362 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b0b21166-2325-426d-a91a-0388fab0f0f1 req-774fca8e-8c71-480d-b0a1-1ebc73fbefdc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073757 Mar 29 02:30:31.121233 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2075/4371] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:31.135314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:31.139761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:31.149771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:31.150709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:31.151715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:31.152348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:32.911813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:32.943366 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5715d94-d236-498d-a98f-ffcb23f5b228 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 2.283721 Mar 29 02:30:32.948436 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2297/4372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:30 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:33.132638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:33.144738 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44973661-41aa-41d4-8cdf-7341094cff3d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1662 microversion: 2.1 time: 2.021932 Mar 29 02:30:33.154084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2076/4373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:31 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1662 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:33.164979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-52321b41-fbc6-4a38-83b0-317ffdd68de6 req-fe44f35c-728f-4e35-922c-41abaaeed750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:33.166925 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:33.166925 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:30:33.177546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-52321b41-fbc6-4a38-83b0-317ffdd68de6 req-fe44f35c-728f-4e35-922c-41abaaeed750 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:33.179036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-52321b41-fbc6-4a38-83b0-317ffdd68de6 req-fe44f35c-728f-4e35-922c-41abaaeed750 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:33.258469 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-52321b41-fbc6-4a38-83b0-317ffdd68de6 req-fe44f35c-728f-4e35-922c-41abaaeed750 service nova] Creating event network-changed:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:30:33.269710 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-52321b41-fbc6-4a38-83b0-317ffdd68de6 req-fe44f35c-728f-4e35-922c-41abaaeed750 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108276 Mar 29 02:30:33.271996 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2298/4374] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:30:33.964455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:33.965097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:33.977913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:33.978356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:33.979128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:33.979554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:34.165014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:34.165716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:34.181759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:34.182399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:34.183363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:34.183945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:34.600313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:34.612169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a6c648f-d582-422a-9397-3b37b5888748 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.651752 Mar 29 02:30:34.613555 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2077/4375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:33 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:35.417888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:35.428099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4449e118-b817-4689-b691-20798881cebd tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1662 microversion: 2.1 time: 1.266841 Mar 29 02:30:35.431267 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2299/4376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:34 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1662 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:35.630975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:35.632299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:35.657303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:35.659696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:35.660727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:35.661924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:36.190979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:36.210763 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-442da054-6ba3-41c2-8e06-f3133f88b2db tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.584856 Mar 29 02:30:36.213397 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2078/4377] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:35 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:36.445500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:36.446807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:36.461775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:36.464389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:36.465592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:36.466284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:36.857905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:36.867487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-019184ab-477a-4f92-82cc-d3d62ab8d5fe req-bea6b3e8-2817-4c41-b98d-abd4e351c8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4292c40-7ea1-4c3b-ac83-95a24b56d358", "tag": "4abe07b6-a00a-4266-89f7-d09596aa0a77"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:36.869105 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:36.869105 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:30:36.878589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-019184ab-477a-4f92-82cc-d3d62ab8d5fe req-bea6b3e8-2817-4c41-b98d-abd4e351c8c4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:36.879032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-019184ab-477a-4f92-82cc-d3d62ab8d5fe req-bea6b3e8-2817-4c41-b98d-abd4e351c8c4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:36.890060 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d953b55-1194-4f38-b698-68020cbafdfe tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1666 microversion: 2.1 time: 0.447128 Mar 29 02:30:36.892478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2300/4378] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:36 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1666 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:36.900973 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-019184ab-477a-4f92-82cc-d3d62ab8d5fe req-bea6b3e8-2817-4c41-b98d-abd4e351c8c4 service nova] Creating event network-changed:4abe07b6-a00a-4266-89f7-d09596aa0a77 for instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 on n-h2-828148-1 Mar 29 02:30:36.905933 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-019184ab-477a-4f92-82cc-d3d62ab8d5fe req-bea6b3e8-2817-4c41-b98d-abd4e351c8c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043018 Mar 29 02:30:36.906445 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2079/4379] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:30:37.229561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:37.230471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:37.244305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:37.246918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:37.249811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:37.250450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:37.823313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:37.827337 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd6ef91f-48da-481a-bb90-dc9cb5ec6156 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.601131 Mar 29 02:30:37.837203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2301/4380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:37 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:38.846808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:38.847747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:38.858117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:38.858712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:38.859592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:38.860174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:39.620289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:39.639453 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f13a2a75-b10d-4d28-adc3-a2f1e9f0b287 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.799407 Mar 29 02:30:39.655182 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2080/4381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:38 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:40.656259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:40.657583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:40.677784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:40.682567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:40.687284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:40.687900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:41.043293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:41.052630 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f36edb7a-3505-43f4-8e22-34fb1e5d657b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.399808 Mar 29 02:30:41.063188 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2302/4382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:40 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:42.070072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:42.070751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:42.086511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:42.087273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:42.092972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:42.093818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:42.375682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:42.388727 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e165e5be-0b12-4238-845a-7e9672ee6277 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.319892 Mar 29 02:30:42.389690 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2081/4383] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:42 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:43.407007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:43.407631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:43.429274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:43.429732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:43.430639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:43.430996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:44.285759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:44.310334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-06b05021-b514-4d6c-996d-99c48e9d16a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.898962 Mar 29 02:30:44.312965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2303/4384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:43 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:45.329198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:45.330595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:45.346557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:45.350868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:45.352959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:45.352959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:45.572544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:45.581288 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8095b1ef-5d2a-4392-93f2-f550cb7a5523 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.255967 Mar 29 02:30:45.585007 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2082/4385] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:45 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:46.599580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:46.600196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:46.608394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:46.621122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:46.622055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:46.622500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:46.934085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ea4ca478-bd65-4fa1-bc3c-2b526d368b6d req-e9cb1f46-4f90-45f3-ab69-c73cd4f594da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4292c40-7ea1-4c3b-ac83-95a24b56d358", "name": "network-vif-plugged", "status": "completed", "tag": "4abe07b6-a00a-4266-89f7-d09596aa0a77"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:46.935687 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:30:46.935687 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:30:46.945869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ea4ca478-bd65-4fa1-bc3c-2b526d368b6d req-e9cb1f46-4f90-45f3-ab69-c73cd4f594da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:46.945869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ea4ca478-bd65-4fa1-bc3c-2b526d368b6d req-e9cb1f46-4f90-45f3-ab69-c73cd4f594da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:46.970861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ea4ca478-bd65-4fa1-bc3c-2b526d368b6d req-e9cb1f46-4f90-45f3-ab69-c73cd4f594da service nova] Creating event network-vif-plugged:4abe07b6-a00a-4266-89f7-d09596aa0a77 for instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 on n-h2-828148-1 Mar 29 02:30:46.976428 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ea4ca478-bd65-4fa1-bc3c-2b526d368b6d req-e9cb1f46-4f90-45f3-ab69-c73cd4f594da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046596 Mar 29 02:30:46.977556 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2083/4386] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:30:47.099805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:47.112036 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fee29d01-d234-4a1e-8627-77c9597cb8ea tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.514869 Mar 29 02:30:47.112036 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2304/4387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:46 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:48.128545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:48.129890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:48.144009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:48.144532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:48.147351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:48.148917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:48.832787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:48.845982 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0503b159-1395-4391-99cd-4ed85f54b01d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1314 microversion: 2.1 time: 0.721823 Mar 29 02:30:48.850128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2084/4388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:48 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1314 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:49.867667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:49.868946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:49.880291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:49.880688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:49.881589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:49.881948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:50.339957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:50.356914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6d4ec06-306d-451c-9795-e9ec7ea697bc tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1501 microversion: 2.1 time: 0.494236 Mar 29 02:30:50.359281 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2305/4389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:49 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1501 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:50.376978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:50.377541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:50.391837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:50.391837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:50.392491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:50.393474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:50.478549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'flavor' on Instance uuid c4292c40-7ea1-4c3b-ac83-95a24b56d358 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:30:51.310410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4fff1204-4ace-4b2d-9e5c-9624c0052601 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358/action" status: 202 len: 0 microversion: 2.1 time: 0.924319 Mar 29 02:30:51.310410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2085/4390] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:30:50 2022] POST /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:30:51.326560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:51.326560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:51.342211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:51.342211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:51.342211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:51.342211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:52.004663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:52.015252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d69961e8-2014-4bfb-b0f8-bb63cddb6cbb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.707247 Mar 29 02:30:52.016172 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2306/4391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:51 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:53.033963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:53.035332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:53.049222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:53.050450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:53.052652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:53.054083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:53.363282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:53.374201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-204253dd-bf7a-406d-b72a-707e774c2905 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.344224 Mar 29 02:30:53.377196 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2086/4392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:53 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:54.391775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:54.392385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:54.399794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:54.400247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:54.401034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:54.401663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:54.706483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:54.714808 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e653017-9929-4fe8-ad45-e9f0e8387455 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.326748 Mar 29 02:30:54.715375 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2307/4393] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:54 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:55.034274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1090054642", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "81302685-153b-4d2a-b3f5-cded956c02e0"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:30:55.103551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] validate_networks() for [('81302685-153b-4d2a-b3f5-cded956c02e0', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:30:55.732524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:55.733159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:55.740968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:55.741412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:55.742166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:55.742591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:55.947737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:55.955959 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7811ce8f-6b3c-4dad-bf1e-e999f7d0c17a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.227199 Mar 29 02:30:55.956771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2308/4394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:55 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:56.229503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:30:56.229993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:30:56.230465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:30:56.230878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:30:56.231297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:30:56.240335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:56.240802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:56.241665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:56.242104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:56.269141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Getting quotas for project 458df3ef308f4daa80874f87e2857b62. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:30:56.275971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Getting quotas for user f4e56f2315e34b7793b37e0124d533a9 and project 458df3ef308f4daa80874f87e2857b62. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:30:56.288789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:30:56.291187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:30:56.423853 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d55b072a-aafd-4d7f-b30f-6de152c62461 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.393262 Mar 29 02:30:56.426698 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2087/4395] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:30:56.437204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-000dc966-1d96-44bb-9ed2-cebafd082499 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:56.437900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-000dc966-1d96-44bb-9ed2-cebafd082499 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:56.556087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-000dc966-1d96-44bb-9ed2-cebafd082499 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:56.565901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-000dc966-1d96-44bb-9ed2-cebafd082499 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1214 microversion: 2.1 time: 0.132902 Mar 29 02:30:56.566488 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2309/4396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:56 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:56.973439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:56.974298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:56.982780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:56.983542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:56.984602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:56.985296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:57.586214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9daa0351-fd9c-4585-8577-85378aa585be tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:57.586839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9daa0351-fd9c-4585-8577-85378aa585be tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:57.648463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:57.673817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1318aa2-864a-4004-bacf-1c96cdabf1a5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.696016 Mar 29 02:30:57.673817 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2088/4397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:56 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:30:57.748724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9daa0351-fd9c-4585-8577-85378aa585be tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:57.757487 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9daa0351-fd9c-4585-8577-85378aa585be tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1214 microversion: 2.1 time: 0.178225 Mar 29 02:30:57.758650 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2310/4398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:57 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:58.683404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:58.684007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:58.695643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:58.696002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:58.697672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:58.702271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:58.776194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:30:58.777004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:30:58.793950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:58.794602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:58.797157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:30:58.799707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:30:59.086672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:59.096727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85fb2f29-8638-4cb5-945c-40259a712c32 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1210 microversion: 2.1 time: 0.325585 Mar 29 02:30:59.098694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2311/4399] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:58 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1210 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:30:59.674506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:30:59.687079 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ba78dc0-d03a-4a17-8d59-3c390dde70f2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 1.007747 Mar 29 02:30:59.691328 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2089/4400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:30:58 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:00.114405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:00.115063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:00.134097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:00.134549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:00.135339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:00.135772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:00.584165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:00.620952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-289dadac-c697-4dcd-a461-103dca0743ca tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1274 microversion: 2.1 time: 0.510724 Mar 29 02:31:00.625769 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2312/4401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:00 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1274 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:00.706646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:00.707256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:00.732683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:00.738174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:00.739447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:00.739447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:01.558742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:01.568365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-97288b1f-c93e-4408-81c9-56915d836ca5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.865680 Mar 29 02:31:01.569014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2090/4402] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:00 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:01.642912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:01.644066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:01.652860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:01.653380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:01.654166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:01.654773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:01.899663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:01.911723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a7b928dc-ded1-4229-870a-38a4c2509753 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1272 microversion: 2.1 time: 0.273646 Mar 29 02:31:01.913576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2313/4403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:01 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1272 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:02.589701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:02.591571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:02.607326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:02.607807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:02.608557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:02.609018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:02.931694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:02.933799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:02.945248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:02.946917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:02.947781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:02.948170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:03.131427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:03.141774 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83c4dc12-3479-42ef-be7b-4eef7bc298f9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.558274 Mar 29 02:31:03.142873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2091/4404] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:02 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:04.042093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:04.056998 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c30d600e-b08e-408c-a0c1-6127b5b79ec3 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 1.129374 Mar 29 02:31:04.067679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2314/4405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:02 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:04.162446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:04.163886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:04.195282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:04.196054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:04.197456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:04.198091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:04.857757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3e145fd8-2902-4939-af62-e59779c25a8e req-2618f264-b261-47e7-89d0-8aa1e650c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0564e580-e90d-4149-adf8-b9c46a1fd378", "tag": "a8ac9032-f326-471d-a99a-0692114b0316"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:04.860568 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:04.860568 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:31:04.868823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3e145fd8-2902-4939-af62-e59779c25a8e req-2618f264-b261-47e7-89d0-8aa1e650c6ac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:04.869285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3e145fd8-2902-4939-af62-e59779c25a8e req-2618f264-b261-47e7-89d0-8aa1e650c6ac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:04.876938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:04.887819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3e145fd8-2902-4939-af62-e59779c25a8e req-2618f264-b261-47e7-89d0-8aa1e650c6ac service nova] Creating event network-changed:a8ac9032-f326-471d-a99a-0692114b0316 for instance 0564e580-e90d-4149-adf8-b9c46a1fd378 on n-h2-828148-1 Mar 29 02:31:04.888399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b8b6bda7-5206-451f-9463-2a8604cd91a9 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.731742 Mar 29 02:31:04.889279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2092/4406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:04 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:04.901731 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3e145fd8-2902-4939-af62-e59779c25a8e req-2618f264-b261-47e7-89d0-8aa1e650c6ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049060 Mar 29 02:31:04.902867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2315/4407] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:05.074939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:05.075509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:05.084114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:05.084752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:05.085556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:05.085984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:05.911791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:05.917908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:05.918880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:05.949903 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd4594f6-8980-4517-9ca7-b400cdcd5d93 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.863537 Mar 29 02:31:05.963723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:05.964179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:05.965007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:05.965447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:05.978704 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2093/4408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:05 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:06.318403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:06.329628 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-652e8e59-b4c9-4d3e-a6b9-de3ba7408d55 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.426337 Mar 29 02:31:06.333945 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2316/4409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:05 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:06.967289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:06.977137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:06.977137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:06.979073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:06.979868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:06.980298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:07.347768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:07.349456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:07.362497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:07.363202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:07.364587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:07.365520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:07.409195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:07.423213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-889ede50-8962-4fff-9a83-53a485ca0999 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.459363 Mar 29 02:31:07.425379 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2094/4410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:06 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:07.826225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:07.835699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4a314a85-4d4a-47c4-a86c-453a42ccedae tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.491805 Mar 29 02:31:07.845775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2317/4411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:07 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:08.441506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:08.442150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:08.449861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:08.450533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:08.451380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:08.451912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:08.854734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:08.855398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:08.865683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:08.866448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:08.868166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:08.868974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:09.075825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:09.088733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec42e148-d445-4e25-944d-26976a84e773 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.651044 Mar 29 02:31:09.089819 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2095/4412] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:08 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:09.434306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:09.452994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be904218-6643-4301-8ac7-2cf8c1a56e24 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.597743 Mar 29 02:31:09.452994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2318/4413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:08 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:10.108763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:10.116609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:10.127527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:10.129501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:10.130345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:10.130844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:10.430869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:10.441756 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb62bcd3-1128-4482-8e21-5cac3e8c85a0 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.338770 Mar 29 02:31:10.442327 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2096/4414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:10 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:10.466432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:10.466990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:10.474408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:10.474798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:10.475566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:10.476030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:11.003773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:11.011683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-640a29b3-b851-476b-b4fb-95e7039832d8 req-773c31e4-8459-45a2-814e-ed9423b7b105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0564e580-e90d-4149-adf8-b9c46a1fd378", "name": "network-vif-plugged", "status": "completed", "tag": "a8ac9032-f326-471d-a99a-0692114b0316"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:11.013371 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:11.013371 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:11.019911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f202ff00-99f1-4e14-bd08-48d137bc4200 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.552016 Mar 29 02:31:11.019911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2319/4415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:10 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:11.025449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-640a29b3-b851-476b-b4fb-95e7039832d8 req-773c31e4-8459-45a2-814e-ed9423b7b105 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:11.025895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-640a29b3-b851-476b-b4fb-95e7039832d8 req-773c31e4-8459-45a2-814e-ed9423b7b105 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:11.049524 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-640a29b3-b851-476b-b4fb-95e7039832d8 req-773c31e4-8459-45a2-814e-ed9423b7b105 service nova] Creating event network-vif-plugged:a8ac9032-f326-471d-a99a-0692114b0316 for instance 0564e580-e90d-4149-adf8-b9c46a1fd378 on n-h2-828148-1 Mar 29 02:31:11.051757 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-640a29b3-b851-476b-b4fb-95e7039832d8 req-773c31e4-8459-45a2-814e-ed9423b7b105 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044984 Mar 29 02:31:11.052335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2097/4416] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:11.460059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:11.460059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:11.469500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:11.470098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:11.470727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:11.471856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:12.037660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:12.042023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:12.047294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:12.047806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:12.049223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:12.049867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:12.050441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:12.072800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d90b86fd-e158-4864-bfc8-0dc3648ea19f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.617657 Mar 29 02:31:12.073500 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2320/4417] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:11 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:12.457931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:12.467972 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9fdbe78c-285f-45af-941e-9ad2d9caf6a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.436017 Mar 29 02:31:12.468967 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2098/4418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:12 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:13.089670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:13.090588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:13.099069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:13.099686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:13.100631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:13.101220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:13.485841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:13.486449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:13.495350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:13.495350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:13.495939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:13.496373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:13.818372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:13.834869 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f548147-d3d1-4b1e-8d2a-48e88e4f1418 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1314 microversion: 2.1 time: 0.748926 Mar 29 02:31:13.853215 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2321/4419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:13 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:14.007873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:14.019136 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03aa03ad-f313-490e-b5d5-21af7aec7116 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.535980 Mar 29 02:31:14.019715 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2099/4420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:13 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:14.854621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:14.855261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:14.863814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:14.864483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:14.865304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:14.865732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:15.036099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:15.036814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:15.045115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:15.045659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:15.046502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:15.047006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:15.332315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:15.345156 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de83418c-82c5-4a1d-949f-f679651a1d08 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1498 microversion: 2.1 time: 0.495290 Mar 29 02:31:15.346452 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2322/4421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:14 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1498 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:15.378752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:15.398711 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2d79b63-c2dd-48ec-a715-b3afac56a7fb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.359465 Mar 29 02:31:15.398711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2100/4422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:15 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:16.153545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:16.153545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:16.163625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.164810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.165637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.166075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.421463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:16.424548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:16.433997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.434447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.437727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.438254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.456303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'services' on Instance uuid 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:31:16.826671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f84961f-66f1-4fa0-a779-25a0b00561d1 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments/49f9d245-eb6d-4100-aafb-85be76fa6aa4" status: 202 len: 0 microversion: 2.1 time: 0.689059 Mar 29 02:31:16.833295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2323/4423] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:31:16 2022] DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments/49f9d245-eb6d-4100-aafb-85be76fa6aa4 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:31:16.840548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:16.848366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:16.857288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.857993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.858939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:16.860089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:16.974700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:17.015427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:17.031487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80c9e919-c816-4e0b-95e7-aaf546bae309 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1507 microversion: 2.1 time: 0.619879 Mar 29 02:31:17.032321 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2101/4424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:16 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1507 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:17.043028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:17.045875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:17.062892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:17.064865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:17.068803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:17.069463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:17.190411 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19c00de1-6037-4616-8a0e-d8f0054ef1d6 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156160 Mar 29 02:31:17.191286 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2102/4425] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:31:17 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:17.523900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad803271-6304-43cb-b57e-0597c9e419c4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 204 len: 0 microversion: 2.1 time: 0.688649 Mar 29 02:31:17.524864 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2324/4426] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:16 2022] DELETE /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:17.534307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:17.535539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:17.572417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:17.572417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:17.577246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:17.577246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:18.043301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:18.045931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:18.046822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:18.052750 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69aea2f1-2e0e-4d44-b4e9-99809bd4f79a tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1504 microversion: 2.1 time: 0.523690 Mar 29 02:31:18.062490 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2103/4427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:17 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1504 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:18.062660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:18.063297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:18.064002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:18.064587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:18.202631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:18.203562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:18.224499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:18.227140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:18.227979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:18.228421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:18.365239 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d30f2073-9d0b-4ecc-820d-37d041aaf8de tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.166186 Mar 29 02:31:18.366253 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2104/4428] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:31:18 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:31:18.550356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:18.569405 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96fa0fa7-33bc-4baf-8fec-2e463dd156f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1528 microversion: 2.1 time: 0.527312 Mar 29 02:31:18.571451 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2325/4429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:18 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:19.070856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:19.071471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:19.080241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.081646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.082481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.082928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.377088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:19.378833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:19.386125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.386904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.387955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.388604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.465086 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a15e5af0-f633-4e6e-b0bb-6da597164831 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090997 Mar 29 02:31:19.465935 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2326/4430] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:31:19 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:31:19.599916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:19.599916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:19.630377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.631085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.631872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.632607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.678254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:19.690499 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db25ab36-6c56-47f1-85ba-3ea94e1f2a6d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1504 microversion: 2.1 time: 0.623234 Mar 29 02:31:19.692502 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2105/4431] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:19 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1504 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:19.708510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:19.712033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:19.738530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.738530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.739001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.740210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.829374 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Cannot 'reboot' instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 while it is in vm_state rescued Mar 29 02:31:19.830505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 409 to user: Cannot 'reboot' instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 while it is in vm_state rescued {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:19.831511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-772bdab3-b849-4b8f-9e54-fcc76ba3bafa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action" status: 409 len: 145 microversion: 2.1 time: 0.135451 Mar 29 02:31:19.832737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2106/4432] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:31:19 2022] POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action => generated 145 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:31:19.849751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:19.860865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:19.874983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.875915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.876482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:19.877447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:19.983786 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:31:19.985490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Cannot 'rebuild' instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 while it is in vm_state rescued Mar 29 02:31:19.998789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 409 to user: Cannot 'rebuild' instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 while it is in vm_state rescued {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:19.998789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-666c2e51-5a07-41c7-9fc8-ffe3b8b54742 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action" status: 409 len: 146 microversion: 2.1 time: 0.149531 Mar 29 02:31:19.998789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2107/4433] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:31:19 2022] POST /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31/action => generated 146 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:31:20.007443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:20.008153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:20.018972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.019639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.022506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.022506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.111094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:20.302493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:20.327008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12c94c42-a692-40be-b8e9-d53f717e273a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.726365 Mar 29 02:31:20.329069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2327/4434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:19 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:20.638645 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c9079aa2-8dd3-45d6-b1de-525415ce51db tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 204 len: 0 microversion: 2.1 time: 0.634460 Mar 29 02:31:20.639084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2108/4435] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:20 2022] DELETE /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:20.649884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:20.651079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:20.664624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.670454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.674018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.674752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.711475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:20.711627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:20.744752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.745398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.746256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:20.746700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:20.999153 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45364. Mar 29 02:31:21.006034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:21.016237 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ade08bf-e830-4aa3-a30f-2561e5f09bfc tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1462 microversion: 2.1 time: 0.310742 Mar 29 02:31:21.023141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2109/4436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:20 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1462 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:21.029514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-98b075c5-aeb5-47cf-adf0-e59cffaeb985 req-ff6c97d3-864d-404f-9977-cbf6d6cb0cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4292c40-7ea1-4c3b-ac83-95a24b56d358", "name": "network-vif-plugged", "status": "completed", "tag": "4abe07b6-a00a-4266-89f7-d09596aa0a77"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:21.045879 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:21.045879 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:21.055899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-98b075c5-aeb5-47cf-adf0-e59cffaeb985 req-ff6c97d3-864d-404f-9977-cbf6d6cb0cf4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:21.056286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-98b075c5-aeb5-47cf-adf0-e59cffaeb985 req-ff6c97d3-864d-404f-9977-cbf6d6cb0cf4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:21.097150 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-98b075c5-aeb5-47cf-adf0-e59cffaeb985 req-ff6c97d3-864d-404f-9977-cbf6d6cb0cf4 service nova] Creating event network-vif-plugged:4abe07b6-a00a-4266-89f7-d09596aa0a77 for instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 on n-h2-828148-1 Mar 29 02:31:21.115565 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-98b075c5-aeb5-47cf-adf0-e59cffaeb985 req-ff6c97d3-864d-404f-9977-cbf6d6cb0cf4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090553 Mar 29 02:31:21.116873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2110/4437] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:21.208238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9c1ddad1-16d9-4bca-af95-aeb083e6ccd7 req-090afa63-8a53-41a5-9c62-05ebc2e9b556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0564e580-e90d-4149-adf8-b9c46a1fd378", "name": "network-vif-deleted", "tag": "a8ac9032-f326-471d-a99a-0692114b0316"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:21.209761 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:21.209761 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:21.231229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9c1ddad1-16d9-4bca-af95-aeb083e6ccd7 req-090afa63-8a53-41a5-9c62-05ebc2e9b556 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:21.231376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9c1ddad1-16d9-4bca-af95-aeb083e6ccd7 req-090afa63-8a53-41a5-9c62-05ebc2e9b556 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:21.259675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9c1ddad1-16d9-4bca-af95-aeb083e6ccd7 req-090afa63-8a53-41a5-9c62-05ebc2e9b556 service nova] Creating event network-vif-deleted:a8ac9032-f326-471d-a99a-0692114b0316 for instance 0564e580-e90d-4149-adf8-b9c46a1fd378 on n-h2-828148-1 Mar 29 02:31:21.274424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9c1ddad1-16d9-4bca-af95-aeb083e6ccd7 req-090afa63-8a53-41a5-9c62-05ebc2e9b556 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070354 Mar 29 02:31:21.275763 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2111/4438] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:31:21.321733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:21.332184 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ba52c5d-e1bd-4671-b744-b4441e7fef8b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1690 microversion: 2.1 time: 0.687678 Mar 29 02:31:21.333386 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2328/4439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:20 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1690 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:21.352244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:21.352244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:21.364271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:21.365373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:21.366294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:21.366731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:21.950974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:21.969460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c5a0c9a-1756-4f7b-9645-e9ca75593497 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.617235 Mar 29 02:31:21.980378 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2112/4440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:21 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:22.036895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:22.037492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:22.046099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:22.046972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:22.048003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:22.049722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:22.162707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:22.163151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:22.163608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lazy-loading 'fault' on Instance uuid 0564e580-e90d-4149-adf8-b9c46a1fd378 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:31:22.461040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:22.480276 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-61c3deaa-bd70-47a2-8e72-d085124ff89b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 200 len: 1304 microversion: 2.1 time: 0.446918 Mar 29 02:31:22.481594 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2329/4441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:22 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 1304 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:22.779087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:22.779712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:22.791162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:22.791628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:22.792433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:22.792892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:22.991258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:22.992263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:23.008552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:23.009193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:23.011066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:23.011951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:23.460972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:23.473326 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be75aa12-72dd-404d-86ce-11ae98203043 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1690 microversion: 2.1 time: 1.127520 Mar 29 02:31:23.473912 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2113/4442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:22 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1690 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:23.497923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:23.498585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 0564e580-e90d-4149-adf8-b9c46a1fd378] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:23.511794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:23.512502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:23.515812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:23.516438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:23.520656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:23.531414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-622f9cea-7ae4-475b-8347-3adcb7fbdbee tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.546311 Mar 29 02:31:23.531414 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2330/4443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:22 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:23.640640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] HTTP exception thrown: Instance 0564e580-e90d-4149-adf8-b9c46a1fd378 could not be found. Mar 29 02:31:23.647861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Returning 404 to user: Instance 0564e580-e90d-4149-adf8-b9c46a1fd378 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:23.649552 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-040e6225-be69-4c23-b9f9-bd004a79ecbe tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378" status: 404 len: 111 microversion: 2.1 time: 0.155479 Mar 29 02:31:23.650931 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2114/4444] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:23 2022] GET /compute/v2.1/servers/0564e580-e90d-4149-adf8-b9c46a1fd378 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:31:23.878824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1913452908", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "81302685-153b-4d2a-b3f5-cded956c02e0"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:24.490785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:24.491893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:24.500796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:24.502343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:24.504970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:24.505672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:25.365379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] validate_networks() for [('81302685-153b-4d2a-b3f5-cded956c02e0', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:31:26.543892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:31:26.544499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:31:26.544790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:31:26.545278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:31:26.545703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:31:26.560624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:26.561107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:26.561941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:26.569805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:26.583076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Getting quotas for project 458df3ef308f4daa80874f87e2857b62. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:31:26.589019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Getting quotas for user f4e56f2315e34b7793b37e0124d533a9 and project 458df3ef308f4daa80874f87e2857b62. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:31:26.608293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:31:26.619224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:31:26.779602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:26.793803 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e9bfa1d-eb91-4460-99f2-81955ba6a0e2 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1690 microversion: 2.1 time: 2.306679 Mar 29 02:31:26.794397 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2115/4445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:24 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1690 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:26.812278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:26.813254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:26.824766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:26.830552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:26.832679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:26.833152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:26.874157 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7fb8c457-4cbd-473b-9cbe-4c68937d5a1b tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.999621 Mar 29 02:31:26.874824 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2331/4446] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:31:26.895748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa39c3e8-a63b-4acd-b929-271ad7963585 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:26.905301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa39c3e8-a63b-4acd-b929-271ad7963585 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:27.097189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fa39c3e8-a63b-4acd-b929-271ad7963585 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:27.114105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa39c3e8-a63b-4acd-b929-271ad7963585 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1214 microversion: 2.1 time: 0.216904 Mar 29 02:31:27.115554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2332/4447] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:26 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:27.811511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:27.812730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:27.837184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:27.844082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:27.846360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:27.847072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:28.326195 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:31:28.441938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:28.455102 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f400171c-f08d-4346-9749-32a94042c6ad tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1622 microversion: 2.1 time: 0.647585 Mar 29 02:31:28.468627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2333/4448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:27 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1622 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:28.475947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:28.476895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:28.488321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:28.488979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:28.489945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:28.490536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:28.830749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:28.840427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-09e73e48-a386-46e4-88ae-5e4b48756cbb tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1218 microversion: 2.1 time: 0.369775 Mar 29 02:31:28.843566 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2334/4449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:28 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1218 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:29.343428 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45636. Mar 29 02:31:29.450640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:29.463706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b87aa7b-9e2a-4e82-a2e9-2eb68364a534 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 2.667941 Mar 29 02:31:29.464566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2116/4450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:26 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 2670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:29.474181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:29.474957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:29.500430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:29.502335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:29.503226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:29.508257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:29.580388 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:31:29.588749 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:31:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 (ip 10.222.0.36) !!! Mar 29 02:31:29.809833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-289dc404-3b1c-465b-991f-b63ecb86d71f req-4ab38948-6cc9-4c4f-91a0-66691a82ac75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7", "name": "network-vif-deleted", "tag": "eec53f85-c0c5-4bce-86e5-b82382ad67fe"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:29.812940 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:29.812940 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:29.856956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-289dc404-3b1c-465b-991f-b63ecb86d71f req-4ab38948-6cc9-4c4f-91a0-66691a82ac75 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:29.857490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-289dc404-3b1c-465b-991f-b63ecb86d71f req-4ab38948-6cc9-4c4f-91a0-66691a82ac75 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:29.919998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-289dc404-3b1c-465b-991f-b63ecb86d71f req-4ab38948-6cc9-4c4f-91a0-66691a82ac75 service nova] Creating event network-vif-deleted:eec53f85-c0c5-4bce-86e5-b82382ad67fe for instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 on n-h1-828148-1 Mar 29 02:31:29.934690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-289dc404-3b1c-465b-991f-b63ecb86d71f req-4ab38948-6cc9-4c4f-91a0-66691a82ac75 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129174 Mar 29 02:31:29.960782 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2117/4451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:31:29.981939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:29.991392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:30.040399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:30.061884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:30.062567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:30.067382 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7064a3a4-63cc-4495-a44c-0caa17eafd2f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1622 microversion: 2.1 time: 0.596567 Mar 29 02:31:30.069219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:30.084281 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2335/4452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:29 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1622 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:30.084735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:30.343883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:30.364350 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d82686a-5535-4263-ba11-fb1ae96acc64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1274 microversion: 2.1 time: 0.392883 Mar 29 02:31:30.375155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2118/4453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:29 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:30.486728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:30.487564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:30.512914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:30.520700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:30.523142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:30.530780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.090569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:31.091490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:31.105749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:31.107601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.109611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:31.112137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.295552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:31.296203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.296707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'fault' on Instance uuid 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:31:31.683593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:31.697995 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-417e0d16-6bf2-4e66-ba17-3e2084ed6575 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 1.220536 Mar 29 02:31:31.702538 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2336/4454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:30 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:31.712962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:31.717687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:31.731908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:31.735020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.736126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:31.743278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:31.799881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:31.813832 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed788966-8dcd-47fa-b580-a1d3e325036f tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 200 len: 1336 microversion: 2.1 time: 0.725006 Mar 29 02:31:31.826171 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2119/4455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:31 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 1336 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:32.108109 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:31:32.108222 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:31:32.549665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:32.550643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:32.561838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:32.565673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:32.566987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:32.574071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:32.713879 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd76043c-fb58-462b-b951-c185c737428d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168115 Mar 29 02:31:32.725310 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2120/4456] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:31:32 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:31:32.734794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:32.735426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:32.754678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:32.755038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:32.756723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:32.759972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:32.996801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:33.007606 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc1eb5be-a0ca-4d1c-9957-2c177c57de20 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 1.303280 Mar 29 02:31:33.008112 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2337/4457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:31 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:33.022540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:33.023169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:33.046467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:33.046914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:33.047699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:33.048804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:33.134042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 could not be found. Mar 29 02:31:33.134918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 404 to user: Instance 4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:33.135877 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af094796-a961-4e09-b091-ff5574a8be17 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7" status: 404 len: 111 microversion: 2.1 time: 0.119941 Mar 29 02:31:33.137002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2338/4458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:33 2022] GET /compute/v2.1/servers/4f6d46f9-e2a7-48ed-8b3a-e0255391e5a7 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:31:33.143140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:33.143840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:33.152221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:33.152930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:33.153970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:33.154509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:33.224462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:33.436336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:33.457058 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88fbe57d-13f9-4d34-9cac-b46863844972 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.730288 Mar 29 02:31:33.480931 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2121/4459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:32 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:33.480931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5193afe-5126-42e3-a92e-2ee87a647b2b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '.version_select at 0x7f87241caaf0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:33.764623 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5193afe-5126-42e3-a92e-2ee87a647b2b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081745045" status: 202 len: 0 microversion: 2.1 time: 0.298765 Mar 29 02:31:33.770521 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2122/4460] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:31:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081745045 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:31:34.026036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:34.026924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:34.039328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.040042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:34.041295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.041884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:34.180383 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10605e17-712d-42cc-9080-084aa20bcffa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 204 len: 0 microversion: 2.1 time: 1.041847 Mar 29 02:31:34.184803 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2339/4461] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:33 2022] DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:34.191741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:34.195034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:34.207680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.209743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:34.210487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.210819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:34.787216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:34.806412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d474eed9-de6f-4fcb-9dd4-ebc1a3b3e995 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 0.783299 Mar 29 02:31:34.808144 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2123/4462] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:34 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:34.820083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:34.822612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:34.840679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.841539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:34.844193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:34.847410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:35.027652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:35.044040 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9625793a-06ef-42cd-8db0-4a71fd0f296c tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.857562 Mar 29 02:31:35.044987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2340/4463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:34 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:35.050397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-43e198b3-c2a4-492a-8568-ef228d8a908b req-b97a90c2-d21f-43c3-b47f-a39964f99ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e62288e-8f17-4c1f-bd1f-73bf9480b62c", "tag": "f3d7513e-5541-440e-9187-44e833db639c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:35.058212 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:35.058212 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:31:35.074730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43e198b3-c2a4-492a-8568-ef228d8a908b req-b97a90c2-d21f-43c3-b47f-a39964f99ea9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:35.085530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43e198b3-c2a4-492a-8568-ef228d8a908b req-b97a90c2-d21f-43c3-b47f-a39964f99ea9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:35.106352 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-43e198b3-c2a4-492a-8568-ef228d8a908b req-b97a90c2-d21f-43c3-b47f-a39964f99ea9 service nova] Creating event network-changed:f3d7513e-5541-440e-9187-44e833db639c for instance 7e62288e-8f17-4c1f-bd1f-73bf9480b62c on n-h1-828148-1 Mar 29 02:31:35.112785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-43e198b3-c2a4-492a-8568-ef228d8a908b req-b97a90c2-d21f-43c3-b47f-a39964f99ea9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065358 Mar 29 02:31:35.114012 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2341/4464] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:35.587065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:35.599873 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-516e80cd-8689-42e8-9051-fc6876f68b2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.788859 Mar 29 02:31:35.601344 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2124/4465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:34 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:35.835488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:35.837221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:35.848988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:35.850732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:35.851957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:35.853094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:36.062539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:36.063792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:36.074508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:36.075676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:36.076673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:36.077851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:36.504630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:36.515625 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1abd654-64d0-4152-8d57-3833f2c552bf tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 0.686240 Mar 29 02:31:36.516446 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2342/4466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:35 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:36.617773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:36.618465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:36.631616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:36.632351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:36.633335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:36.637003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:36.994942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:37.006598 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23647c51-c2d6-45d0-8f2a-992a8c15a201 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.948422 Mar 29 02:31:37.011215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2125/4467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:36 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:37.036964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:37.046310 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27ce33a9-3729-45f0-86bb-446576ec0f45 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.432144 Mar 29 02:31:37.050138 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2343/4468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:36 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:37.536572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:37.537364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:37.550472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:37.551245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:37.552203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:37.552974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:38.027451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:38.028355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:38.049455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:38.058913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:38.066225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:38.066963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:38.614873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:38.628893 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a9816e4-4ff7-4cae-a94a-659dae1d6916 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 1.098221 Mar 29 02:31:38.629743 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2126/4469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:37 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:38.640291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:38.641236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:38.661158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:38.661881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:38.662853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:38.665094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:38.885859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:38.900397 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-edb2fb9f-1421-49bd-bb92-cd98e653d59b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.877628 Mar 29 02:31:38.902949 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2344/4470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:38 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:39.452420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f12f4cf2-65bf-4dc7-8eab-1037109f5091 req-c066f73b-c107-4a71-8d94-9c93c055c861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bcada5-07ad-40f0-964c-d303c7d91936", "name": "network-vif-unplugged", "status": "completed", "tag": "113d9942-8b7b-493d-a56c-6b4d4ee6aac5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:39.454131 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:39.454131 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:31:39.470575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f12f4cf2-65bf-4dc7-8eab-1037109f5091 req-c066f73b-c107-4a71-8d94-9c93c055c861 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:39.470575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f12f4cf2-65bf-4dc7-8eab-1037109f5091 req-c066f73b-c107-4a71-8d94-9c93c055c861 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:39.490455 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f12f4cf2-65bf-4dc7-8eab-1037109f5091 req-c066f73b-c107-4a71-8d94-9c93c055c861 service nova] Creating event network-vif-unplugged:113d9942-8b7b-493d-a56c-6b4d4ee6aac5 for instance b4bcada5-07ad-40f0-964c-d303c7d91936 on n-h1-828148-1 Mar 29 02:31:39.510607 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f12f4cf2-65bf-4dc7-8eab-1037109f5091 req-c066f73b-c107-4a71-8d94-9c93c055c861 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061727 Mar 29 02:31:39.511575 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2345/4471] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:39.524301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:39.537793 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b38cba78-06d7-459a-b00e-6bb9076f3867 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.903087 Mar 29 02:31:39.538822 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2127/4472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:38 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:39.647013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:39.647628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:39.666572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:39.667011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:39.667802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:39.668228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:39.921086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:39.922938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:39.941036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:39.941769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:39.942804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:39.943430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:40.255658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:40.255658 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8888fd50-6b60-44a9-9788-37192f8dc87e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 0.489843 Mar 29 02:31:40.255658 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2346/4473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:39 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:40.346719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:40.357644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e32fc807-9c21-4c4c-88ad-b220acf6ef9e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.440207 Mar 29 02:31:40.373921 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2128/4474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:39 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:40.556407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:40.557075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:40.581895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:40.582476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:40.583306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:40.583739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:41.123064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:41.137950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9fb6767f-ca99-4648-b5b3-fa725f42db2d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.585725 Mar 29 02:31:41.149562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2347/4475] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:40 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:41.269079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:41.269695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:41.288346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:41.288712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:41.289526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:41.289956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:41.378054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:41.378944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:41.400027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:41.400852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:41.402832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:41.406545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:41.977829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:41.987593 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2775f160-6107-4ef6-bc6b-f4975c24127f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.614111 Mar 29 02:31:41.988421 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2348/4476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:41 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:42.155063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:42.155873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:42.168012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:42.175873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:42.175873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:42.175873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:42.545874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:42.548703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:42.554810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d49cdc3-748e-419f-9100-ad690bdf9760 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1523 microversion: 2.1 time: 0.403203 Mar 29 02:31:42.577164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2349/4477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:42 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:42.577454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-843cb562-73aa-4f26-92b0-8a4d1bb01aba tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 1.298627 Mar 29 02:31:42.577454 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2129/4478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:41 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:43.005667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:43.006839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:43.024495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.025168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:43.026131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.026721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:43.581491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:43.582092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:43.591156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.591790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:43.597648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.598258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:43.850572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:43.862740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f2332f7e-befa-4a0f-b144-f298840f8123 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1672 microversion: 2.1 time: 0.860398 Mar 29 02:31:43.863693 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2350/4479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:43 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1672 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:43.869571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:43.870263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:43.916697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.918187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:43.919232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:43.921027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:44.801670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:44.810872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8382f71b-5846-4d9b-838d-455756454f30 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 1.233680 Mar 29 02:31:44.816077 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2130/4480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:43 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:44.832819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4cdd972c-5a70-4d0e-9dec-3e5f1822f766 req-344832f5-24bb-46ab-af31-d0e38f1bcd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e62288e-8f17-4c1f-bd1f-73bf9480b62c", "name": "network-vif-plugged", "status": "completed", "tag": "f3d7513e-5541-440e-9187-44e833db639c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:44.834781 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:44.834781 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:44.851830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4cdd972c-5a70-4d0e-9dec-3e5f1822f766 req-344832f5-24bb-46ab-af31-d0e38f1bcd54 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:44.852524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4cdd972c-5a70-4d0e-9dec-3e5f1822f766 req-344832f5-24bb-46ab-af31-d0e38f1bcd54 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:44.879135 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4cdd972c-5a70-4d0e-9dec-3e5f1822f766 req-344832f5-24bb-46ab-af31-d0e38f1bcd54 service nova] Creating event network-vif-plugged:f3d7513e-5541-440e-9187-44e833db639c for instance 7e62288e-8f17-4c1f-bd1f-73bf9480b62c on n-h1-828148-1 Mar 29 02:31:44.888791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4cdd972c-5a70-4d0e-9dec-3e5f1822f766 req-344832f5-24bb-46ab-af31-d0e38f1bcd54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060311 Mar 29 02:31:44.893990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2131/4481] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:44.899449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:44.900254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:44.910308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:44.910981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:44.912157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:44.912768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:44.983186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:45.189801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:45.198475 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-222e5a88-b5b4-4bb3-ab1d-27b8bc981209 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1505 microversion: 2.1 time: 1.333669 Mar 29 02:31:45.202796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2351/4482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:43 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1505 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:45.215766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:45.216636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:45.239539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.239539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.239539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.239539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.429593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:45.440598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2c6b66f6-9a84-4604-8ee0-7c39834feba1 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 200 len: 1604 microversion: 2.1 time: 0.235906 Mar 29 02:31:45.441667 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2352/4483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:45 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:45.457431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c2612eb4-0b8c-4e84-9740-7da9dd4dd0f4 req-108d07b3-cc2e-4ce8-9068-4b1c1b04fc34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4bcada5-07ad-40f0-964c-d303c7d91936", "name": "network-vif-deleted", "tag": "113d9942-8b7b-493d-a56c-6b4d4ee6aac5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:45.459614 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:45.459614 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:31:45.473733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c2612eb4-0b8c-4e84-9740-7da9dd4dd0f4 req-108d07b3-cc2e-4ce8-9068-4b1c1b04fc34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.474566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c2612eb4-0b8c-4e84-9740-7da9dd4dd0f4 req-108d07b3-cc2e-4ce8-9068-4b1c1b04fc34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.492119 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-096ac188-5ef9-4ee5-bb41-664bf910ca5a tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 204 len: 0 microversion: 2.1 time: 0.599708 Mar 29 02:31:45.492701 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2132/4484] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:44 2022] DELETE /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:45.503319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:45.503319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:45.519608 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c2612eb4-0b8c-4e84-9740-7da9dd4dd0f4 req-108d07b3-cc2e-4ce8-9068-4b1c1b04fc34 service nova] Creating event network-vif-deleted:113d9942-8b7b-493d-a56c-6b4d4ee6aac5 for instance b4bcada5-07ad-40f0-964c-d303c7d91936 on n-h1-828148-1 Mar 29 02:31:45.530798 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c2612eb4-0b8c-4e84-9740-7da9dd4dd0f4 req-108d07b3-cc2e-4ce8-9068-4b1c1b04fc34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086478 Mar 29 02:31:45.531410 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2353/4485] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:45.532295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.535542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.536278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.536897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.858329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:45.858329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:45.883961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.885330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:45.885698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:45.886427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:46.232317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:46.243021 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5af74cf-0f39-4233-858d-ad287163a95f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1314 microversion: 2.1 time: 0.411656 Mar 29 02:31:46.254101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2354/4486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:45 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:46.259315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:46.260255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:46.269428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:46.270316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:46.271438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:46.272196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:46.533599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:46.547913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9bd6aece-7b9a-4562-a4d9-f2ff274befc3 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1507 microversion: 2.1 time: 1.050668 Mar 29 02:31:46.549081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2133/4487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:45 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1507 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:46.553731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:46.554674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:46.562458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:46.563728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:46.569164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:46.570032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:46.730691 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. Mar 29 02:31:46.732516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:46.735449 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d50f7a55-ef5e-44d3-80ec-d04d7cf8540e tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 404 len: 111 microversion: 2.1 time: 0.184647 Mar 29 02:31:46.737729 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2134/4488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:46 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:31:46.753708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b789bcaf-6375-4127-8e85-a9c83de1b1ff tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '.version_select at 0x7f8724059dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:46.916269 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b789bcaf-6375-4127-8e85-a9c83de1b1ff tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-410854583" status: 202 len: 0 microversion: 2.1 time: 0.172709 Mar 29 02:31:46.919686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:46.919861 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2135/4489] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Mar 29 02:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-410854583 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:31:46.945885 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc72e2f6-8e48-4b87-85cb-c296ed35f696 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1505 microversion: 2.1 time: 0.689106 Mar 29 02:31:46.947019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2355/4490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:46 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:47.263264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:47.263264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:47.271204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:47.272078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:47.273137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:47.273879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:47.343329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-106b4e55-a8ac-4339-96f9-70bcca63b5ad req-5779f52e-247d-4632-8479-3c47e6376d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4292c40-7ea1-4c3b-ac83-95a24b56d358", "name": "network-vif-unplugged", "status": "completed", "tag": "4abe07b6-a00a-4266-89f7-d09596aa0a77"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:47.348210 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:47.348210 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:31:47.388226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-106b4e55-a8ac-4339-96f9-70bcca63b5ad req-5779f52e-247d-4632-8479-3c47e6376d7c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:47.392233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-106b4e55-a8ac-4339-96f9-70bcca63b5ad req-5779f52e-247d-4632-8479-3c47e6376d7c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:47.440818 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-106b4e55-a8ac-4339-96f9-70bcca63b5ad req-5779f52e-247d-4632-8479-3c47e6376d7c service nova] Creating event network-vif-unplugged:4abe07b6-a00a-4266-89f7-d09596aa0a77 for instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 on n-h2-828148-1 Mar 29 02:31:47.454287 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-106b4e55-a8ac-4339-96f9-70bcca63b5ad req-5779f52e-247d-4632-8479-3c47e6376d7c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114943 Mar 29 02:31:47.456285 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2356/4491] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:47.566808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:47.567505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:47.584061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:47.585025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:47.586482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:47.590457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:48.017769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:48.030257 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86a86e32-fc64-4851-8403-f32c690b766e tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1498 microversion: 2.1 time: 0.773048 Mar 29 02:31:48.034938 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2136/4492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:47 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1498 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:48.048140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:48.049808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:48.072100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:48.072638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:48.073583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:48.074023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:48.330383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:48.346240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1f67e36-0cdf-457e-9144-fd070cecfc9b tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1507 microversion: 2.1 time: 0.784473 Mar 29 02:31:48.347155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2357/4493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:47 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1507 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:48.893729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:48.913038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-10d11e75-6d68-476b-a96d-a736bdd1d0e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 200 len: 1448 microversion: 2.1 time: 0.875945 Mar 29 02:31:48.925448 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2137/4494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:48 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 1448 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:48.931080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:48.931692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:48.939960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:48.940773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:48.941795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:48.942490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:49.021048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:49.029355 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Working on deleting snapshot 896a8597-2116-4e65-b9df-4b86c220f2b6 from shelved instance... Mar 29 02:31:49.201147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:49.201633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:49.212731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:49.213968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:49.216034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:49.217419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:49.290432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:49.648504 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c5bdc6b-3283-484f-a175-34516c83d36d tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 204 len: 0 microversion: 2.1 time: 0.450907 Mar 29 02:31:49.652260 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2138/4495] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:49 2022] DELETE /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:31:49.656373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:49.657845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:49.679838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:49.681574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:49.683584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:49.685052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:49.988214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:49.999744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a330e726-caa8-4778-b380-9c63985d20af tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 200 len: 1465 microversion: 2.1 time: 0.349153 Mar 29 02:31:50.002611 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2139/4496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:49 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 1465 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:50.012526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:50.014322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:50.022165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:50.022799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:50.023638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:50.024194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:50.446336 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:31:50.448997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:50.461969 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3779fcf9-bea2-4389-b16f-1e8b318049ed tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1504 microversion: 2.1 time: 0.457920 Mar 29 02:31:50.478398 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2140/4497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:50 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:50.480287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b1a45dee-674a-4a22-940f-09f6f11de89f req-8451c6e7-819c-41d9-9ba0-b99e66e05a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2414f4-0514-4fcc-8262-ed3b38545e31", "name": "network-vif-deleted", "tag": "55d6b32d-4b8d-4f1b-8575-e745edd91df9"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:50.482878 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:50.482878 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:50.493246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1a45dee-674a-4a22-940f-09f6f11de89f req-8451c6e7-819c-41d9-9ba0-b99e66e05a0d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:50.494537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1a45dee-674a-4a22-940f-09f6f11de89f req-8451c6e7-819c-41d9-9ba0-b99e66e05a0d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:50.531351 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b1a45dee-674a-4a22-940f-09f6f11de89f req-8451c6e7-819c-41d9-9ba0-b99e66e05a0d service nova] Creating event network-vif-deleted:55d6b32d-4b8d-4f1b-8575-e745edd91df9 for instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 on n-h2-828148-1 Mar 29 02:31:50.559426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b1a45dee-674a-4a22-940f-09f6f11de89f req-8451c6e7-819c-41d9-9ba0-b99e66e05a0d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083993 Mar 29 02:31:50.561286 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2141/4498] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:50.709027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: .version_select at 0x7f8717d57ca0>, body: {"keypair": {"name": "tempest-keypair-2113506207"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:50.763659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:31:50.771506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:31:50.874202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Doing local delete in cell 465b9be6-8890-42cd-be93-13bd5816ef58(cell1) {{(pid=103513) _delete /opt/stack/nova/nova/compute/api.py:2387}} Mar 29 02:31:50.876564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:50.877250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:50.879219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Mar 29 02:31:50.897349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] deallocate_for_instance() {{(pid=103513) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1655}} Mar 29 02:31:51.455536 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46256. Mar 29 02:31:51.486144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:31:51.493473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:31:51.525994 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-17e34da0-d97e-4c39-92d7-e4d4b39f6b07 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.821482 Mar 29 02:31:51.528767 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2142/4499] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:31:50 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:51.540932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:51.540932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: 6a2414f4-0514-4fcc-8262-ed3b38545e31] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:51.560428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:51.561053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:51.564031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:51.564961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:51.672052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 could not be found. Mar 29 02:31:51.672661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 404 to user: Instance 6a2414f4-0514-4fcc-8262-ed3b38545e31 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:51.673548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-214747bf-4da2-41ec-a5af-73c8c6121aba tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31" status: 404 len: 111 microversion: 2.1 time: 0.143757 Mar 29 02:31:51.679879 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2143/4500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:51 2022] GET /compute/v2.1/servers/6a2414f4-0514-4fcc-8262-ed3b38545e31 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:31:51.693718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:51.694353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:51.723305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:51.724359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:51.728384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:51.729549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:52.521828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:52.538665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b71b298a-8002-42b0-9461-64e232da391f tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1504 microversion: 2.1 time: 0.857540 Mar 29 02:31:52.539821 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2144/4501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:51 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1504 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:52.544435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:52.545170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:52.560407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:52.562934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:52.563896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:52.567502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:52.692163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:52.788796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Updating instance_info_cache with network_info: [] {{(pid=103513) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Mar 29 02:31:53.090996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.scheduler.client.report [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Cannot delete allocation for c4292c40-7ea1-4c3b-ac83-95a24b56d358 consumer in placement as consumer does not exist {{(pid=103513) delete_allocation_for_instance /opt/stack/nova/nova/scheduler/client/report.py:2100}} Mar 29 02:31:53.219162 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-90832440-a107-46e5-bb32-36ac9e7b8e02 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 204 len: 0 microversion: 2.1 time: 0.677818 Mar 29 02:31:53.219746 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2145/4502] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:52 2022] DELETE /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:53.224938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-63889a34-3930-41e8-a34b-700f74d16fee req-d5d87c3a-1bc0-4821-9f6d-9baffa733be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4292c40-7ea1-4c3b-ac83-95a24b56d358", "name": "network-vif-deleted", "tag": "4abe07b6-a00a-4266-89f7-d09596aa0a77"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:53.228795 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:53.228795 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:53.244696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63889a34-3930-41e8-a34b-700f74d16fee req-d5d87c3a-1bc0-4821-9f6d-9baffa733be8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.245550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63889a34-3930-41e8-a34b-700f74d16fee req-d5d87c3a-1bc0-4821-9f6d-9baffa733be8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.274574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_external_events [req-63889a34-3930-41e8-a34b-700f74d16fee req-d5d87c3a-1bc0-4821-9f6d-9baffa733be8 service nova] Unable to find a host for instance c4292c40-7ea1-4c3b-ac83-95a24b56d358. Dropping event network-vif-deleted {{(pid=103514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Mar 29 02:31:53.281108 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-63889a34-3930-41e8-a34b-700f74d16fee req-d5d87c3a-1bc0-4821-9f6d-9baffa733be8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.059162 Mar 29 02:31:53.282068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2146/4503] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 62 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 29 02:31:53.289662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:53.291274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:53.313053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.313710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.318506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.319294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.686814 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1dbc1a0-e8e2-405f-949a-5b242c9bba27 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 204 len: 0 microversion: 2.1 time: 4.759193 Mar 29 02:31:53.688596 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2358/4504] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:31:48 2022] DELETE /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 0 bytes in 4762 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:31:53.696999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:53.697897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:53.731262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.732187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.735638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.737597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.920074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:53.933215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af9135ff-de41-4081-b674-645026787f64 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1462 microversion: 2.1 time: 0.243409 Mar 29 02:31:53.942900 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2359/4505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:53 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1462 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:53.948418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:53.949206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:53.962409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.962862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.963642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:53.964075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:53.964707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:53.979784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5522e5ac-cc7c-4eef-8797-727253eb72aa tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.694289 Mar 29 02:31:53.982354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2147/4506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:53 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:53.994881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e8ce33bc-fea7-44ac-8167-f88ccb5502b9 req-cc664030-3efb-4c00-a83c-a4a7433a7e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e62288e-8f17-4c1f-bd1f-73bf9480b62c", "name": "network-vif-deleted", "tag": "f3d7513e-5541-440e-9187-44e833db639c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:54.001410 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:54.001410 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:54.014139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8ce33bc-fea7-44ac-8167-f88ccb5502b9 req-cc664030-3efb-4c00-a83c-a4a7433a7e74 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:54.016754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8ce33bc-fea7-44ac-8167-f88ccb5502b9 req-cc664030-3efb-4c00-a83c-a4a7433a7e74 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:54.053997 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e8ce33bc-fea7-44ac-8167-f88ccb5502b9 req-cc664030-3efb-4c00-a83c-a4a7433a7e74 service nova] Creating event network-vif-deleted:f3d7513e-5541-440e-9187-44e833db639c for instance 7e62288e-8f17-4c1f-bd1f-73bf9480b62c on n-h1-828148-1 Mar 29 02:31:54.055229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. Mar 29 02:31:54.055229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:54.055229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4cefdc75-d09b-4dbf-b33f-60b50bbd6b0c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 404 len: 111 microversion: 2.1 time: 0.114725 Mar 29 02:31:54.056971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2360/4507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:53 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:31:54.070153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e8ce33bc-fea7-44ac-8167-f88ccb5502b9 req-cc664030-3efb-4c00-a83c-a4a7433a7e74 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083977 Mar 29 02:31:54.082489 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2148/4508] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:54.273607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-908147521", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:54.378484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:31:54.951939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:54.952792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:54.961694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:54.963017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:54.964433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:54.966655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.128323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.129199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.129916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lazy-loading 'fault' on Instance uuid 7e62288e-8f17-4c1f-bd1f-73bf9480b62c {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:31:55.406687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4e56f2315e34b7793b37e0124d533a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458df3ef308f4daa80874f87e2857b62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:55.415205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-382e25b2-fd5b-47bb-b4d3-b339fa5092f4 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 200 len: 1304 microversion: 2.1 time: 0.467703 Mar 29 02:31:55.415768 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2149/4509] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:54 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 1304 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:31:55.429823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:55.442054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:55.442054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.442054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.442975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.443569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.694881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:31:55.695969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:31:55.696618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:31:55.697868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:31:55.697868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:31:55.709129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.709589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.710377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.710809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.730091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:31:55.735982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:31:55.755717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:31:55.760269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:31:55.901361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3b1fe3e-daa7-420a-95db-0483a75b9038 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631405 Mar 29 02:31:55.908211 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2361/4510] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:31:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:31:55.914027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:55.914701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:55.924279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.925377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:55.927350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:55.933521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:56.108391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:31:56.143225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:56.158012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32ce9de4-3712-47a3-929a-660905f68a2c tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.733253 Mar 29 02:31:56.159389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2150/4511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:55 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:56.164040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d841caf-d25e-46e4-8887-dd9ed4ebfde4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:56.171574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d841caf-d25e-46e4-8887-dd9ed4ebfde4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:56.359578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d841caf-d25e-46e4-8887-dd9ed4ebfde4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:56.386073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d841caf-d25e-46e4-8887-dd9ed4ebfde4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1214 microversion: 2.1 time: 0.225401 Mar 29 02:31:56.395603 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2151/4512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:56 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:56.433235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:56.433878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] [instance: 7e62288e-8f17-4c1f-bd1f-73bf9480b62c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:56.450715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:56.451205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:56.452014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:56.459104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:56.545515 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] HTTP exception thrown: Instance 7e62288e-8f17-4c1f-bd1f-73bf9480b62c could not be found. Mar 29 02:31:56.546114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] Returning 404 to user: Instance 7e62288e-8f17-4c1f-bd1f-73bf9480b62c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:31:56.547153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f8d17c4-7be1-48ca-a49a-f908cdce62f6 tempest-VolumesActionsTest-249516048 tempest-VolumesActionsTest-249516048-project] 10.222.0.36 "GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c" status: 404 len: 111 microversion: 2.1 time: 0.117684 Mar 29 02:31:56.548219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2152/4513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:56 2022] GET /compute/v2.1/servers/7e62288e-8f17-4c1f-bd1f-73bf9480b62c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:31:56.650635 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e012be68-00aa-40f0-999c-544b7e8e877f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 204 len: 0 microversion: 2.42 time: 0.739905 Mar 29 02:31:56.651694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2362/4514] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:31:55 2022] DELETE /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 0 bytes in 743 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:31:56.661679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:56.662713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:56.675144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:56.676143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:56.677190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:56.683580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:57.175535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:57.176900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:57.190215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:57.206605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:57.211437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:57.211437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:57.636631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:57.651905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18f1ab91-b2cd-46f4-b097-9f63b3d47c14 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1522 microversion: 2.1 time: 0.479969 Mar 29 02:31:57.662796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2363/4515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:57 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:57.674946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-39475443", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb7c7d33-536f-4e4c-b35d-fb43c69f7bc9"}], "security_groups": [{"name": "tempest-securitygroup--291140334"}], "key_name": "tempest-keypair-2113506207", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:57.806572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:57.818283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:57.820352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:57.821929 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-26a3fac7-1cf6-4351-a92e-87983de47839 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2958 microversion: 2.42 time: 1.165659 Mar 29 02:31:57.822999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2153/4516] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:31:56 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2958 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:31:57.830854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:57.831712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:57.844792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:57.847833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:57.848577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:57.851839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:57.977030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] validate_networks() for [('fb7c7d33-536f-4e4c-b35d-fb43c69f7bc9', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:31:58.067943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:58.079641 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87729837-5f54-4e80-a71a-10a419c811ab tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1210 microversion: 2.1 time: 0.255330 Mar 29 02:31:58.083779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2154/4517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:57 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1210 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:58.354379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-176d971d-6879-474b-80b5-0a15e8a72ad5 req-8c1dd1fb-d8cd-46e7-8676-a16ce326c0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c1b67e-5774-4151-a20e-4f0fba6162d0", "name": "network-vif-deleted", "tag": "19138e39-3cad-4c89-b396-0118d8520f9a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:31:58.355972 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:31:58.355972 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:31:58.371915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-176d971d-6879-474b-80b5-0a15e8a72ad5 req-8c1dd1fb-d8cd-46e7-8676-a16ce326c0c6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:58.374514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-176d971d-6879-474b-80b5-0a15e8a72ad5 req-8c1dd1fb-d8cd-46e7-8676-a16ce326c0c6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:58.414948 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-176d971d-6879-474b-80b5-0a15e8a72ad5 req-8c1dd1fb-d8cd-46e7-8676-a16ce326c0c6 service nova] Creating event network-vif-deleted:19138e39-3cad-4c89-b396-0118d8520f9a for instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 on n-h1-828148-1 Mar 29 02:31:58.420741 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-176d971d-6879-474b-80b5-0a15e8a72ad5 req-8c1dd1fb-d8cd-46e7-8676-a16ce326c0c6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070457 Mar 29 02:31:58.422489 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2155/4518] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:31:58.678765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:58.679740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:58.737757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:58.737757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:58.737757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:58.737757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:58.858632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:58.860049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:58.861565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lazy-loading 'fault' on Instance uuid d6c1b67e-5774-4151-a20e-4f0fba6162d0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:31:59.407607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2efd8e6056cd4a27a715e3b54eca605d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2ae2fbff9a45d28765f19e7e87a2b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:59.419190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03084a2f-5afd-486b-80bf-f104a4d2bc4e tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 200 len: 1311 microversion: 2.1 time: 0.753361 Mar 29 02:31:59.422180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2156/4519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:58 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 1311 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:31:59.433346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:59.434223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:59.448762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:59.454793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:59.455829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:59.456434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:59.871292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:59.885587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:59.887404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:31:59.889118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2a647f2-2086-4e70-b417-fd7b1f5f35b1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2958 microversion: 2.42 time: 0.465704 Mar 29 02:31:59.890048 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2157/4520] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:31:59 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2958 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:31:59.895247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:31:59.896215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:31:59.904633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:59.905352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:31:59.906381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:31:59.907016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:00.099940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:00.115499 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d91e16a2-a761-493e-83df-2e43a45761ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1272 microversion: 2.1 time: 0.223688 Mar 29 02:32:00.116084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2158/4521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:31:59 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:00.440381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:00.442425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] [instance: d6c1b67e-5774-4151-a20e-4f0fba6162d0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:00.454547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:00.455657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:00.456920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:00.457954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:00.544775 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] HTTP exception thrown: Instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 could not be found. Mar 29 02:32:00.545613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] Returning 404 to user: Instance d6c1b67e-5774-4151-a20e-4f0fba6162d0 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:32:00.546642 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94ee9d1e-033d-48fd-b327-5ab994ce2464 tempest-ServerRescueNegativeTestJSON-434171235 tempest-ServerRescueNegativeTestJSON-434171235-project] 10.222.0.36 "GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0" status: 404 len: 111 microversion: 2.1 time: 0.111550 Mar 29 02:32:00.551034 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2159/4522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:00 2022] GET /compute/v2.1/servers/d6c1b67e-5774-4151-a20e-4f0fba6162d0 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:32:00.913947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:00.915793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:00.924599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:00.925106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:00.925937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:00.927140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:01.640476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:32:01.641527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:32:01.642199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:32:01.642808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:32:01.643424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:32:01.653105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:01.653885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:01.655084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:01.656815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:01.680195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:32:01.686115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Getting quotas for user b4a1d4410e584b6d8816da49c5e5b9c6 and project 6b19e3005af647ca9c3a40ee180c6ae2. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:32:01.714945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:32:01.722169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:32:01.940723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70c1cf19-36ff-45c2-b903-d3f50849ef8d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.276172 Mar 29 02:32:01.942169 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2364/4523] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:31:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 4279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:32:01.954152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:01.960099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:01.971582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:01.972533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:01.973620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:01.974286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:02.916316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:02.937654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:02.944044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:02.951368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1d40af7-e1f2-4c74-ae36-ec4c78b8371b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2958 microversion: 2.42 time: 2.041522 Mar 29 02:32:02.969132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2160/4524] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:00 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2958 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:32:02.989283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20f9e6ba-61c6-4cc0-8cc0-d1240bd4c4e2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:02.992618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20f9e6ba-61c6-4cc0-8cc0-d1240bd4c4e2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:03.784283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-20f9e6ba-61c6-4cc0-8cc0-d1240bd4c4e2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:03.799554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20f9e6ba-61c6-4cc0-8cc0-d1240bd4c4e2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1236 microversion: 2.1 time: 0.829154 Mar 29 02:32:03.802426 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2161/4525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:02 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1236 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:03.814929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-857c2aa5-1cba-4156-8650-7de2ee5cbbcc req-23204526-abdc-4dee-bde5-952463920fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:03.816744 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:03.816744 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:03.858841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-857c2aa5-1cba-4156-8650-7de2ee5cbbcc req-23204526-abdc-4dee-bde5-952463920fc8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:03.860363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-857c2aa5-1cba-4156-8650-7de2ee5cbbcc req-23204526-abdc-4dee-bde5-952463920fc8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:03.913018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-857c2aa5-1cba-4156-8650-7de2ee5cbbcc req-23204526-abdc-4dee-bde5-952463920fc8 service nova] Creating event network-vif-unplugged:d7a5dc56-ced5-4090-b4c9-8ef771e1bd8a for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:03.927185 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-857c2aa5-1cba-4156-8650-7de2ee5cbbcc req-23204526-abdc-4dee-bde5-952463920fc8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123222 Mar 29 02:32:03.930910 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2162/4526] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:03.981477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:03.982402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:04.002744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:04.003910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:04.005819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:04.007696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:04.214123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:04.220951 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-843aaa6c-259a-4648-889e-30d90dabbc83 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 2.277574 Mar 29 02:32:04.222131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2365/4527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:01 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:04.821290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:04.822756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:04.844589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:04.847500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:04.848771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:04.851436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:05.258206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:05.294010 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03752e00-372a-4584-a89f-459821f15ce8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1288 microversion: 2.1 time: 0.476544 Mar 29 02:32:05.296572 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2366/4528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:04 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1288 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:05.303306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4596cccf-2894-4556-a7eb-04dfe83b1d0b req-e2d69aa8-0043-4bad-8274-38e5114ef698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8272421-c9fe-4d54-a6fe-be178057cd7a", "tag": "82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:05.308586 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:05.308586 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:05.327681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4596cccf-2894-4556-a7eb-04dfe83b1d0b req-e2d69aa8-0043-4bad-8274-38e5114ef698 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:05.328381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4596cccf-2894-4556-a7eb-04dfe83b1d0b req-e2d69aa8-0043-4bad-8274-38e5114ef698 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:05.350387 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4596cccf-2894-4556-a7eb-04dfe83b1d0b req-e2d69aa8-0043-4bad-8274-38e5114ef698 service nova] Creating event network-changed:82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38 for instance e8272421-c9fe-4d54-a6fe-be178057cd7a on n-h1-828148-1 Mar 29 02:32:05.357559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4596cccf-2894-4556-a7eb-04dfe83b1d0b req-e2d69aa8-0043-4bad-8274-38e5114ef698 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058550 Mar 29 02:32:05.359455 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2367/4529] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:05.364827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:05.365841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:05.378284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:05.379092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:05.380115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:05.380545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:05.628589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:05.656162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:05.662374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:05.664028 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-681f75e0-c5e5-46db-853e-3619d632a81d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2958 microversion: 2.42 time: 1.689596 Mar 29 02:32:05.678282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2163/4530] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:03 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2958 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:06.073470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "23ae4153-d36c-4180-8450-7828198b373d"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "5439bc8e-6127-445f-b123-cba37ea6e3fc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:06.075374 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:06.075374 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:06.126962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:06.129133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:06.195654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] Creating event network-vif-unplugged:23ae4153-d36c-4180-8450-7828198b373d for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:06.199211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] Creating event network-vif-unplugged:5439bc8e-6127-445f-b123-cba37ea6e3fc for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:06.210859 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a1efd2f8-b743-4adf-91fe-df3bc79c4231 req-c762a130-72f3-4950-abc2-b9d7ba542be4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.140970 Mar 29 02:32:06.212295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2164/4531] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:32:06.327468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:06.329504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:06.380470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:06.382208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:06.384070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:06.386289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:06.894218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:06.909355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b644846-72a1-42b6-acbe-b3574c970962 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1294 microversion: 2.1 time: 0.598908 Mar 29 02:32:06.911614 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2165/4532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:06 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1294 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:06.923187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:06.927070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:06.946712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:06.954071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:06.959820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:06.961349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:07.690262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:07.705162 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c7fd350-99ce-4ef1-a1ad-b1d52168f4f5 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 2.344224 Mar 29 02:32:07.705744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2368/4533] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:05 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 2346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:07.926819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:07.927440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:07.944182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:07.944860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:07.945652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:07.946091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:08.154330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:08.173023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26d395c5-2570-4752-a063-ddb7a73650aa tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1294 microversion: 2.1 time: 0.249714 Mar 29 02:32:08.188665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2369/4534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:07 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1294 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:08.246277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "36ac7136-8916-47de-9d81-73917be95fee"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "a3943a15-704e-4b26-9b7c-ce42e87e288b"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-unplugged", "status": "completed", "tag": "cffc250d-42d3-48de-875e-040ce109f7cd"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:08.256303 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:08.256303 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:08.283082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:08.283531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:08.328483 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Creating event network-vif-unplugged:36ac7136-8916-47de-9d81-73917be95fee for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:08.329040 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Creating event network-vif-unplugged:a3943a15-704e-4b26-9b7c-ce42e87e288b for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:08.329541 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] Creating event network-vif-unplugged:cffc250d-42d3-48de-875e-040ce109f7cd for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:08.346861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-abd91541-87fa-4da3-8925-43b263ba5b4d req-13068c30-5eab-4baf-8018-b33c5b36c1c3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.110269 Mar 29 02:32:08.347798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2370/4535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:32:08.723207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:08.723829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:08.743474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:08.744144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:08.746270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:08.746891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:09.123615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:09.141834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:09.147804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:09.151905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-260ee673-a4a1-4eca-8b19-8b0a183b1139 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2937 microversion: 2.42 time: 2.236483 Mar 29 02:32:09.153001 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2166/4536] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:06 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2937 bytes in 2241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:09.190443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:09.195044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:09.204415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:09.204867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:09.205680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:09.206125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:09.556748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:09.570899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:09.578208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ec3ed69-c49b-48a4-a11a-b7d15ec4e1e4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 0.847130 Mar 29 02:32:09.581724 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2371/4537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:08 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:09.583768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-009a3861-bacb-4521-ac4f-5bb71a515cf0 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1294 microversion: 2.1 time: 0.397425 Mar 29 02:32:09.595799 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2167/4538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:09 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:10.192228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:10.209176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:10.247979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:10.253764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:10.253764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:10.253764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:10.598836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:10.599304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:10.612544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:10.616210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:10.616210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:10.624717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:13.323390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:13.338621 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ca70974-4d3a-4bf9-a9a2-b427daa0e093 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 2.745643 Mar 29 02:32:13.339461 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2168/4539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:10 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 2747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:13.350253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:13.351140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:13.383535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:13.384986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:13.389583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:13.390354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:13.831616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:13.856252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:13.863033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:13.867791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-137ac505-bcb1-4cf2-816e-3636e3f5e45d tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2916 microversion: 2.42 time: 3.699644 Mar 29 02:32:13.874206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2372/4540] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:10 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2916 bytes in 3707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:13.889742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4ea35f67-3d23-4c14-8084-4707a2153c35 req-c2df0485-2ffa-4693-a735-2f8bd60452f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-deleted", "tag": "cffc250d-42d3-48de-875e-040ce109f7cd"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:13.899592 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:13.899592 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:13.930251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4ea35f67-3d23-4c14-8084-4707a2153c35 req-c2df0485-2ffa-4693-a735-2f8bd60452f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:13.944077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4ea35f67-3d23-4c14-8084-4707a2153c35 req-c2df0485-2ffa-4693-a735-2f8bd60452f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:13.992426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4ea35f67-3d23-4c14-8084-4707a2153c35 req-c2df0485-2ffa-4693-a735-2f8bd60452f8 service nova] Creating event network-vif-deleted:cffc250d-42d3-48de-875e-040ce109f7cd for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:14.032920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4ea35f67-3d23-4c14-8084-4707a2153c35 req-c2df0485-2ffa-4693-a735-2f8bd60452f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154647 Mar 29 02:32:14.034155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2373/4541] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:14.253378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:14.267712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-de76ce28-21dd-4a5f-819c-e3539afd4d4f tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 0.926912 Mar 29 02:32:14.268955 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2169/4542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:13 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:14.369983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:14.370750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:14.383703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:14.384692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:14.386274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:14.391266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:14.892326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:14.894135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:14.921949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:14.929015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:14.929897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:14.931975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:15.610328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:15.638646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df25fdc9-fb72-4714-8e8e-d3c23dc5381e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 1.282168 Mar 29 02:32:15.650801 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2374/4543] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:14 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:15.668044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:15.676753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:15.713049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:15.713647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:15.714982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:15.716604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:16.213712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:16.243064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:16.262219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:16.270142 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a0a7bcb-3366-4a9d-894f-04f75aa62332 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2710 microversion: 2.42 time: 1.378868 Mar 29 02:32:16.272306 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2170/4544] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:14 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2710 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:32:16.279529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6011067f-df61-411d-ba45-ca8d6fbf4a8b req-c477be17-1378-4798-8f63-5f421d03bf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8272421-c9fe-4d54-a6fe-be178057cd7a", "name": "network-vif-plugged", "status": "completed", "tag": "82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:16.281374 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:16.281374 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:16.294264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6011067f-df61-411d-ba45-ca8d6fbf4a8b req-c477be17-1378-4798-8f63-5f421d03bf90 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:16.294264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6011067f-df61-411d-ba45-ca8d6fbf4a8b req-c477be17-1378-4798-8f63-5f421d03bf90 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:16.315894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6011067f-df61-411d-ba45-ca8d6fbf4a8b req-c477be17-1378-4798-8f63-5f421d03bf90 service nova] Creating event network-vif-plugged:82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38 for instance e8272421-c9fe-4d54-a6fe-be178057cd7a on n-h1-828148-1 Mar 29 02:32:16.339441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6011067f-df61-411d-ba45-ca8d6fbf4a8b req-c477be17-1378-4798-8f63-5f421d03bf90 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064814 Mar 29 02:32:16.340061 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2171/4545] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:16.353634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4972aee-17f3-43bd-949c-9800a94626c0", "tag": "e94fbebb-091c-48bb-80dd-7e0c94bc3c7a"}, {"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-deleted", "tag": "36ac7136-8916-47de-9d81-73917be95fee"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:16.355429 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:16.355429 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:16.381417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:16.395990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:16.418870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] Creating event network-changed:e94fbebb-091c-48bb-80dd-7e0c94bc3c7a for instance e4972aee-17f3-43bd-949c-9800a94626c0 on n-h2-828148-1 Mar 29 02:32:16.419843 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] Creating event network-vif-deleted:36ac7136-8916-47de-9d81-73917be95fee for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:16.426932 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e7e4f1fd-02dc-48fa-b490-2b2791ac6453 req-dcb6ccce-6b01-4722-a71d-39e7eb265c82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.085464 Mar 29 02:32:16.428107 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2172/4546] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:16.660741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:16.661918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:16.694693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:16.697378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:16.703558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:16.706536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:16.928267 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:32:17.938739 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46796. Mar 29 02:32:18.063556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:18.078481 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-501b67ad-ae94-41a5-aa13-ac38635e1934 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 1.424337 Mar 29 02:32:18.079264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2173/4547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:16 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:18.097469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:18.098092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:18.129362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:18.132753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:18.133624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:18.134072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:18.192803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:18.211832 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e445d251-04b0-470b-8228-57ce0f4fca00 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 2.559761 Mar 29 02:32:18.213087 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2375/4548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:15 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:19.096994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:19.097909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:19.142822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:19.153270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:19.157584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:19.158316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:19.758789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:19.780627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:19.783064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:19.799948 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72155207-fe40-44e9-b3cc-f6cf170bd71c tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2664 microversion: 2.42 time: 1.718632 Mar 29 02:32:19.802254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2174/4549] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:18 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2664 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:19.815633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:19.819102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:19.837824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:19.842802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:19.843972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:19.847314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:20.706026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:20.724591 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca97c754-87b4-4a94-8b58-2d09616958ab tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 0.912724 Mar 29 02:32:20.727469 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2175/4550] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:19 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:20.737892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c31db7c1-293a-4c1d-933a-4a06a959c6a6 req-ecd6aee4-be75-4931-a8f9-8eea394a08de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-deleted", "tag": "a3943a15-704e-4b26-9b7c-ce42e87e288b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:20.745101 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:20.745101 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:20.770547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c31db7c1-293a-4c1d-933a-4a06a959c6a6 req-ecd6aee4-be75-4931-a8f9-8eea394a08de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:20.772008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c31db7c1-293a-4c1d-933a-4a06a959c6a6 req-ecd6aee4-be75-4931-a8f9-8eea394a08de service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:20.830471 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c31db7c1-293a-4c1d-933a-4a06a959c6a6 req-ecd6aee4-be75-4931-a8f9-8eea394a08de service nova] Creating event network-vif-deleted:a3943a15-704e-4b26-9b7c-ce42e87e288b for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:20.845815 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c31db7c1-293a-4c1d-933a-4a06a959c6a6 req-ecd6aee4-be75-4931-a8f9-8eea394a08de service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114617 Mar 29 02:32:20.848745 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2176/4551] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:20.867120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:20.872121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:20.888526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:20.888526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:20.888526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:20.888526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:21.280702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:21.312106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:21.314451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:21.320460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cdf53b4d-0586-4888-8968-1d19d4bcc71f tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2550 microversion: 2.42 time: 0.467852 Mar 29 02:32:21.321474 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2177/4552] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:20 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2550 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:21.429999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:21.441874 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07bb1950-deb6-4cbb-8bc4-4325520e4044 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1314 microversion: 2.1 time: 2.350085 Mar 29 02:32:21.451044 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2376/4553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:19 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1314 bytes in 2353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:21.763940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:21.764783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:21.772784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:21.773482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:21.774313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:21.774883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:22.123711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:22.148756 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6be0c3c-cfce-439f-8e69-912498f8db46 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 0.393550 Mar 29 02:32:22.161098 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2178/4554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:21 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:22.343246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:22.344337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:22.363200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:22.363663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:22.364465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:22.364962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:22.458893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:22.459613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:22.483564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:22.483564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:22.483564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:22.483564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:22.975120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:22.985320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfee81f6-f1fd-468e-afb0-fd0e06428875 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1501 microversion: 2.1 time: 0.530562 Mar 29 02:32:23.000444 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2179/4555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:22 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1501 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:23.005730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49d116b9-f717-4585-bf16-4a663eb1c1b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:23.014620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49d116b9-f717-4585-bf16-4a663eb1c1b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:23.015593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49d116b9-f717-4585-bf16-4a663eb1c1b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:23.096246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49d116b9-f717-4585-bf16-4a663eb1c1b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Going to try to stop instance {{(pid=103514) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:32:23.434151 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49d116b9-f717-4585-bf16-4a663eb1c1b0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a/action" status: 202 len: 0 microversion: 2.1 time: 0.426867 Mar 29 02:32:23.439904 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2180/4556] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:32:23 2022] POST /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:32:23.465573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:23.477635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:23.528861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:23.540307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:23.543819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:23.545048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:24.183631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:24.208876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-962c7adb-f8ef-4c28-8038-0c8e29b1b925 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 0.766397 Mar 29 02:32:24.219355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2181/4557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:23 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:24.224691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:24.225439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:24.235182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:24.235651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:24.236588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:24.237198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:24.883685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:24.898046 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4963a200-1ea3-459b-9339-7b8015e586e1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.677379 Mar 29 02:32:24.910870 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2182/4558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:24 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:25.195350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:25.209155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:25.210866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:25.212485 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00b6dd0e-0b6a-40ef-8a86-97557875a945 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2550 microversion: 2.42 time: 2.876259 Mar 29 02:32:25.226143 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2377/4559] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:22 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2550 bytes in 2891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:25.226297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:25.227257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:25.259410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.265569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:25.266512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.266966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-aefa0b80-8ab5-406b-9574-44efeb2fc248 req-ba6ce6af-41bd-409f-8c58-d3fe0836619a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-deleted", "tag": "5439bc8e-6127-445f-b123-cba37ea6e3fc"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aefa0b80-8ab5-406b-9574-44efeb2fc248 req-ba6ce6af-41bd-409f-8c58-d3fe0836619a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-aefa0b80-8ab5-406b-9574-44efeb2fc248 req-ba6ce6af-41bd-409f-8c58-d3fe0836619a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:25.824855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-aefa0b80-8ab5-406b-9574-44efeb2fc248 req-ba6ce6af-41bd-409f-8c58-d3fe0836619a service nova] Creating event network-vif-deleted:5439bc8e-6127-445f-b123-cba37ea6e3fc for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:25.825865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:25.826621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-aefa0b80-8ab5-406b-9574-44efeb2fc248 req-ba6ce6af-41bd-409f-8c58-d3fe0836619a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106812 Mar 29 02:32:25.826804 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c506e14-e288-4b23-b3c0-2e2fcb2aebed tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 0.585055 Mar 29 02:32:25.826990 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2378/4560] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:25.827081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2183/4561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:25 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:25.832857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-45168943-acdc-45f3-925a-07d8b48f22d6 req-fb7b5205-46a4-4ebf-81c5-c12a4edf7ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4972aee-17f3-43bd-949c-9800a94626c0", "name": "network-vif-plugged", "status": "completed", "tag": "e94fbebb-091c-48bb-80dd-7e0c94bc3c7a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:25.835315 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:25.835315 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:25.845138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-45168943-acdc-45f3-925a-07d8b48f22d6 req-fb7b5205-46a4-4ebf-81c5-c12a4edf7ce7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.845583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-45168943-acdc-45f3-925a-07d8b48f22d6 req-fb7b5205-46a4-4ebf-81c5-c12a4edf7ce7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:25.872108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-45168943-acdc-45f3-925a-07d8b48f22d6 req-fb7b5205-46a4-4ebf-81c5-c12a4edf7ce7 service nova] Creating event network-vif-plugged:e94fbebb-091c-48bb-80dd-7e0c94bc3c7a for instance e4972aee-17f3-43bd-949c-9800a94626c0 on n-h2-828148-1 Mar 29 02:32:25.877611 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-45168943-acdc-45f3-925a-07d8b48f22d6 req-fb7b5205-46a4-4ebf-81c5-c12a4edf7ce7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067713 Mar 29 02:32:25.878497 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2379/4562] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:25.920994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:25.924237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:25.965633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.966083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:25.970683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:25.971177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:26.245562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:26.246396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:26.290322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:26.290322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:26.290322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:26.290322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:26.410555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:26.426431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ab416a1-e281-4c9b-b8c8-4816dd1f9b48 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.509330 Mar 29 02:32:26.426431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2184/4563] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:25 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:26.824333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:26.832008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:26.837139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:26.856224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:26.860631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:26.860631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:27.853051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:27.865708 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c46bd0b7-2dca-461e-add0-d83064a372f5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 1.045117 Mar 29 02:32:27.866899 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2185/4564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:26 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:27.881138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:27.882573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:27.909369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:27.914403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:27.917348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:27.919789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:28.255527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:28.266259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-059890ed-9b37-46f5-97a1-01f2dad9f19a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.395230 Mar 29 02:32:28.267345 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2186/4565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:27 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:28.722974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:28.745189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:28.751561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:28.757032 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4840ad9-f6cc-494d-967b-d18a3a140a2b tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 2213 microversion: 2.42 time: 2.523288 Mar 29 02:32:28.762158 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2380/4566] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:26 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 2213 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:28.884271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:28.885207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:28.898507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:28.905906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:28.907200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:28.907793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:28.917928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-38c99cb7-374d-4e80-963e-beb84c7e0dd9 req-dc21a952-cf24-4f4c-98de-611bd1ecbc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6d0927-7bb0-4cd8-aa21-d313b70b66ba", "name": "network-vif-deleted", "tag": "23ae4153-d36c-4180-8450-7828198b373d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:28.924773 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:28.924773 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:28.949496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-38c99cb7-374d-4e80-963e-beb84c7e0dd9 req-dc21a952-cf24-4f4c-98de-611bd1ecbc52 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:28.953313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-38c99cb7-374d-4e80-963e-beb84c7e0dd9 req-dc21a952-cf24-4f4c-98de-611bd1ecbc52 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:29.009918 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-38c99cb7-374d-4e80-963e-beb84c7e0dd9 req-dc21a952-cf24-4f4c-98de-611bd1ecbc52 service nova] Creating event network-vif-deleted:23ae4153-d36c-4180-8450-7828198b373d for instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba on n-h2-828148-1 Mar 29 02:32:29.038660 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-38c99cb7-374d-4e80-963e-beb84c7e0dd9 req-dc21a952-cf24-4f4c-98de-611bd1ecbc52 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117198 Mar 29 02:32:29.039693 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2381/4567] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:32:29.294722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:29.295934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:29.304769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:29.310673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:29.310673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:29.314195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:30.007596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:30.017996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e05a2fe-f5c8-4be5-8f67-4181e99c843f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.735511 Mar 29 02:32:30.018703 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2382/4568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:29 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:30.025413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:30.026191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:30.036525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:30.037244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:30.038251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:30.039147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:30.115901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:30.128376 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-922fae03-595e-4731-bf7a-aac167d32973 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1361 microversion: 2.1 time: 1.247655 Mar 29 02:32:30.129605 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2187/4569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:28 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1361 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:30.686824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:30.713286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:30.715667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:30.719419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9801801d-878e-4e91-a431-b4f44dd55be1 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1604 microversion: 2.42 time: 0.699597 Mar 29 02:32:30.722403 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2383/4570] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:30 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1604 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:31.035588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:31.036690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:31.057042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:31.057748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:31.058738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:31.059332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:31.145423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:31.146568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:31.157327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:31.161416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:31.164253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:31.168203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:31.944215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:31.956972 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7d1208c-d8ff-47d2-9e12-389aefa04b6a tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1548 microversion: 2.1 time: 0.815047 Mar 29 02:32:31.977205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2384/4571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:31 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1548 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:31.988430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:31.991056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:32.010275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:32.011525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:32.015278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:32.015896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:32.255021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:32.266876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:32.270088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:32.275944 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-67be8f04-1e57-4356-909b-f52549afda86 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1604 microversion: 2.42 time: 0.295095 Mar 29 02:32:32.279435 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2385/4572] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:31 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1604 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:32.285429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:32.296291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:32.318856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:32.320058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:32.321671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:32.322338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:32.410837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:32.421088 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f33dd48e-288d-4a38-9ee6-9fa408e9438d tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.389543 Mar 29 02:32:32.421660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2188/4573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:31 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:32.591826 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be82f105-a6d2-4dd1-9e0c-1592b0c60401 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.310439 Mar 29 02:32:32.592418 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2386/4574] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 02:32:32 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-interface => generated 285 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:33.302073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:33.303152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:33.350207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:33.357599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:33.361053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:33.365237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:33.544577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:33.545614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:33.548427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lazy-loading 'fault' on Instance uuid 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:32:33.552365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-211218824", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "cd416d3f-9bc1-4811-91a0-ff8a87f27910"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:33.673549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] validate_networks() for [('cd416d3f-9bc1-4811-91a0-ff8a87f27910', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:32:33.758076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:33.768138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:33.776809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04a5b48824604553ac2fd7b08fc81f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bda67cbdacc74c0f8dbde35c57289991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:33.786791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c3c7d913-8681-43e8-a609-413ea511cb8a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 200 len: 1371 microversion: 2.42 time: 0.487295 Mar 29 02:32:33.787712 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2387/4575] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:33 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:33.795842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:33.800788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:33.818084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:33.818925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:33.819945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:33.820600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:34.423816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:34.437369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e2a2c0ca-cc91-490a-a446-b448e52b63e2 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.640917 Mar 29 02:32:34.438261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2388/4576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:33 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:34.809198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:34.810759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:34.841893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:34.842347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:34.843138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:34.843572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:35.004952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] HTTP exception thrown: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. Mar 29 02:32:35.005910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Returning 404 to user: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:32:35.007800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b0b230b-3c4b-420a-b4a4-1953ae21f84a tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 404 len: 111 microversion: 2.42 time: 0.201728 Mar 29 02:32:35.015295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2389/4577] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:34 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:32:35.024885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a1236cb3-2fe3-49d1-9e71-fc3bb0464de6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '.version_select at 0x7f8725ec6940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:35.168453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a1236cb3-2fe3-49d1-9e71-fc3bb0464de6 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496303868" status: 204 len: 0 microversion: 2.42 time: 0.150899 Mar 29 02:32:35.173238 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2390/4578] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Mar 29 02:32:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1496303868 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:32:35.371551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:32:35.374188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:32:35.374907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:32:35.375520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:32:35.376359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:32:35.408477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:35.411345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:35.417225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:35.421065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:35.455503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:35.456133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:35.469029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Getting quotas for project 9f9c926c28e3415aaefb615c2deb3e18. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:32:35.472789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:35.473095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:35.473887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:35.474321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:35.477808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Getting quotas for user a36cd20ad6ac472f90c7b2be0ad56588 and project 9f9c926c28e3415aaefb615c2deb3e18. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:32:35.535029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:32:35.544496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:32:35.728951 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1a9626b-1de9-47d5-9534-5aee5c2d60c1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.488078 Mar 29 02:32:35.738089 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2189/4579] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:32:35.756622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:35.759410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:36.195492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:36.202282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:36.209829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:36.218954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0cea031b-ccc3-491b-890a-f9eeb78ca96b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1261 microversion: 2.26 time: 0.472276 Mar 29 02:32:36.219683 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2190/4580] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:35 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1261 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:36.688795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:36.705071 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebe0b1b5-5607-4dfd-9f0f-a11ee9cc2dcb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.251894 Mar 29 02:32:36.707375 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2391/4581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:35 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:37.238582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:37.244925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:37.508923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6a6fe8c6-a19e-44b5-8c14-55417a91ed62 req-d2c74640-4ad9-492a-9054-b4a10dc7d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4972aee-17f3-43bd-949c-9800a94626c0", "tag": "e94fbebb-091c-48bb-80dd-7e0c94bc3c7a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:37.509070 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:37.509070 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:32:37.532206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6a6fe8c6-a19e-44b5-8c14-55417a91ed62 req-d2c74640-4ad9-492a-9054-b4a10dc7d8d0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:37.532930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6a6fe8c6-a19e-44b5-8c14-55417a91ed62 req-d2c74640-4ad9-492a-9054-b4a10dc7d8d0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:37.550989 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6a6fe8c6-a19e-44b5-8c14-55417a91ed62 req-d2c74640-4ad9-492a-9054-b4a10dc7d8d0 service nova] Creating event network-changed:e94fbebb-091c-48bb-80dd-7e0c94bc3c7a for instance e4972aee-17f3-43bd-949c-9800a94626c0 on n-h2-828148-1 Mar 29 02:32:37.599353 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6a6fe8c6-a19e-44b5-8c14-55417a91ed62 req-d2c74640-4ad9-492a-9054-b4a10dc7d8d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058300 Mar 29 02:32:37.599353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2392/4582] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:37.600513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:37.603857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:37.606113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:37.609113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-622ce98c-5332-4c71-8047-eca04f49fba4 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1261 microversion: 2.26 time: 0.374505 Mar 29 02:32:37.610177 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2191/4583] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:37 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1261 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:37.724765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:37.726329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:37.744899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:37.752064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:37.755075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:37.755705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:38.627494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:38.628369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:38.651271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:38.651375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:38.652121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:38.652552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:39.227514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:39.246721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:39.253032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:39.259468 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be324e96-a788-4391-8b68-980584b97f1d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1313 microversion: 2.26 time: 0.635595 Mar 29 02:32:39.265596 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2192/4584] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:38 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:39.405981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:39.421338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-409ab24f-63ef-4167-8a90-2e09b537057a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.701373 Mar 29 02:32:39.444465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2393/4585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:37 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:40.296062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:40.298457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:40.327752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:40.328234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:40.330752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:40.332604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:40.452182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:40.452820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:40.475325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:40.475778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:40.476580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:40.482762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:40.688979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:40.708723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:40.718725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:40.720528 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-120fab8e-0eea-47de-bc51-b524f1b84fb0 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1319 microversion: 2.26 time: 0.437308 Mar 29 02:32:40.734578 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2193/4586] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:40 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:41.422458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:41.436761 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c05b259-f5fc-49f6-b8cf-bad235f00d80 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.989079 Mar 29 02:32:41.438521 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2394/4587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:40 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:41.747748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:41.749725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:41.765927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:41.768242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:41.770510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:41.773311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:42.456373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:42.457026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:42.478437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:42.478898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:42.479688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:42.480123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:42.951235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:42.969805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:42.978825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:42.982445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2c2449a2-d626-4b86-bda3-64d78362d09b tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 1.239140 Mar 29 02:32:42.985500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2194/4588] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:41 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:43.605725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:43.646158 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a377a7cc-316b-451a-a763-7ec23fdd9d01 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.194989 Mar 29 02:32:43.649177 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2395/4589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:42 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:44.008182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:44.008936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:44.033616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:44.034228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:44.035181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:44.035624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:44.665293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:44.666517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:44.685965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:44.686722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:44.687733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:44.688401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:44.895756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:44.919104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:44.926605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:44.928540 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ec4c5ca-d7d8-4371-9be4-8a78c9b2459e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 0.924471 Mar 29 02:32:44.929201 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2195/4590] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:44 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:45.026459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fcd09fd5-0e39-4c5d-b4cf-bdc6f6786c9d req-c39d1514-3b58-429f-9b72-5a794584cd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8399626a-dfb5-4393-a6b7-8cc5ef175ea5", "tag": "14cd6804-aae7-4d8b-8663-d162f3dea834"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:45.030037 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:45.030037 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:45.050542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fcd09fd5-0e39-4c5d-b4cf-bdc6f6786c9d req-c39d1514-3b58-429f-9b72-5a794584cd8c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:45.054877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fcd09fd5-0e39-4c5d-b4cf-bdc6f6786c9d req-c39d1514-3b58-429f-9b72-5a794584cd8c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:45.082395 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fcd09fd5-0e39-4c5d-b4cf-bdc6f6786c9d req-c39d1514-3b58-429f-9b72-5a794584cd8c service nova] Creating event network-changed:14cd6804-aae7-4d8b-8663-d162f3dea834 for instance 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 on n-h1-828148-1 Mar 29 02:32:45.090843 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fcd09fd5-0e39-4c5d-b4cf-bdc6f6786c9d req-c39d1514-3b58-429f-9b72-5a794584cd8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067236 Mar 29 02:32:45.094213 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2196/4591] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:45.531796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:45.549967 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb165517-e09f-4911-b70c-062582037812 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 0.888102 Mar 29 02:32:45.556148 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2396/4592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:44 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:45.947914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:45.949134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:45.960381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:45.962414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:45.963359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:45.965394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:46.579282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:46.580426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:46.601822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:46.607197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:46.610579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:46.611160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:47.491181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:47.499689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:47.506461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:47.507615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e0e35b04-ab31-4de5-85ba-8d12bc5f1918 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 1.564095 Mar 29 02:32:47.511805 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2197/4593] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:45 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:47.630593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:47.643377 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f8db4cff-0680-401f-bb88-97b854f89e70 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.067964 Mar 29 02:32:47.655845 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2397/4594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:46 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:48.527479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:48.528180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:48.542735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:48.543233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:48.544579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:48.545090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:48.659577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:48.660368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:48.682275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:48.686118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:48.687095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:48.687662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:49.157510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:49.181842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:49.189118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:49.189118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-862c07bd-4beb-4cdf-a982-6a66e5be8342 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 0.665209 Mar 29 02:32:49.189842 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2198/4595] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:48 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:50.040246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:50.072102 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c9d23a1b-1f78-4d03-a1c6-60dc2f7784fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1511 microversion: 2.1 time: 1.416254 Mar 29 02:32:50.073084 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2398/4596] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:48 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1511 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:50.212366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:50.213165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:50.229794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:50.231928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:50.237959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:50.239159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:50.962029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:50.975093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:50.976665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:50.978037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96ac96f4-7980-4e7b-846f-63d313ce1250 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 0.771367 Mar 29 02:32:50.978872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2199/4597] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:50 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:51.090240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:51.091492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:51.115666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:51.115924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:51.116584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:51.117047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:51.997745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:51.998353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:52.005125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:52.031267 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-378bb77b-50b3-4e08-a4e4-090d2e2cba38 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1488 microversion: 2.1 time: 0.944952 Mar 29 02:32:52.040947 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2399/4598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:51 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1488 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:52.042323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.052758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:52.053320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:52.053936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.054830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.055337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.074577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.075018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.075996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.076613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.139795 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] HTTP exception thrown: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. Mar 29 02:32:52.142909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Returning 404 to user: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:32:52.142909 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7c46264-ddeb-4ce1-9671-6a19d5b5fbc7 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 404 len: 111 microversion: 2.42 time: 0.092143 Mar 29 02:32:52.142909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2400/4599] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:32:52 2022] DELETE /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:32:52.149419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:52.149887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:52.165371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.165371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.165371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.165371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.233678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:32:52.568873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:52.581813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:52.584041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:52.585538 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c712ead-2fec-4645-ade8-27ccc496ea8d tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 0.591928 Mar 29 02:32:52.589475 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5622809-0ecf-4e22-a40a-4741a4138eb0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 204 len: 0 microversion: 2.1 time: 0.445181 Mar 29 02:32:52.590297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2401/4600] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:32:52 2022] DELETE /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:32:52.607356 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2200/4601] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:51 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:52.608423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:52.609654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] [instance: 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:52.628351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.629118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.629981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.630502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.631454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:52.632043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:52.639989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.640654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.641833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:52.645331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:52.712957 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] HTTP exception thrown: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. Mar 29 02:32:52.716761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] Returning 404 to user: Instance 2f6d0927-7bb0-4cd8-aa21-d313b70b66ba could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:32:52.719946 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae4e71d1-1c41-4794-832a-036dda1e6ba9 tempest-TaggedBootDevicesTest_v242-2113998517 tempest-TaggedBootDevicesTest_v242-2113998517-project] 10.222.0.36 "GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba" status: 404 len: 111 microversion: 2.42 time: 0.128414 Mar 29 02:32:52.744654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2402/4602] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:52 2022] GET /compute/v2.1/servers/2f6d0927-7bb0-4cd8-aa21-d313b70b66ba => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:32:53.046331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:53.064177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2416907e-8162-46ce-ae06-d34b08a457ed tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1494 microversion: 2.1 time: 0.455668 Mar 29 02:32:53.066608 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2201/4603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:52 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1494 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:53.627107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:53.627719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:53.651275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:53.654158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:53.657299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:53.658212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:54.079754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a73c90f4-bccb-4a5f-90c5-52f54553c3e7 req-0d8ac84a-4c70-4113-be9d-576351edba5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8399626a-dfb5-4393-a6b7-8cc5ef175ea5", "name": "network-vif-plugged", "status": "completed", "tag": "14cd6804-aae7-4d8b-8663-d162f3dea834"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:54.082025 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:54.082025 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:54.096631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a73c90f4-bccb-4a5f-90c5-52f54553c3e7 req-0d8ac84a-4c70-4113-be9d-576351edba5e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:54.098447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a73c90f4-bccb-4a5f-90c5-52f54553c3e7 req-0d8ac84a-4c70-4113-be9d-576351edba5e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:54.128154 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a73c90f4-bccb-4a5f-90c5-52f54553c3e7 req-0d8ac84a-4c70-4113-be9d-576351edba5e service nova] Creating event network-vif-plugged:14cd6804-aae7-4d8b-8663-d162f3dea834 for instance 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 on n-h1-828148-1 Mar 29 02:32:54.136877 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a73c90f4-bccb-4a5f-90c5-52f54553c3e7 req-0d8ac84a-4c70-4113-be9d-576351edba5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062161 Mar 29 02:32:54.141583 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2202/4604] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:54.153854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:54.156855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:54.202547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:54.202997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:54.215010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:54.215476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:54.441561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:54.453827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:54.455501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:54.456434 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-41b19bc9-6087-4bd2-be2d-60ee13d44e2c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 0.833926 Mar 29 02:32:54.457004 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2403/4605] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:53 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:55.032823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:55.045045 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77e61883-5ce6-49ac-bb47-d09921f27551 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1494 microversion: 2.1 time: 0.899471 Mar 29 02:32:55.046824 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2203/4606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:54 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1494 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:55.475375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:55.476631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:55.499221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:55.504862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:55.504862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:55.504862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:55.672224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-864e62f6-924e-44f7-9f91-2993dd455dff req-305a34a8-d332-4861-9f73-775c3f5e6e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8272421-c9fe-4d54-a6fe-be178057cd7a", "name": "network-vif-deleted", "tag": "82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:55.673916 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:32:55.673916 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:32:55.699570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-864e62f6-924e-44f7-9f91-2993dd455dff req-305a34a8-d332-4861-9f73-775c3f5e6e80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:55.700011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-864e62f6-924e-44f7-9f91-2993dd455dff req-305a34a8-d332-4861-9f73-775c3f5e6e80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:55.765443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-864e62f6-924e-44f7-9f91-2993dd455dff req-305a34a8-d332-4861-9f73-775c3f5e6e80 service nova] Creating event network-vif-deleted:82ecc5ee-dd9d-44f1-a22f-4bf9af2f0c38 for instance e8272421-c9fe-4d54-a6fe-be178057cd7a on n-h1-828148-1 Mar 29 02:32:55.781977 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-864e62f6-924e-44f7-9f91-2993dd455dff req-305a34a8-d332-4861-9f73-775c3f5e6e80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113276 Mar 29 02:32:55.792629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2204/4607] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:32:56.063632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:56.065539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:56.081240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:56.089384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:56.095536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:56.096496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:56.237864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:56.238360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:56.239952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'fault' on Instance uuid e8272421-c9fe-4d54-a6fe-be178057cd7a {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:32:56.594613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:56.606521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:56.612789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:56.620465 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-edbdf6a0-2b37-4ade-bc8d-bb5daadf60e5 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1361 microversion: 2.26 time: 1.142080 Mar 29 02:32:56.626862 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2404/4608] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:55 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1361 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:57.196976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:57.205923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cada4822-d525-481a-8e27-edfd1fcff428 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 200 len: 1304 microversion: 2.1 time: 1.146108 Mar 29 02:32:57.207366 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2205/4609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:56 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 1304 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:32:57.634259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:57.635687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:57.647571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:57.649762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:57.650753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:57.653352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.038677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:58.055804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:58.055804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:32:58.056620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-266daa2d-21a4-4e16-b9f0-4933761db857 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1544 microversion: 2.26 time: 0.425449 Mar 29 02:32:58.069136 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2405/4610] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:32:57 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1544 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:32:58.079164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8717e771f0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.090327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.091172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.091664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:58.099832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.100282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.101225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.101653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.176627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.177293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.193313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.194143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.223562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.224179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:58.232528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.233426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.234227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.234843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.288208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. Mar 29 02:32:58.289099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:32:58.290098 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-355c14f1-21d0-4c08-bb9a-9d49845bfed8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 404 len: 111 microversion: 2.1 time: 0.070583 Mar 29 02:32:58.291161 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2406/4611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:58 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:32:58.321863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:32:58.376605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d53e1a3-7d6a-4cc9-9fbe-47b7b66ab9ee tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-143177701" status: 201 len: 0 microversion: 2.26 time: 0.301725 Mar 29 02:32:58.377610 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2206/4612] 10.222.0.36 () {62 vars in 1376 bytes} [Tue Mar 29 02:32:58 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-143177701 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 29 02:32:58.388535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-97bf9dab-a2ad-493a-b195-e482fca59a59 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d5e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.423286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97bf9dab-a2ad-493a-b195-e482fca59a59 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.424199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-97bf9dab-a2ad-493a-b195-e482fca59a59 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.446428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1608093582", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a652b2df-b676-4b08-aecb-0581ee6b0e6f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:32:58.446623 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-97bf9dab-a2ad-493a-b195-e482fca59a59 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-143177701" status: 204 len: 0 microversion: 2.26 time: 0.063074 Mar 29 02:32:58.451267 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2407/4613] 10.222.0.36 () {60 vars in 1357 bytes} [Tue Mar 29 02:32:58 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-143177701 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:32:58.456694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8717e79a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.466777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.467347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.467893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:58.475703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.476324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.477298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.477697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.515715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] validate_networks() for [('a652b2df-b676-4b08-aecb-0581ee6b0e6f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:32:58.538374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.538809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.669207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:32:58.819696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-724ef0ad-75eb-47ce-935e-1d00d7273994 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 204 len: 0 microversion: 2.26 time: 0.365895 Mar 29 02:32:58.820852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2408/4614] 10.222.0.36 () {60 vars in 1294 bytes} [Tue Mar 29 02:32:58 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:32:58.835341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e2bb7ba-4ce7-4c8e-86cc-33d79549a4e2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8725ec6940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.852782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2bb7ba-4ce7-4c8e-86cc-33d79549a4e2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.853441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2bb7ba-4ce7-4c8e-86cc-33d79549a4e2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.893541 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e2bb7ba-4ce7-4c8e-86cc-33d79549a4e2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 12 microversion: 2.26 time: 0.066410 Mar 29 02:32:58.896137 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2409/4615] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 02:32:58 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 12 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:58.910959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d51f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:58.946768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.951784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.951784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:58.975812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.977385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:58.981527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:58.983169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.118055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.118574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.144766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.144766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.285890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:32:59.368906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:32:59.369891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:32:59.370522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:32:59.371144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:32:59.372537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:32:59.387526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.391244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.392371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.395380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.432796 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6253831-090b-45d5-b6b6-1364b9a035d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-714976798" status: 201 len: 0 microversion: 2.26 time: 0.526606 Mar 29 02:32:59.435018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2410/4616] 10.222.0.36 () {62 vars in 1376 bytes} [Tue Mar 29 02:32:58 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-714976798 => generated 0 bytes in 533 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Mar 29 02:32:59.435466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:32:59.443537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Getting quotas for user 042da487d12a4035a8ee45b15a1d88b5 and project 98f955dfc30e4e1597fad2589467b808. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:32:59.451232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-53fb51a6-ccac-4118-9b09-775964b4767a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8724bad670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:59.459037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53fb51a6-ccac-4118-9b09-775964b4767a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.459630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53fb51a6-ccac-4118-9b09-775964b4767a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.473739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:32:59.478618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:32:59.479942 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-53fb51a6-ccac-4118-9b09-775964b4767a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 35 microversion: 2.26 time: 0.039836 Mar 29 02:32:59.481133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2411/4617] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 02:32:59 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 35 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:32:59.497026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d5310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:59.526534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.528936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.530739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:59.555788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.558434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.561338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.561904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.656866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-154c64d3-d505-4cb5-9d8e-1a7c26bd357e tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.214005 Mar 29 02:32:59.658876 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2207/4618] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:32:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:32:59.669932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e093c74-2fe9-4c55-b475-9bf4005a9264 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:32:59.675603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e093c74-2fe9-4c55-b475-9bf4005a9264 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:32:59.742432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:32:59.742969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:32:59.955118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:00.109861 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-45d5adbb-957c-41f2-8d9c-29ec2a4e0346 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-714976798" status: 204 len: 0 microversion: 2.26 time: 0.623265 Mar 29 02:33:00.110771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2412/4619] 10.222.0.36 () {60 vars in 1360 bytes} [Tue Mar 29 02:32:59 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-714976798 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:00.119615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3eb19ea7-d4e0-4789-9f9f-3d98d6b7b2b1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8725ec6940>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:00.159347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eb19ea7-d4e0-4789-9f9f-3d98d6b7b2b1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.159787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3eb19ea7-d4e0-4789-9f9f-3d98d6b7b2b1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.198690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3eb19ea7-d4e0-4789-9f9f-3d98d6b7b2b1 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 12 microversion: 2.26 time: 0.083467 Mar 29 02:33:00.200481 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2413/4620] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 02:33:00 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 12 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:00.211215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d5c10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:00.230687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.231130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.231609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:00.254948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.255389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.256234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.256665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.344151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.344744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.362718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:00.382025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e093c74-2fe9-4c55-b475-9bf4005a9264 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:00.415163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e093c74-2fe9-4c55-b475-9bf4005a9264 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1215 microversion: 2.1 time: 0.749213 Mar 29 02:33:00.418495 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2208/4621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:32:59 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1215 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:00.465714 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f9f9a0b-0cb3-4f53-8cb2-277ee4419927 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 204 len: 0 microversion: 2.26 time: 0.257310 Mar 29 02:33:00.468104 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2414/4622] 10.222.0.36 () {60 vars in 1294 bytes} [Tue Mar 29 02:33:00 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:00.481721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f872405df70>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:00.493147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.493913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.494613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:00.503878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.504658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.514614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.516245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.641391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.642316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.668613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.669405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.769904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:00.888331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec91da51-59f3-4fe5-b0a9-1b61f55594cf tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-873715243" status: 201 len: 0 microversion: 2.26 time: 0.412713 Mar 29 02:33:00.893289 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2209/4623] 10.222.0.36 () {62 vars in 1376 bytes} [Tue Mar 29 02:33:00 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-873715243 => generated 0 bytes in 418 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 29 02:33:00.911919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8717ea85e0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:00.938075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:00.939274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.038718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.039176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.085963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.086595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.295361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:01.398658 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-993b2a5f-ff40-44a9-b63c-cdb21c31eb34 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-503101550" status: 201 len: 0 microversion: 2.26 time: 0.491385 Mar 29 02:33:01.400132 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2415/4624] 10.222.0.36 () {62 vars in 1376 bytes} [Tue Mar 29 02:33:00 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-503101550 => generated 0 bytes in 493 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Mar 29 02:33:01.410769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d5280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:01.425847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.439081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:01.440003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:01.451357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.452126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:01.453669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.454182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.454974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.455893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.465501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.476393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.479760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.482825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.675663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.676119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.779372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:01.799803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:01.818858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebfc7be8-dd97-4745-bd1d-874844abdcdf tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1219 microversion: 2.1 time: 0.381366 Mar 29 02:33:01.825189 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2416/4625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:01 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1219 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:01.878860 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8efae1c5-41d6-4f4b-a48b-b9dba2e8e91f tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 204 len: 0 microversion: 2.26 time: 0.472866 Mar 29 02:33:01.880857 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2210/4626] 10.222.0.36 () {60 vars in 1294 bytes} [Tue Mar 29 02:33:01 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:01.889191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-182a8e26-f0f8-47e2-a4a8-a19a00c73ae7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8724bf9160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:01.917067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-182a8e26-f0f8-47e2-a4a8-a19a00c73ae7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:01.918130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-182a8e26-f0f8-47e2-a4a8-a19a00c73ae7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:01.959215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-182a8e26-f0f8-47e2-a4a8-a19a00c73ae7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 12 microversion: 2.26 time: 0.074009 Mar 29 02:33:01.960002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2417/4627] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 02:33:01 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 12 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:01.972614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8724344dc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:01.992377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.000089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.000873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:02.014555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.015429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.016443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.017187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.155101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.155813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.183624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:02.314198 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fdd6136-f763-4b69-af0e-57fd33665110 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 204 len: 0 microversion: 2.26 time: 0.347916 Mar 29 02:33:02.314831 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2211/4628] 10.222.0.36 () {60 vars in 1294 bytes} [Tue Mar 29 02:33:01 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:02.327222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87240d5af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:02.345253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.348489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.349769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:02.369482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.370223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.371894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.372487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.488164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.488612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.508454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.508625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.603582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:02.675561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d16fe55-5af6-4365-bff9-669cc423c88e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-1637600522" status: 201 len: 0 microversion: 2.26 time: 0.342128 Mar 29 02:33:02.677236 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2418/4629] 10.222.0.36 () {62 vars in 1379 bytes} [Tue Mar 29 02:33:02 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-1637600522 => generated 0 bytes in 355 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Mar 29 02:33:02.686217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f87244644c0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:02.711711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.712380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.718403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:02.737849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.738657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.742898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.748222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.842508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:02.843587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:02.864177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.865730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.867126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.867590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.876822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.877315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:02.887897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:02.888619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.024101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:03.092253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:03.107470 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-889abe80-409d-4cfb-be37-effb0eb1a513 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1267 microversion: 2.1 time: 0.271096 Mar 29 02:33:03.108867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2419/4630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:02 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:03.128707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:03.139360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:03.140783 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-17b68a81-5d26-48f8-bd04-742d957ee374 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-2022796164" status: 201 len: 0 microversion: 2.26 time: 0.459013 Mar 29 02:33:03.142578 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2212/4631] 10.222.0.36 () {62 vars in 1379 bytes} [Tue Mar 29 02:33:02 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags/tempest-tag-2022796164 => generated 0 bytes in 462 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Mar 29 02:33:03.154622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Action: 'update_all', calling method: .version_select at 0x7f872405d040>, body: {"tags": ["tempest-tag-424155759", "tempest-tag-1024930237"]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:03.167014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.168040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.168824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.169281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.170897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.172777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.174048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:03.186914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.187627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.188982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.192037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.339011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.342220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.376340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b0fe431c-83f3-41c0-95a6-1d7aedae59d3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/ips" status: 200 len: 146 microversion: 2.1 time: 0.252442 Mar 29 02:33:03.381519 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2420/4632] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:33:03 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/ips => generated 146 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:03.492082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:03.628551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b960a95-e38c-4904-a4f2-41fe0d06c0cb tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 61 microversion: 2.26 time: 0.479847 Mar 29 02:33:03.630770 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2213/4633] 10.222.0.36 () {62 vars in 1311 bytes} [Tue Mar 29 02:33:03 2022] PUT /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 61 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:03.640646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b5f7848-8956-4e1e-bf32-618ce1e4085c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8724bf9d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:03.658373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b5f7848-8956-4e1e-bf32-618ce1e4085c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.660672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b5f7848-8956-4e1e-bf32-618ce1e4085c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.695375 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b5f7848-8956-4e1e-bf32-618ce1e4085c tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 200 len: 61 microversion: 2.26 time: 0.059792 Mar 29 02:33:03.706272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '.version_select at 0x7f8724059af0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:03.711669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2421/4634] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Mar 29 02:33:03 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 61 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:03.725949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.728123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.728791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:03.751758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.755217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.758023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.758667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:03.919220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:03.924736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.029619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lazy-loading 'flavor' on Instance uuid 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:04.126712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:04.127877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:04.146793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.147251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.148042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.148476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.180319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ad9c6de-e3e8-4834-9f9a-906329153e7a tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags" status: 204 len: 0 microversion: 2.26 time: 0.477889 Mar 29 02:33:04.181950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2214/4635] 10.222.0.36 () {60 vars in 1294 bytes} [Tue Mar 29 02:33:03 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5/tags => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:04.191627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:04.193270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:04.203134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.203716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.204747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.205444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.282436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:33:04.403277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:04.417669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-92dea9d3-65a4-4687-be55-a241a9fa325a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1273 microversion: 2.1 time: 0.289689 Mar 29 02:33:04.420816 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2422/4636] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:04 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:04.739426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f23ab215-9f95-4051-aab5-75ea766c5d22 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 204 len: 0 microversion: 2.26 time: 0.551119 Mar 29 02:33:04.749728 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2215/4637] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:33:04 2022] DELETE /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:33:04.749915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:04.749915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:04.765697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.766155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:04.766947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:04.767374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:05.445147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:05.445960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:05.462569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:05.463533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:05.465272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:05.465928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:06.016625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:06.031923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:06.033742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:06.035106 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b944c3ac-5abb-4d56-bb4b-4c123845508e tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1550 microversion: 2.26 time: 1.290172 Mar 29 02:33:06.036167 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2423/4638] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:33:04 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1550 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:33:06.067813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:06.079517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dd0c60f-23c7-47be-9756-f52098cb4cf4 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1273 microversion: 2.1 time: 0.638868 Mar 29 02:33:06.096550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2216/4639] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:05 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1273 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:06.819692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8134a7a3-f526-4994-b55d-3d0c64e982a2"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:06.821099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:06.829653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:06.834780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:06.834780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:06.834780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:07.063601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:07.064675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:07.101229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:07.102391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:07.103975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:07.104483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:08.112134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e520703b-6ad1-4c4d-b221-f05fdd914f1d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296157 Mar 29 02:33:08.112695 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2424/4640] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:33:06 2022] POST /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 194 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:08.130448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:08.132990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:08.136604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:08.143132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:08.150642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:08.152700 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b534ff5c-03bf-4c7c-911c-a9fe22872b10 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1550 microversion: 2.26 time: 1.099998 Mar 29 02:33:08.153516 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2217/4641] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:33:07 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1550 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:33:08.158258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:08.158734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:08.159511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:08.159940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:09.161849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:09.171972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:09.172350 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75e0fac3-76bd-45f7-be9c-ff941332eb78 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 1.058074 Mar 29 02:33:09.172625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:09.184757 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2425/4642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:08 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:09.188451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:09.199564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:09.202670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:09.203130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:10.106785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d000d683-8dac-4b3f-b2e3-f195b5be944a req-b3553fa9-bb78-49dc-8854-5702afd513fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8399626a-dfb5-4393-a6b7-8cc5ef175ea5", "name": "network-vif-deleted", "tag": "14cd6804-aae7-4d8b-8663-d162f3dea834"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:10.108370 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:10.108370 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:33:10.138967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d000d683-8dac-4b3f-b2e3-f195b5be944a req-b3553fa9-bb78-49dc-8854-5702afd513fc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:10.139407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d000d683-8dac-4b3f-b2e3-f195b5be944a req-b3553fa9-bb78-49dc-8854-5702afd513fc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:10.176125 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d000d683-8dac-4b3f-b2e3-f195b5be944a req-b3553fa9-bb78-49dc-8854-5702afd513fc service nova] Creating event network-vif-deleted:14cd6804-aae7-4d8b-8663-d162f3dea834 for instance 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 on n-h1-828148-1 Mar 29 02:33:10.187848 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d000d683-8dac-4b3f-b2e3-f195b5be944a req-b3553fa9-bb78-49dc-8854-5702afd513fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083719 Mar 29 02:33:10.187848 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2426/4643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:10.206986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:10.208949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:10.217695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:10.218252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:10.219135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:10.219581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:10.796482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:10.805886 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d3d86a5-c581-4b55-a630-2d7929ea68a0 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 0.616575 Mar 29 02:33:10.806469 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2427/4644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:10 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:11.464685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:11.483856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:11.491376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a36cd20ad6ac472f90c7b2be0ad56588', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9c926c28e3415aaefb615c2deb3e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:11.504690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-353c7255-afda-4c90-8072-f6fda69747b2 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 200 len: 1550 microversion: 2.26 time: 2.324327 Mar 29 02:33:11.504690 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2218/4645] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:33:09 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 1550 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:33:11.822580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:11.823783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:11.834885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:11.835924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:11.837026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:11.837763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:12.515845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:12.518049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] [instance: 8399626a-dfb5-4393-a6b7-8cc5ef175ea5] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:12.522300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:12.530692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebca5e0b-c9ac-4ab3-9d3c-fa26a790f154 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 0.711736 Mar 29 02:33:12.533052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:12.533599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:12.534441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:12.536182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:12.543465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2428/4646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:11 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:12.646327 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] HTTP exception thrown: Instance 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 could not be found. Mar 29 02:33:12.647054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] Returning 404 to user: Instance 8399626a-dfb5-4393-a6b7-8cc5ef175ea5 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:12.648026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf3c757b-9122-4816-ba3b-486b6aab55d7 tempest-ServerTagsTestJSON-930646472 tempest-ServerTagsTestJSON-930646472-project] 10.222.0.36 "GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5" status: 404 len: 111 microversion: 2.26 time: 0.140523 Mar 29 02:33:12.654807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2219/4647] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:33:12 2022] GET /compute/v2.1/servers/8399626a-dfb5-4393-a6b7-8cc5ef175ea5 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:33:13.548111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:13.554892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:13.604667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:13.605283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:13.606303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:13.606303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:14.322446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:14.337151 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55783dd1-0388-407b-a930-e2f7ae581f22 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 0.790459 Mar 29 02:33:14.342326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fd1477e7-4fb6-4df5-8b23-ebcdbcfe9d78 req-bc160ed2-ae15-4f56-b15c-bd52bb551587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a76af81-137c-4329-ac63-0442c185bc99", "tag": "869ca73b-38f9-4978-84ca-a30e020f399b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:14.344023 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:14.344023 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:33:14.345156 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2429/4648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:13 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:14.356147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd1477e7-4fb6-4df5-8b23-ebcdbcfe9d78 req-bc160ed2-ae15-4f56-b15c-bd52bb551587 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:14.356601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fd1477e7-4fb6-4df5-8b23-ebcdbcfe9d78 req-bc160ed2-ae15-4f56-b15c-bd52bb551587 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:14.383210 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fd1477e7-4fb6-4df5-8b23-ebcdbcfe9d78 req-bc160ed2-ae15-4f56-b15c-bd52bb551587 service nova] Creating event network-changed:869ca73b-38f9-4978-84ca-a30e020f399b for instance 5a76af81-137c-4329-ac63-0442c185bc99 on n-h1-828148-1 Mar 29 02:33:14.390167 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fd1477e7-4fb6-4df5-8b23-ebcdbcfe9d78 req-bc160ed2-ae15-4f56-b15c-bd52bb551587 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051803 Mar 29 02:33:14.395714 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2220/4649] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:15.354691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:15.356411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:15.371897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:15.372595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:15.377400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:15.378009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:16.344341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:16.352673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99cc52bd-b4a0-4280-a09b-ec76d64d09ad tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 1.002162 Mar 29 02:33:16.353283 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2430/4650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:15 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:17.371742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:17.372435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:17.395740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.399567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:17.399567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.399567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:17.720620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:17.721578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:17.734345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.734749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:17.735524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.735954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:17.922752 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b017570-5f9c-4302-a589-4b0abcb6ea38 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204931 Mar 29 02:33:17.924274 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2431/4651] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:33:17 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:17.936123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:17.937190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:17.956962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.957640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:17.960855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:17.961493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:18.094730 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d9f7c6d2-2ec7-47b2-81ea-b632cb1dd2d2 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2" status: 200 len: 194 microversion: 2.1 time: 0.163754 Mar 29 02:33:18.096426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2432/4652] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Mar 29 02:33:17 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2 => generated 194 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:33:19.061905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:19.075604 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 1.708054 Mar 29 02:33:19.076602 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2221/4653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:17 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:20.104813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:20.106291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:20.129429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:20.129886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:20.130675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:20.140621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:20.559675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:20.560731 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a424075-4ebe-4958-a6ff-8f18fdd2f43a tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001391 Mar 29 02:33:20.561175 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2222/4654] 10.222.0.36 () {56 vars in 885 bytes} [Tue Mar 29 02:33:20 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Mar 29 02:33:21.530793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb1ae3c-2420-4dcf-9afc-0632e63be51d"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:21.532823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:21.556690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:21.560044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:21.562514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:21.569432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:22.241323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:22.259125 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32d2bbcc-f942-4131-bd50-6be0497ef3e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 2.164124 Mar 29 02:33:22.260551 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2433/4655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:20 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:22.893241 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-610d1ba9-d5b2-4be2-8428-1d9622ccb705 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "POST /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.365489 Mar 29 02:33:22.894261 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2223/4656] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:33:21 2022] POST /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 194 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:33:23.278913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:23.279528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:23.296060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:23.303078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:23.304086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:23.304532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:24.655483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:24.669014 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3fbf70f-ba91-47ca-a36d-3962e4b3f9dd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 1.391069 Mar 29 02:33:24.669014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2434/4657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:23 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:25.685441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:25.686206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:25.701795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:25.702443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:25.703529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:25.704130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:26.954345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:26.967846 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c87d46dd-1880-4fa2-ac61-16e558ef8733 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 1.281093 Mar 29 02:33:26.982082 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2224/4658] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:25 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:27.052125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-15201b16-eb6a-432c-a81a-12de3148a050 req-9c34a7c6-678d-44ad-9e42-e9ffa535bedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a76af81-137c-4329-ac63-0442c185bc99", "name": "network-vif-plugged", "status": "completed", "tag": "869ca73b-38f9-4978-84ca-a30e020f399b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:27.054678 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:27.054678 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:33:27.070471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-15201b16-eb6a-432c-a81a-12de3148a050 req-9c34a7c6-678d-44ad-9e42-e9ffa535bedf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:27.071090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-15201b16-eb6a-432c-a81a-12de3148a050 req-9c34a7c6-678d-44ad-9e42-e9ffa535bedf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:27.099303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-15201b16-eb6a-432c-a81a-12de3148a050 req-9c34a7c6-678d-44ad-9e42-e9ffa535bedf service nova] Creating event network-vif-plugged:869ca73b-38f9-4978-84ca-a30e020f399b for instance 5a76af81-137c-4329-ac63-0442c185bc99 on n-h1-828148-1 Mar 29 02:33:27.106820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-15201b16-eb6a-432c-a81a-12de3148a050 req-9c34a7c6-678d-44ad-9e42-e9ffa535bedf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063614 Mar 29 02:33:27.108326 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2435/4659] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:28.015385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:28.017697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:28.044667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:28.049550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:28.053035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:28.053491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:28.616181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:28.628301 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a437567-1545-41f1-8a8d-4e520d69bb5c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1315 microversion: 2.1 time: 0.632569 Mar 29 02:33:28.628301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2225/4660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:27 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:29.646157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:29.646633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:29.664990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:29.665452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:29.666287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:29.672769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:32.666296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:32.675708 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8b46de4c-c584-4101-b69b-c8d043a0d015 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1501 microversion: 2.1 time: 3.033846 Mar 29 02:33:32.684699 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2436/4661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:29 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1501 bytes in 3044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:32.692488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:32.693055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:32.707871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:32.708322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:32.709146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:32.709582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:32.826741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'flavor' on Instance uuid 5a76af81-137c-4329-ac63-0442c185bc99 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:33.396161 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a5e4d68-c1fe-420a-84ca-83656c1017cd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "POST /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99/action" status: 202 len: 0 microversion: 2.1 time: 0.707630 Mar 29 02:33:33.399722 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2226/4662] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:33:32 2022] POST /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:33:33.416082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:33.416711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:33.456129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:33.456596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:33.457411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:33.457851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:33.776463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:33.778645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:33.794935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:33.798356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:33.799192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:33.801421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:33.887839 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ab45159-791a-4622-bcc8-a15b040d0aa5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.116987 Mar 29 02:33:33.890098 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2227/4663] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:33:33 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:34.050694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:34.051187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:34.078400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:34.078400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:34.078400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:34.078400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:34.184795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e23d7b46-b809-4840-bb2c-e3f3e612ae89 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2" status: 200 len: 194 microversion: 2.1 time: 0.138216 Mar 29 02:33:34.209240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2228/4664] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Mar 29 02:33:34 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:33:34.223312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:34.229636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:34.249226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:34.249972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:34.250953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:34.252722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:34.533724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lazy-loading 'services' on Instance uuid e4972aee-17f3-43bd-949c-9800a94626c0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:34.813265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:34.823294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df1bd078-da5f-4e20-9174-58f25f2db846 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1509 microversion: 2.1 time: 1.421554 Mar 29 02:33:34.830711 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2437/4665] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:33 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1509 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:34.964333 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-11be9d7a-7987-4eca-aa96-2b2c0659ad18 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2" status: 202 len: 0 microversion: 2.1 time: 0.747582 Mar 29 02:33:34.965999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2229/4666] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:33:34 2022] DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/8134a7a3-f526-4994-b55d-3d0c64e982a2 => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:33:35.847331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:35.847856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:35.870877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:35.871331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:35.872193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:35.872970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:37.419569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:37.436283 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d733e155-2adc-44a1-90f5-1733ce8d623b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1492 microversion: 2.1 time: 1.592457 Mar 29 02:33:37.437165 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2438/4667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:35 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1492 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:37.456270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:37.456932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:37.466086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:37.466537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:37.467382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:37.467825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:37.580935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:33:37.918589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:37.919095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:37.933905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:37.934582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:37.938906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:37.939534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:38.119226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ffba5e6-886d-4242-ad7d-905c5e8f3b7d tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/0eb1ae3c-2420-4dcf-9afc-0632e63be51d" status: 200 len: 194 microversion: 2.1 time: 0.188470 Mar 29 02:33:38.119226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2439/4668] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Mar 29 02:33:37 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/0eb1ae3c-2420-4dcf-9afc-0632e63be51d => generated 194 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:38.128129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:38.128728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:38.148498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:38.148977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:38.151331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:38.153372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:38.384904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lazy-loading 'services' on Instance uuid e4972aee-17f3-43bd-949c-9800a94626c0 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:38.507082 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7d2ffd3-e673-4541-8fef-28dfbb723e5f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 204 len: 0 microversion: 2.1 time: 1.054332 Mar 29 02:33:38.513058 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2230/4669] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:37 2022] DELETE /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:33:38.516691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:38.517183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:38.546389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:38.547033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:38.547638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:38.547980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:38.895562 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78faf679-737a-4547-adbd-4a5d3c98a347 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/0eb1ae3c-2420-4dcf-9afc-0632e63be51d" status: 202 len: 0 microversion: 2.1 time: 0.771235 Mar 29 02:33:38.896718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2440/4670] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:33:38 2022] DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments/0eb1ae3c-2420-4dcf-9afc-0632e63be51d => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:33:39.431581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:39.445888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee759bff-8f22-4c48-8196-bc75987d740c tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1498 microversion: 2.1 time: 0.933037 Mar 29 02:33:39.455524 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2231/4671] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:38 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1498 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:40.465601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:40.475676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:40.485855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:40.491907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:40.493643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:40.494960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:41.144491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:41.166265 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75e73dd0-6416-4b83-8490-d1dc39554261 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1498 microversion: 2.1 time: 0.706795 Mar 29 02:33:41.167895 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2441/4672] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:40 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1498 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:41.531520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:41.533903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:41.549468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:41.550043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:41.557150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:41.557150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:41.668999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f55daf98-af06-472a-add9-6f2815c27850 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.142629 Mar 29 02:33:41.670249 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2232/4673] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:33:41 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:33:42.031298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:42.032241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:42.044386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.044848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.045640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.046071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.183695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:42.187550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:42.211716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.215748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.217727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.219523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.293853 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56b8f60a-b96f-409b-a6f3-ca1e757673a7 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.266274 Mar 29 02:33:42.302328 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2442/4674] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 02:33:42 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0/os-volume_attachments => generated 25 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:33:42.439974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:42.440783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:42.454984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.455780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.456772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:42.457417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:42.544311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:33:42.999779 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebf0c4a5-4180-497f-a1e8-c183881fd3b8 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 204 len: 0 microversion: 2.1 time: 0.563208 Mar 29 02:33:43.000465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2443/4675] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:42 2022] DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:33:43.010418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:43.011437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:43.026563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:43.027389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:43.030475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:43.031139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:43.880083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:43.899308 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef0a4143-ba65-4977-8dd5-dcdcc51e0055 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1672 microversion: 2.1 time: 0.894241 Mar 29 02:33:43.899956 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2444/4676] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:43 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1672 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:44.358243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2aec6d48-c3cd-46bc-9c2f-1c500ccd3b58 req-c4a4038d-42bc-426a-bf91-9ffd9b7bfc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a76af81-137c-4329-ac63-0442c185bc99", "name": "network-vif-unplugged", "status": "completed", "tag": "869ca73b-38f9-4978-84ca-a30e020f399b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:44.360200 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:44.360200 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:33:44.387333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2aec6d48-c3cd-46bc-9c2f-1c500ccd3b58 req-c4a4038d-42bc-426a-bf91-9ffd9b7bfc25 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:44.388176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2aec6d48-c3cd-46bc-9c2f-1c500ccd3b58 req-c4a4038d-42bc-426a-bf91-9ffd9b7bfc25 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:44.489381 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2aec6d48-c3cd-46bc-9c2f-1c500ccd3b58 req-c4a4038d-42bc-426a-bf91-9ffd9b7bfc25 service nova] Creating event network-vif-unplugged:869ca73b-38f9-4978-84ca-a30e020f399b for instance 5a76af81-137c-4329-ac63-0442c185bc99 on n-h1-828148-1 Mar 29 02:33:44.496261 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2aec6d48-c3cd-46bc-9c2f-1c500ccd3b58 req-c4a4038d-42bc-426a-bf91-9ffd9b7bfc25 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142711 Mar 29 02:33:44.515262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2445/4677] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:44.850364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:44.860583 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c7fd8ee-301a-4ff0-807a-8897e2462495 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1498 microversion: 2.1 time: 2.681116 Mar 29 02:33:44.874711 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2233/4678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:42 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1498 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:44.918534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:44.919941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:44.936026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:44.937526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:44.939482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:44.941032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:45.888992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:45.889604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:45.898890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:45.899425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:45.900407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:45.901103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:46.195385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:46.205130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eceac169-fc20-4455-9ad3-ded19a569443 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1672 microversion: 2.1 time: 1.291970 Mar 29 02:33:46.223713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2446/4679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:44 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1672 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:47.231257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:47.231995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:47.240932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:47.241746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:47.242696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:47.247527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:47.925694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:47.935464 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d5522a9-9884-435f-9e21-3f45dae235e3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1498 microversion: 2.1 time: 2.055351 Mar 29 02:33:47.936057 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2234/4680] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:45 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1498 bytes in 2057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:48.637886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:48.648321 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-816b92fe-592e-4234-8e8a-e66816b4c740 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1672 microversion: 2.1 time: 1.420635 Mar 29 02:33:48.661211 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2447/4681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:47 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1672 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:48.792588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: .version_select at 0x7f8717d57310>, body: {"keypair": {"name": "tempest-keypair-896805179"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:48.841138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:33:48.862114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:33:48.955957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:48.958065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:48.979851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:48.979851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:48.979851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:48.979851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:49.591712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:33:49.606772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:33:49.654495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6db5ac9b-8875-42cd-97ce-19cb8fa80646 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.223582 Mar 29 02:33:49.658128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2235/4682] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:33:48 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1228 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 29 02:33:49.669410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-69fa3b2e-69bc-4c79-b7fe-a610e9717096 req-fa9c811c-80c9-42c4-a894-fe7ea9842621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4972aee-17f3-43bd-949c-9800a94626c0", "name": "network-vif-deleted", "tag": "e94fbebb-091c-48bb-80dd-7e0c94bc3c7a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:49.675188 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:49.675188 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:33:49.693656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69fa3b2e-69bc-4c79-b7fe-a610e9717096 req-fa9c811c-80c9-42c4-a894-fe7ea9842621 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:49.698034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69fa3b2e-69bc-4c79-b7fe-a610e9717096 req-fa9c811c-80c9-42c4-a894-fe7ea9842621 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:49.704364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:49.715111 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4614ee4e-6fd0-423f-a0ef-46cdffb51372 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1498 microversion: 2.1 time: 0.763721 Mar 29 02:33:49.718083 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2448/4683] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:48 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1498 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:49.733849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:49.736977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:49.752827 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-69fa3b2e-69bc-4c79-b7fe-a610e9717096 req-fa9c811c-80c9-42c4-a894-fe7ea9842621 service nova] Creating event network-vif-deleted:e94fbebb-091c-48bb-80dd-7e0c94bc3c7a for instance e4972aee-17f3-43bd-949c-9800a94626c0 on n-h2-828148-1 Mar 29 02:33:49.762802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:49.763270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:49.766096 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-69fa3b2e-69bc-4c79-b7fe-a610e9717096 req-fa9c811c-80c9-42c4-a894-fe7ea9842621 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102787 Mar 29 02:33:49.767175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:49.767799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:49.768291 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2236/4684] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:33:50.229408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4a1d4410e584b6d8816da49c5e5b9c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b19e3005af647ca9c3a40ee180c6ae2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:50.239519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78bb63ae-c82c-4736-aff7-f295ee437cc3 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 200 len: 1321 microversion: 2.1 time: 0.520299 Mar 29 02:33:50.259074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2449/4685] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:49 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:50.283423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f771fa00-c36d-4546-b0f5-f6b873b57c42 req-f61c69ba-8e53-47e7-9344-04a01a4bda15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a76af81-137c-4329-ac63-0442c185bc99", "name": "network-vif-deleted", "tag": "869ca73b-38f9-4978-84ca-a30e020f399b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:50.285104 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:33:50.285104 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:33:50.302649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f771fa00-c36d-4546-b0f5-f6b873b57c42 req-f61c69ba-8e53-47e7-9344-04a01a4bda15 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:50.309812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f771fa00-c36d-4546-b0f5-f6b873b57c42 req-f61c69ba-8e53-47e7-9344-04a01a4bda15 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:50.349118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f771fa00-c36d-4546-b0f5-f6b873b57c42 req-f61c69ba-8e53-47e7-9344-04a01a4bda15 service nova] Creating event network-vif-deleted:869ca73b-38f9-4978-84ca-a30e020f399b for instance 5a76af81-137c-4329-ac63-0442c185bc99 on n-h1-828148-1 Mar 29 02:33:50.359704 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f771fa00-c36d-4546-b0f5-f6b873b57c42 req-f61c69ba-8e53-47e7-9344-04a01a4bda15 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270241 Mar 29 02:33:50.360311 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2237/4686] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:33:50.735632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:50.738428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:50.779173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:50.787151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:50.805749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:50.805749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:51.042729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:51.043458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:51.047235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lazy-loading 'fault' on Instance uuid 5a76af81-137c-4329-ac63-0442c185bc99 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:33:51.278809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:51.279825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:51.325501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:51.326126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:51.327028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:51.327578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:51.464656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. Mar 29 02:33:51.473255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:51.474255 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c74a149-71b4-4603-80f0-ddb801f48c8b tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 404 len: 111 microversion: 2.1 time: 0.202496 Mar 29 02:33:51.474964 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2238/4687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:51 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:33:51.486804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38b0e2c7-474f-416b-8749-3ead8ca4b567 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '.version_select at 0x7f87242e9040>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:51.521457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042da487d12a4035a8ee45b15a1d88b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98f955dfc30e4e1597fad2589467b808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:51.536020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d960f78a-d58f-4e9e-8650-f49c481deddb tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 200 len: 1305 microversion: 2.1 time: 0.805085 Mar 29 02:33:51.536612 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2450/4688] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:50 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 1305 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:51.631945 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38b0e2c7-474f-416b-8749-3ead8ca4b567 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113506207" status: 202 len: 0 microversion: 2.1 time: 0.150320 Mar 29 02:33:51.636617 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2239/4689] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 02:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113506207 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:33:52.554013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:52.556676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:52.577937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.578382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:52.579164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.579596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:52.726087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. Mar 29 02:33:52.726699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:52.727536 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9448bc08-68d0-44b2-ad4f-9eaa30b41e53 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 404 len: 111 microversion: 2.1 time: 0.177225 Mar 29 02:33:52.734172 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2451/4690] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:52 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:52.743992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:52.744524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:52.761370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.761838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:52.763319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.763319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:52.901913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. Mar 29 02:33:52.902548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:52.903395 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72d20ac2-ed3c-4935-9ae1-e0cbbceb9f74 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 404 len: 111 microversion: 2.1 time: 0.163126 Mar 29 02:33:52.912137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:52.913110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5a76af81-137c-4329-ac63-0442c185bc99] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:52.913997 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2240/4691] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:52 2022] DELETE /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:52.924540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.932300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:52.935525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:52.935525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.216122 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. Mar 29 02:33:53.217043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5a76af81-137c-4329-ac63-0442c185bc99 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.218101 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2a10bc8-d690-4c7e-ab1a-c975e92df4bd tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99" status: 404 len: 111 microversion: 2.1 time: 0.309915 Mar 29 02:33:53.219873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2452/4692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:52 2022] GET /compute/v2.1/servers/5a76af81-137c-4329-ac63-0442c185bc99 => generated 111 bytes in 312 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:33:53.228202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.229151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.236999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.237665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.271854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.271854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.391706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. Mar 29 02:33:53.391706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.391706 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-733cae73-d876-42b1-a275-56cda34876fa tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 404 len: 111 microversion: 2.1 time: 0.163511 Mar 29 02:33:53.396680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.397375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: e8272421-c9fe-4d54-a6fe-be178057cd7a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.401241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2241/4693] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:53 2022] DELETE /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:53.407810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.408255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.412615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.414255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.514522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. Mar 29 02:33:53.515121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance e8272421-c9fe-4d54-a6fe-be178057cd7a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.515941 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-233634be-f255-451e-8cbc-cd8566105bc1 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a" status: 404 len: 111 microversion: 2.1 time: 0.123217 Mar 29 02:33:53.516644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2453/4694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:53 2022] GET /compute/v2.1/servers/e8272421-c9fe-4d54-a6fe-be178057cd7a => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:53.524758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.525279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.533171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.533929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.535011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.535681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.590121 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. Mar 29 02:33:53.590971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.592020 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7989130-2e12-42ea-8e6b-d9067a4b21b3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 404 len: 111 microversion: 2.1 time: 0.071015 Mar 29 02:33:53.593147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2242/4695] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:53 2022] DELETE /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:53.601378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.601989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: c4292c40-7ea1-4c3b-ac83-95a24b56d358] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.628258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.629337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.630346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.631955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.798641 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. Mar 29 02:33:53.802027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance c4292c40-7ea1-4c3b-ac83-95a24b56d358 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.802978 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-36186f1b-a5f9-4f13-8876-828ee37d7f20 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358" status: 404 len: 111 microversion: 2.1 time: 0.205827 Mar 29 02:33:53.807062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2454/4696] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:53 2022] GET /compute/v2.1/servers/c4292c40-7ea1-4c3b-ac83-95a24b56d358 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:53.814755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.823456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.824390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.824884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.837890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.838851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.942593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. Mar 29 02:33:53.943204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:53.944038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29d72fbf-4736-4b4a-b47c-dff66009f125 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 404 len: 111 microversion: 2.1 time: 0.133012 Mar 29 02:33:53.944610 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2243/4697] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:53 2022] DELETE /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:53.955496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:53.956275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 5011319a-67dc-42f5-ba72-584c3a97cfe6] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:53.971652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.974848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:53.975765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:53.976314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:54.084605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. Mar 29 02:33:54.090256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 5011319a-67dc-42f5-ba72-584c3a97cfe6 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:54.090256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a0dac265-8f3a-4281-a347-8150067cf7e7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6" status: 404 len: 111 microversion: 2.1 time: 0.135085 Mar 29 02:33:54.092133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2455/4698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:53 2022] GET /compute/v2.1/servers/5011319a-67dc-42f5-ba72-584c3a97cfe6 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:54.104904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1ff4839-7079-4a04-95dc-64e7f6a3fd9b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:54.105408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1ff4839-7079-4a04-95dc-64e7f6a3fd9b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:54.113208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-f1ff4839-7079-4a04-95dc-64e7f6a3fd9b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. Mar 29 02:33:54.113952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1ff4839-7079-4a04-95dc-64e7f6a3fd9b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:54.114789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1ff4839-7079-4a04-95dc-64e7f6a3fd9b tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1" status: 404 len: 111 microversion: 2.1 time: 0.013682 Mar 29 02:33:54.116947 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2244/4699] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:54 2022] DELETE /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:54.124304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed358660-0b56-4a1a-a520-1f79524bcd1f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:54.125280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed358660-0b56-4a1a-a520-1f79524bcd1f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 774ce156-0f31-4ac6-98a3-853080cf3ee1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:54.132890 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ed358660-0b56-4a1a-a520-1f79524bcd1f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. Mar 29 02:33:54.137818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed358660-0b56-4a1a-a520-1f79524bcd1f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 774ce156-0f31-4ac6-98a3-853080cf3ee1 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:54.138797 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed358660-0b56-4a1a-a520-1f79524bcd1f tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1" status: 404 len: 111 microversion: 2.1 time: 0.018384 Mar 29 02:33:54.139365 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2456/4700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:54 2022] GET /compute/v2.1/servers/774ce156-0f31-4ac6-98a3-853080cf3ee1 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:54.903592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1555163469", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "36554e6a-2a50-4d62-afdb-29cf6905975f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:55.023510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] validate_networks() for [('36554e6a-2a50-4d62-afdb-29cf6905975f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:33:57.023477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:33:57.024583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:33:57.025534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:33:57.026245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:33:57.026875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:33:57.061714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:57.062527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:57.063679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:57.070704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:57.122552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:33:57.130063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for user 446cf893ae6343219c5293cfcee725eb and project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:33:57.143314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:33:57.146059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:33:57.287395 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94804465-f9e4-4b0b-b6b0-cbcc323207cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.492858 Mar 29 02:33:57.297629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2245/4701] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:33:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:33:57.298815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-88f157c6-648e-4141-a32e-806de1772a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:57.299686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-88f157c6-648e-4141-a32e-806de1772a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:57.519533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-88f157c6-648e-4141-a32e-806de1772a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:57.543776 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-88f157c6-648e-4141-a32e-806de1772a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1218 microversion: 2.1 time: 0.248603 Mar 29 02:33:57.548721 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2457/4702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:57 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:33:58.139298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:58.139892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:58.165696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.168065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.169013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.170152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.317465 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. Mar 29 02:33:58.327309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:58.328318 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e01105ec-a84d-4026-8177-0bb18c8a4ff3 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 404 len: 111 microversion: 2.1 time: 0.192731 Mar 29 02:33:58.332173 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2246/4703] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:58 2022] DELETE /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:58.341060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:58.342589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: 93826ed0-0fd6-4652-8603-ba461565cad0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:58.357403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.360147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.361280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.362050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.473091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. Mar 29 02:33:58.478589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance 93826ed0-0fd6-4652-8603-ba461565cad0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:58.478589 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4067fa0a-5a20-4694-a3ff-c0cdb7d7b0a8 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0" status: 404 len: 111 microversion: 2.1 time: 0.137971 Mar 29 02:33:58.478589 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2458/4704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:58 2022] GET /compute/v2.1/servers/93826ed0-0fd6-4652-8603-ba461565cad0 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:58.484909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:58.485543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:58.496610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.499284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.500230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.501147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.562011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b9dbbdc-b8e2-4d1e-b308-fd5781d4c184 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:58.562635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b9dbbdc-b8e2-4d1e-b308-fd5781d4c184 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:58.634386 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. Mar 29 02:33:58.635029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:58.644823 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-460a0a50-7558-4aa0-9a8d-fab22cd984b7 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 404 len: 111 microversion: 2.1 time: 0.164619 Mar 29 02:33:58.649982 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2247/4705] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:33:58 2022] DELETE /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:58.654620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:58.655230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] [instance: dd459e0a-897b-4859-aea5-ae71fcfd4904] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:33:58.681766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.682743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.683524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:33:58.683953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:33:58.862890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] HTTP exception thrown: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. Mar 29 02:33:58.863542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] Returning 404 to user: Instance dd459e0a-897b-4859-aea5-ae71fcfd4904 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:33:58.864544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7382745-f423-4c14-932e-eb0877f84168 tempest-DeleteServersTestJSON-1833484917 tempest-DeleteServersTestJSON-1833484917-project] 10.222.0.36 "GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904" status: 404 len: 111 microversion: 2.1 time: 0.213552 Mar 29 02:33:58.866667 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2248/4706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:58 2022] GET /compute/v2.1/servers/dd459e0a-897b-4859-aea5-ae71fcfd4904 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:33:58.961283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b9dbbdc-b8e2-4d1e-b308-fd5781d4c184 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:33:58.975506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b9dbbdc-b8e2-4d1e-b308-fd5781d4c184 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1218 microversion: 2.1 time: 0.418518 Mar 29 02:33:58.979571 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2459/4707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:58 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1218 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:33:59.622244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-80901885", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb65f99d-8de1-4775-8513-7351ce939995"}], "security_groups": [{"name": "tempest-securitygroup--126290378"}], "key_name": "tempest-keypair-896805179", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:33:59.995080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:33:59.995697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:00.013912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:00.014355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:00.015148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:00.015754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:00.115798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] validate_networks() for [('bb65f99d-8de1-4775-8513-7351ce939995', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:34:00.260449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:00.279206 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bf235a6-05e0-41c1-99de-f663c7dc8161 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1270 microversion: 2.1 time: 0.286350 Mar 29 02:34:00.295489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2460/4708] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:33:59 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:01.296008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:01.296632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:01.306124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:01.306554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:01.307537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:01.307979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:01.491684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:01.513497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d97a244-d148-4765-983b-954d34608bf9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1276 microversion: 2.1 time: 0.210095 Mar 29 02:34:01.516621 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2461/4709] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:01 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:02.533963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:02.534863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:02.558607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:02.561895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:02.562848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:02.563475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:03.007791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:03.019912 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f72b67c6-69a1-44a7-a5ed-8d10c56001a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1276 microversion: 2.1 time: 0.490414 Mar 29 02:34:03.020748 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2462/4710] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:02 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1276 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:04.038217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:04.039684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:04.054949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:04.056778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:04.058668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:04.059283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:04.226333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:04.240294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb568767-2330-445f-bed9-6f7c985d93b1 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1276 microversion: 2.1 time: 0.206283 Mar 29 02:34:04.243032 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2463/4711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:04 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:05.070735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:34:05.072362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:34:05.072362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:34:05.072362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:34:05.072654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:34:05.081701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:05.082124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:05.089426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:05.090230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:05.115320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:34:05.121542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:34:05.137653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:34:05.139942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:34:05.258914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:05.261719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:05.277565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:05.278871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:05.280900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:05.287015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:05.296077 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56d46da5-439b-4a30-8a57-bb42e1b709d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.685310 Mar 29 02:34:05.296746 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2249/4712] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:33:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 5687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:34:05.308180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:05.308794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:05.713150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:05.715644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:05.735277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af812c14-c823-4aee-b948-1c591aefb690 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.480228 Mar 29 02:34:05.735878 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2464/4713] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:05 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:05.780920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:05.783166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:05.784224 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-46f1e042-4c28-4a0a-8a3d-53aeb89a4380 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1279 microversion: 2.20 time: 0.481251 Mar 29 02:34:05.784778 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2250/4714] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:05 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1279 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:34:06.720566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:06.721775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:06.735468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.736693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:06.739216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.739825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:06.751560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:06.752175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:06.772677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.773430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:06.781665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.782327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:06.837491 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. Mar 29 02:34:06.839597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:34:06.840439 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a672b8f2-1d7d-4b61-9a83-e3f3ca22ee09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 404 len: 111 microversion: 2.1 time: 0.123810 Mar 29 02:34:06.844030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2465/4715] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:34:06 2022] DELETE /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:34:06.866315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:06.869462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:06.896926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.900797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:06.900797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:06.903398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:07.405811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:07.418461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:07.419995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:07.421116 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42f538ec-ae0b-4843-9796-ca97d0879910 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1283 microversion: 2.20 time: 0.575875 Mar 29 02:34:07.422777 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2466/4716] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:06 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1283 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:07.436897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:07.439503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: e4972aee-17f3-43bd-949c-9800a94626c0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:07.465393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:07.466001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:07.466977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:07.467527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:07.607852 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. Mar 29 02:34:07.608770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance e4972aee-17f3-43bd-949c-9800a94626c0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:34:07.609790 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11e5d961-ca08-46c9-bbd2-638498e34c09 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0" status: 404 len: 111 microversion: 2.1 time: 0.186079 Mar 29 02:34:07.614148 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2467/4717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:07 2022] GET /compute/v2.1/servers/e4972aee-17f3-43bd-949c-9800a94626c0 => generated 111 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:34:08.141959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-637618081", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "0ae8024f-afb6-4c57-af2c-bfdfc8c9e500"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:08.313611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] validate_networks() for [('0ae8024f-afb6-4c57-af2c-bfdfc8c9e500', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:34:09.241173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:09.248317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03a5c06b-b94b-4273-99a1-15a6bd4af3e6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 2.500618 Mar 29 02:34:09.261206 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2251/4718] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:06 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:09.266112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:09.266726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:09.297727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:09.301956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:09.306401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:09.307164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:09.657713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:09.677929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:09.683031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:09.687899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7de2db5d-36f4-49fb-8271-2d0990a5b559 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1337 microversion: 2.20 time: 0.421825 Mar 29 02:34:09.691134 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2252/4719] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:09 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1337 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:09.845065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e9c7868b-f80e-42f0-9c1d-aa436f901c87 req-5aade0cf-6a3c-46b5-bb26-eaf7524e3fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7b17e49-731d-4ae0-a761-6878392921c3", "tag": "a4cef7fe-92f3-45b5-a118-47220656dddf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:09.846386 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:09.846386 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:34:09.869642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e9c7868b-f80e-42f0-9c1d-aa436f901c87 req-5aade0cf-6a3c-46b5-bb26-eaf7524e3fe7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:09.869642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e9c7868b-f80e-42f0-9c1d-aa436f901c87 req-5aade0cf-6a3c-46b5-bb26-eaf7524e3fe7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:09.924497 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e9c7868b-f80e-42f0-9c1d-aa436f901c87 req-5aade0cf-6a3c-46b5-bb26-eaf7524e3fe7 service nova] Creating event network-changed:a4cef7fe-92f3-45b5-a118-47220656dddf for instance f7b17e49-731d-4ae0-a761-6878392921c3 on n-h1-828148-1 Mar 29 02:34:09.931590 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e9c7868b-f80e-42f0-9c1d-aa436f901c87 req-5aade0cf-6a3c-46b5-bb26-eaf7524e3fe7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091206 Mar 29 02:34:09.933828 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2253/4720] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:10.265924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:10.266642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:10.289513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:10.289978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:10.290842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:10.291286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:10.932966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:10.942286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47a64e82-dc50-4e00-855e-56c0f25f3e07 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.681329 Mar 29 02:34:10.944092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2254/4721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:10 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:10.950350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:10.951307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:10.959447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:10.960288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:10.961350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:10.962269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.215535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:34:11.215535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:34:11.215535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:34:11.215535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:34:11.215535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:34:11.228176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.228818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.230539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.231490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.255630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Getting quotas for project f2a1f4e49a1c4b81a803dac4641618ab. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:34:11.262961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Getting quotas for user dd996e3af92e4f05bed53269df9a5571 and project f2a1f4e49a1c4b81a803dac4641618ab. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:34:11.267660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:11.280378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:11.282853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:11.284319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e13a246c-2a53-4733-b85b-5b76bdfea27a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1337 microversion: 2.20 time: 0.338923 Mar 29 02:34:11.285575 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2255/4722] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:10 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1337 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:11.292903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:34:11.295378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:34:11.436071 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 02:34:11.647647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:11.648518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:11.657251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.657893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.658874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.659456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.751798 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. Mar 29 02:34:11.752424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:34:11.753720 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-503b3610-143c-4b1d-8703-137806a43d16 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 404 len: 111 microversion: 2.1 time: 0.109568 Mar 29 02:34:11.757170 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2256/4723] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:34:11 2022] DELETE /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:34:11.767632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:11.768268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] [instance: b4bcada5-07ad-40f0-964c-d303c7d91936] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:11.789374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.789829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.790610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.791041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.842584 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] HTTP exception thrown: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. Mar 29 02:34:11.846263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] Returning 404 to user: Instance b4bcada5-07ad-40f0-964c-d303c7d91936 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:34:11.846263 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7071617b-cb31-4093-8a44-0c6201a248c5 tempest-AttachVolumeTestJSON-1493912396 tempest-AttachVolumeTestJSON-1493912396-project] 10.222.0.36 "GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936" status: 404 len: 111 microversion: 2.1 time: 0.081696 Mar 29 02:34:11.848084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2257/4724] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:11 2022] GET /compute/v2.1/servers/b4bcada5-07ad-40f0-964c-d303c7d91936 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:34:11.962093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:11.963147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:11.973747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.979730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:11.979730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:11.979730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:12.446004 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49264. Mar 29 02:34:12.451922 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9fa51bef-8cac-44f5-bf6e-202f723d2648 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.628709 Mar 29 02:34:12.462871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:12.463467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2468/4725] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:34:12.463551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd7a3cc6-78fa-474a-9bd7-56f7fde2d3e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.503170 Mar 29 02:34:12.465046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2258/4726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:11 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:12.466663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:12.470761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:12.473134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67f780ef-6ace-4b1d-a320-fa8b874f6aa7 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:12.478106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67f780ef-6ace-4b1d-a320-fa8b874f6aa7 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:12.505545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:12.509747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:12.513060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:12.513606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:12.615478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67f780ef-6ace-4b1d-a320-fa8b874f6aa7 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:12.624441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67f780ef-6ace-4b1d-a320-fa8b874f6aa7 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1216 microversion: 2.1 time: 0.158154 Mar 29 02:34:12.636891 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2259/4727] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:12 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:13.465050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:13.477328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:13.477919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:13.478726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:13.478890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:13.480422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d245c6d-6088-4bbc-93fd-251e0cfd653a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 1.025265 Mar 29 02:34:13.491073 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2469/4728] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:12 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:13.497824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:13.501387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:13.501387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:13.501387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:13.642306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34186aa4-7aa7-4c79-879b-f2599091eae6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:13.642915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-34186aa4-7aa7-4c79-879b-f2599091eae6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:13.778475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-34186aa4-7aa7-4c79-879b-f2599091eae6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:13.810399 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34186aa4-7aa7-4c79-879b-f2599091eae6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1216 microversion: 2.1 time: 0.172299 Mar 29 02:34:13.811729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2470/4729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:13 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:14.071462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:14.081128 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58da44ac-7d38-41e0-9f5c-130c285f0cfd tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.606391 Mar 29 02:34:14.081715 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2260/4730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:13 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:14.500152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:14.501418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:14.521729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:14.522186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:14.522983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:14.523418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:14.827326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:14.827935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:14.849832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:14.849832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:14.849832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:14.849832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:15.067138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:15.076656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efe1fb63-285f-4c30-8915-88ed830c5133 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1268 microversion: 2.1 time: 0.252912 Mar 29 02:34:15.081054 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2261/4731] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:14 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1268 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:15.102442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:15.102769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:15.125153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:15.126311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:15.127584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:15.128268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:15.751311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:15.766993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:15.770308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:15.771423 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd97ab3d-7cbe-4621-9cdb-8d72f6260b56 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 1.276790 Mar 29 02:34:15.774518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2471/4732] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:14 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:16.014525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:16.028496 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9877d5f6-45b2-4b8a-a4a7-eaf9f0f97407 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.933898 Mar 29 02:34:16.034735 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2262/4733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:15 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:16.097765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:16.098723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:16.107450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.108005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.109057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.109735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.338739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:16.350334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5057daa7-2a91-4847-8259-162de4d33e57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1274 microversion: 2.1 time: 0.256310 Mar 29 02:34:16.352264 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2472/4734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:16 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:16.660009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f3e8edb3-6f28-4281-a534-d1661034e91c req-8296a4a0-b198-4a3f-af64-0207154c579f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:16.664596 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:16.664596 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:34:16.701675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3e8edb3-6f28-4281-a534-d1661034e91c req-8296a4a0-b198-4a3f-af64-0207154c579f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.707458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f3e8edb3-6f28-4281-a534-d1661034e91c req-8296a4a0-b198-4a3f-af64-0207154c579f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.789170 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f3e8edb3-6f28-4281-a534-d1661034e91c req-8296a4a0-b198-4a3f-af64-0207154c579f service nova] Creating event network-changed:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:34:16.802638 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f3e8edb3-6f28-4281-a534-d1661034e91c req-8296a4a0-b198-4a3f-af64-0207154c579f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.417455 Mar 29 02:34:16.810713 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2263/4735] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:34:16.830781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:16.832927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:16.849143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.849859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.851240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.852267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.856017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b3304f3f-3aae-437f-99fa-e07b2463e2b5 req-914446ae-4de4-4b0e-ba70-bae43715737d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b17e49-731d-4ae0-a761-6878392921c3", "name": "network-vif-plugged", "status": "completed", "tag": "a4cef7fe-92f3-45b5-a118-47220656dddf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:16.857984 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:16.857984 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:34:16.866802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b3304f3f-3aae-437f-99fa-e07b2463e2b5 req-914446ae-4de4-4b0e-ba70-bae43715737d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:16.867236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b3304f3f-3aae-437f-99fa-e07b2463e2b5 req-914446ae-4de4-4b0e-ba70-bae43715737d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:16.893769 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b3304f3f-3aae-437f-99fa-e07b2463e2b5 req-914446ae-4de4-4b0e-ba70-bae43715737d service nova] Creating event network-vif-plugged:a4cef7fe-92f3-45b5-a118-47220656dddf for instance f7b17e49-731d-4ae0-a761-6878392921c3 on n-h1-828148-1 Mar 29 02:34:16.907738 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b3304f3f-3aae-437f-99fa-e07b2463e2b5 req-914446ae-4de4-4b0e-ba70-bae43715737d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200212 Mar 29 02:34:16.908912 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2473/4736] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:17.057179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:17.057179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:17.076818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:17.079780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:17.081767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:17.085438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:17.848879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:17.866284 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af99b032-c87a-4400-bd89-695ac13f20bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 0.820906 Mar 29 02:34:17.867649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2474/4737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:17 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:17.880652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:17.881649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:17.897941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:17.898660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:17.899733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:17.900416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:18.102398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:18.113793 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d5fcf8a-b991-4cb6-8358-3d617cd13010 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1274 microversion: 2.1 time: 0.244670 Mar 29 02:34:18.153226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2475/4738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:17 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1274 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:18.181166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:18.194181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:18.195803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:18.203322 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d015fd5-d7cc-474f-beb8-013f5e8c97bc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 1.391476 Mar 29 02:34:18.203920 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2264/4739] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:16 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:18.883378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:18.883911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:18.902768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:18.902768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:18.902982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:18.903273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:19.137664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:19.138655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:19.169329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:19.169974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:19.170938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:19.171438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:20.062648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:20.072713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f83d2f18-9c96-4a47-a7e2-50ddc7fdb3aa tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1318 microversion: 2.1 time: 1.192986 Mar 29 02:34:20.074101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2476/4740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:18 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1318 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:20.078926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:20.079710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:20.088337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:20.088950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:20.092914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:20.093476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:20.465230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:20.474719 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b5bdcdf-e4f1-4007-a206-ab8494447fd6 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 1.346629 Mar 29 02:34:20.484803 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2265/4741] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:19 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:20.773099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:20.786552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:20.788319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:20.789675 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12ab4578-f208-4b01-b54d-21096a47745c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 0.714366 Mar 29 02:34:20.790449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2477/4742] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:20 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:21.090728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:21.092403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:21.104474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:21.105805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:21.122073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:21.122073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:21.490573 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:34:21.497769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:21.498377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:21.509224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:21.510854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:21.512684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:21.513360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.037318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.047311 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-11c16209-fbd0-4b16-81c5-af17105e46ac tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1506 microversion: 2.1 time: 0.960483 Mar 29 02:34:22.048074 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2266/4743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:21 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1506 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:22.054210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:22.054814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:22.061577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.067146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.069292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.070491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.071131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.079352 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42aec427-f426-4233-af61-160cf0f4e4d2 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.589735 Mar 29 02:34:22.080093 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2478/4744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:21 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:22.102409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:22.105586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:22.121865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.123471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.124437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.124893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.500396 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 49810. Mar 29 02:34:22.616898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.623626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7a212f7-2b59-4f37-aa50-46052d1309cf tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1506 microversion: 2.1 time: 0.541352 Mar 29 02:34:22.637305 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2479/4745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:22 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:22.642989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "OS-DCF:diskConfig": "AUTO"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:22.644908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:22.655242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.657285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.658441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.659093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.758940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.769999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.777429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:22.778603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c294c52-48b4-485a-aa73-66fbff4464ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 0.728537 Mar 29 02:34:22.793327 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2267/4746] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:22 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:22.817016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:34:22.817357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:34:22.818059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:34:22.818793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:34:22.819357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:34:22.869779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-41eacfc6-74aa-4292-ba01-038556a5720b req-730b33b0-e0bc-48d5-b423-177e5e5b7950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2187c4f5-2095-4cf5-9d69-0a0f37834947", "tag": "362da240-a44a-4e31-afc6-bf08934c5c3d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:22.871407 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:22.871407 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:34:22.889746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-41eacfc6-74aa-4292-ba01-038556a5720b req-730b33b0-e0bc-48d5-b423-177e5e5b7950 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:22.892192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-41eacfc6-74aa-4292-ba01-038556a5720b req-730b33b0-e0bc-48d5-b423-177e5e5b7950 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:22.937012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-41eacfc6-74aa-4292-ba01-038556a5720b req-730b33b0-e0bc-48d5-b423-177e5e5b7950 service nova] Creating event network-changed:362da240-a44a-4e31-afc6-bf08934c5c3d for instance 2187c4f5-2095-4cf5-9d69-0a0f37834947 on n-h1-828148-1 Mar 29 02:34:22.954172 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-41eacfc6-74aa-4292-ba01-038556a5720b req-730b33b0-e0bc-48d5-b423-177e5e5b7950 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086635 Mar 29 02:34:22.958511 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2268/4747] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:23.096908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:23.098465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:23.108628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.109922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.110875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.112611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.153365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:23.178761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.179980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.181227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.184537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.269410 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a69f9d1b-511c-458b-ab5f-666591eb05c5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "POST /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3/action" status: 202 len: 1108 microversion: 2.1 time: 0.630388 Mar 29 02:34:23.272549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2480/4748] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:34:22 2022] POST /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3/action => generated 1108 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 29 02:34:23.284450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:23.285171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:23.305802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.324100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.325775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.325775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.803135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:23.813557 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8e91fd1-5d2f-4603-9d07-882b19e604a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.532942 Mar 29 02:34:23.823196 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2481/4749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:23 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:23.823196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:23.833351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:23.842750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.843209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:23.843995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:23.844435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:24.240061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:24.252529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:24.254388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:24.255559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5c62d576-dde5-4133-b1f1-b25c6235c4a7 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 0.437434 Mar 29 02:34:24.256285 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2482/4750] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:23 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:24.262551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-18bccd6a-380e-4802-9d1d-a162824aa048 req-07017cc6-8cf6-40d7-8e81-73db7bd44806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "name": "network-vif-plugged", "status": "completed", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:24.264513 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:24.264513 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:34:24.274162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18bccd6a-380e-4802-9d1d-a162824aa048 req-07017cc6-8cf6-40d7-8e81-73db7bd44806 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:24.274847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-18bccd6a-380e-4802-9d1d-a162824aa048 req-07017cc6-8cf6-40d7-8e81-73db7bd44806 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:24.294665 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-18bccd6a-380e-4802-9d1d-a162824aa048 req-07017cc6-8cf6-40d7-8e81-73db7bd44806 service nova] Creating event network-vif-plugged:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:34:24.300097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-18bccd6a-380e-4802-9d1d-a162824aa048 req-07017cc6-8cf6-40d7-8e81-73db7bd44806 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042035 Mar 29 02:34:24.300382 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2483/4751] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:34:24.448637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:24.464443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e35efb57-a8ef-4c1f-ae54-808920ab3a0e tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 1.370470 Mar 29 02:34:24.468353 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2269/4752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:23 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:24.831100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:24.831889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:24.840059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:24.840781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:24.841806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:24.842454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:25.166446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:25.183760 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f03d54bb-0ea1-40c3-af2d-bd26e4a7d99c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.356901 Mar 29 02:34:25.185156 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2484/4753] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:24 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:25.276171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:25.277675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:25.286772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:25.290481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:25.290481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:25.290481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:25.481282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:25.482233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:25.491301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:25.491884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:25.492792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:25.493267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:25.773414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:25.787078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-637af77f-462b-4fa4-9009-f011af1cf708 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.309711 Mar 29 02:34:25.788015 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2485/4754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:25 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:26.200944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:26.201689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:26.209858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:26.210858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:26.211163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:26.211619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:26.447969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:26.457986 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46777f4c-1b1a-4a79-8094-37ae7b282a1b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.260726 Mar 29 02:34:26.459197 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2486/4755] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:26 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:26.471359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:26.481812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:26.483662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:26.485071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-42bbbba3-fca2-4ee3-a3b1-feb74aa7b33e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1404 microversion: 2.20 time: 1.213915 Mar 29 02:34:26.486270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2270/4756] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:25 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1404 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:34:26.807513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:26.808769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:26.822647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:26.823097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:26.826023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:26.826475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:27.100133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:27.109930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de812cb6-99c2-4f0c-b2aa-bce4e65c2674 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.310236 Mar 29 02:34:27.112882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2487/4757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:26 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:27.476239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:27.476928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:27.490500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:27.491243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:27.496756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:27.497536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:27.511814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:27.512547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:27.537125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:27.537830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:27.538836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:27.539471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:27.915416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:27.924369 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-92bf45c1-e67e-42a6-a612-0cbf9f7bac98 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.452541 Mar 29 02:34:27.926372 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2271/4758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:27 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:27.967307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:27.977445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:27.985473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:27.985473 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-264254cb-af66-40aa-acf4-a22f45c3dd13 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1595 microversion: 2.20 time: 0.473347 Mar 29 02:34:27.985473 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2488/4759] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:34:27 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1595 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:34:27.998269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:27.998901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:28.006565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.007012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:28.007779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.008207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:28.128334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:28.128978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:28.140176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.140671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:28.141494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.141916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:28.300366 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cac0c2e5-6f40-41fe-8841-bab7f370e16f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.300001 Mar 29 02:34:28.300366 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2272/4760] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:34:27 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:34:28.812626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:28.822373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a87a391-6804-48da-88ea-be7c87642893 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.698636 Mar 29 02:34:28.822980 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2489/4761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:28 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:28.944962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:28.946693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:28.969627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.970984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:28.972397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:28.973459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:29.621564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:29.649741 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c7dde60-4716-42e2-87e1-775beac093ad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.708439 Mar 29 02:34:29.660358 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2273/4762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:28 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:29.841044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:29.841690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:29.855697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:29.857384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:29.859824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:29.861070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:30.310235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:30.320551 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cd574d85-b875-496a-90a0-bb0385d37d57 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.484542 Mar 29 02:34:30.328514 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2490/4763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:29 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:30.668178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:30.668925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:30.687824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:30.689169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:30.692957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:30.693505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:31.345737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:31.347966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:31.355922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:31.369103 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-591b9a12-4501-41e6-af7d-f8d134e5fa13 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.705266 Mar 29 02:34:31.372272 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2274/4764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:30 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:31.401725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:31.402730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:31.405678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:31.406295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:31.485910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4df908f5-8128-4adb-beb4-41c6cd608a68 req-9cb4f612-2a77-470d-95f1-5416ef17667a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:31.487484 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:31.487484 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:34:31.497410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4df908f5-8128-4adb-beb4-41c6cd608a68 req-9cb4f612-2a77-470d-95f1-5416ef17667a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:31.498180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4df908f5-8128-4adb-beb4-41c6cd608a68 req-9cb4f612-2a77-470d-95f1-5416ef17667a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:31.515651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4df908f5-8128-4adb-beb4-41c6cd608a68 req-9cb4f612-2a77-470d-95f1-5416ef17667a service nova] Creating event network-changed:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:34:31.521653 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4df908f5-8128-4adb-beb4-41c6cd608a68 req-9cb4f612-2a77-470d-95f1-5416ef17667a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041411 Mar 29 02:34:31.523592 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2275/4765] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:34:32.329916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:32.339233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-306a9528-f448-40a5-a876-7a3ee08ede3d tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.999402 Mar 29 02:34:32.340817 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2491/4766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:31 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:32.394034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:32.394820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:32.425096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:32.429853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:32.431450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:32.432086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:32.768463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:32.776791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f2822af4-ca51-431b-9acf-31a6ca20140b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.391662 Mar 29 02:34:32.780127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2276/4767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:32 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:32.816003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-14f1b960-c1af-4719-ba98-2f61216d950f req-5cfc6a5e-b0d1-4b34-ab78-6b9a948b750e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2187c4f5-2095-4cf5-9d69-0a0f37834947", "name": "network-vif-plugged", "status": "completed", "tag": "362da240-a44a-4e31-afc6-bf08934c5c3d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:32.817684 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:32.817684 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:34:32.840798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-14f1b960-c1af-4719-ba98-2f61216d950f req-5cfc6a5e-b0d1-4b34-ab78-6b9a948b750e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:32.841267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-14f1b960-c1af-4719-ba98-2f61216d950f req-5cfc6a5e-b0d1-4b34-ab78-6b9a948b750e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:32.859417 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-14f1b960-c1af-4719-ba98-2f61216d950f req-5cfc6a5e-b0d1-4b34-ab78-6b9a948b750e service nova] Creating event network-vif-plugged:362da240-a44a-4e31-afc6-bf08934c5c3d for instance 2187c4f5-2095-4cf5-9d69-0a0f37834947 on n-h1-828148-1 Mar 29 02:34:32.865084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-14f1b960-c1af-4719-ba98-2f61216d950f req-5cfc6a5e-b0d1-4b34-ab78-6b9a948b750e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052520 Mar 29 02:34:32.866403 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2492/4768] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:34:33.357169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:33.358082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:33.365818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:33.366468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:33.367556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:33.368226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:33.645385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:33.654845 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a53fe4d-4d5c-433b-ab8d-d9c0b19d8ef9 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.301845 Mar 29 02:34:33.656151 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2277/4769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:33 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:33.797411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:33.798488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:33.820451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:33.821617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:33.822609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:33.823205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:34.673023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:34.674321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:34.692343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:34.693179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:34.694189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:34.694844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:34.884351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:34.895502 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd3cc385-4379-4b2d-bc72-15098795a14d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 1.102769 Mar 29 02:34:34.899454 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2493/4770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:33 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:35.140125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:35.150480 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d937655-0795-4c59-86cc-23cb87849428 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1316 microversion: 2.1 time: 0.480956 Mar 29 02:34:35.151401 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2278/4771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:34 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1316 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:35.913614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:35.914879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:35.923789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:35.924242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:35.925285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:35.925833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:36.173714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:36.176884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:36.228131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:36.234446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:36.238334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:36.239793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:36.993762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:37.004743 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-888c30dc-4d56-4450-861e-0aa3f3954b3d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 1.094953 Mar 29 02:34:37.009511 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2494/4772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:35 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:37.080220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:37.093222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d5f038d-aa36-41e7-bacd-a8ac6da6157a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1504 microversion: 2.1 time: 0.927369 Mar 29 02:34:37.095893 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2279/4773] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:36 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1504 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:37.113157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:37.114319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:37.123076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.130032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.130032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.130032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.197228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6624db0-e15f-4ae0-b3c1-092cc69229f1 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips" status: 200 len: 108 microversion: 2.1 time: 0.088198 Mar 29 02:34:37.204301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2495/4774] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:34:37 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips => generated 108 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:34:37.217191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:37.217753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:37.234022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.234471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.237219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.237219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.358270 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7c0e71f-a9fa-4807-be69-7811c4b63cb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips" status: 200 len: 108 microversion: 2.1 time: 0.152688 Mar 29 02:34:37.360340 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2280/4775] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:34:37 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips => generated 108 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:37.369297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:37.371529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:37.379665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.381043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.382503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.383149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.483812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebdba59f-5596-47d0-ace1-9a2bee3b1873 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips/tempest-ServerAddressesTestJSON-373289749-network" status: 200 len: 93 microversion: 2.1 time: 0.116752 Mar 29 02:34:37.499916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:37.500712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:37.505090 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2496/4776] 10.222.0.36 () {58 vars in 1397 bytes} [Tue Mar 29 02:34:37 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947/ips/tempest-ServerAddressesTestJSON-373289749-network => generated 93 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 02:34:37.509396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.513249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.514417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:37.516822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:37.594119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:34:38.031051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:38.032285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:38.040541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:38.041385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:38.042251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:38.043109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:38.362632 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-14401838-3244-4f46-ba6c-61edf012233f tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 204 len: 0 microversion: 2.1 time: 0.869871 Mar 29 02:34:38.363561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2281/4777] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:34:37 2022] DELETE /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 0 bytes in 872 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:34:38.372428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:38.373060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:38.391961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:38.392643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:38.395819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:38.396460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:38.833710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:38.836955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:38.847705 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-065601ae-e1bb-4da4-b1df-0cc66f6b1f9a tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1510 microversion: 2.1 time: 0.475782 Mar 29 02:34:38.856646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d63bb04-9b9a-4d3c-94cc-1f8e489fbfab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.828152 Mar 29 02:34:38.859828 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2282/4778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:38 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:38.861600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2497/4779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:38 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:39.868145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:39.869441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:39.870111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:39.870408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:39.879629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:39.880081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:39.881052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:39.881525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:39.881666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:39.882259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:39.886696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:39.887863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:40.650877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:40.670010 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6157e437-6a18-42da-8b66-14d7cdd893a4 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1510 microversion: 2.1 time: 0.806412 Mar 29 02:34:40.672648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2283/4780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:39 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1510 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:40.690601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:40.702324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f23f871-1a6d-48b9-afbf-bdbebf148d3f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.834387 Mar 29 02:34:40.703572 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2498/4781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:39 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:41.687764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:41.688380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:41.695933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:41.696631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:41.697607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:41.698201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:41.698329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-98abd388-7ec8-4810-8110-3b18553a1947 req-9278d28e-1e3d-428f-9d17-f5814256d3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2187c4f5-2095-4cf5-9d69-0a0f37834947", "name": "network-vif-deleted", "tag": "362da240-a44a-4e31-afc6-bf08934c5c3d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:41.701069 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:41.701069 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:34:41.712297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-98abd388-7ec8-4810-8110-3b18553a1947 req-9278d28e-1e3d-428f-9d17-f5814256d3ac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:41.712794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-98abd388-7ec8-4810-8110-3b18553a1947 req-9278d28e-1e3d-428f-9d17-f5814256d3ac service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:41.734158 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-98abd388-7ec8-4810-8110-3b18553a1947 req-9278d28e-1e3d-428f-9d17-f5814256d3ac service nova] Creating event network-vif-deleted:362da240-a44a-4e31-afc6-bf08934c5c3d for instance 2187c4f5-2095-4cf5-9d69-0a0f37834947 on n-h1-828148-1 Mar 29 02:34:41.741929 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-98abd388-7ec8-4810-8110-3b18553a1947 req-9278d28e-1e3d-428f-9d17-f5814256d3ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048324 Mar 29 02:34:41.743578 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2499/4782] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:41.749648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:41.750361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:41.784500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:41.785068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:41.785999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:41.786505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:42.038970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd996e3af92e4f05bed53269df9a5571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1f4e49a1c4b81a803dac4641618ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:42.049247 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efe3064f-a0d7-4bf9-b0e1-3beafa5b5a55 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 200 len: 1468 microversion: 2.1 time: 0.365466 Mar 29 02:34:42.049944 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2284/4783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:41 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 1468 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:42.233124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:42.243016 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6572046b-2908-455f-ad81-376dcbf96c4f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.498510 Mar 29 02:34:42.248164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2500/4784] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:41 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:43.067297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:43.068002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] [instance: 2187c4f5-2095-4cf5-9d69-0a0f37834947] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:43.079140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:43.080206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:43.082655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:43.084376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:43.198767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] HTTP exception thrown: Instance 2187c4f5-2095-4cf5-9d69-0a0f37834947 could not be found. Mar 29 02:34:43.199410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] Returning 404 to user: Instance 2187c4f5-2095-4cf5-9d69-0a0f37834947 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:34:43.204187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b91cd46-7ce6-45a9-b386-8c7a8e6acfb0 tempest-ServerAddressesTestJSON-1009281778 tempest-ServerAddressesTestJSON-1009281778-project] 10.222.0.36 "GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947" status: 404 len: 111 microversion: 2.1 time: 0.136713 Mar 29 02:34:43.204187 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2285/4785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:43 2022] GET /compute/v2.1/servers/2187c4f5-2095-4cf5-9d69-0a0f37834947 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:34:43.266190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:43.266906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:43.289298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:43.290511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:43.291349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:43.291782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:44.226456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:44.241902 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-885aecad-f9ff-4dee-8dc2-c09828911934 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.985985 Mar 29 02:34:44.242489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2501/4786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:43 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:45.260008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:45.260614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:45.275883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:45.276349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:45.277200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:45.278163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:45.638204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:45.656570 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23f4c67d-fe2d-4793-ba30-dd7227e91a56 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.399979 Mar 29 02:34:45.659372 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2286/4787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:45 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:46.674966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:46.675575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:46.690344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:46.691050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:46.692050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:46.693397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:46.982579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:46.985919 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d0c0118-bab9-4805-8faf-adf979bfd8b3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.314821 Mar 29 02:34:46.986920 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2502/4788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:46 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:48.004296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:48.006027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:48.038781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:48.039829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:48.043456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:48.044082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:48.509129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:48.522256 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-57adfd77-ff10-42b2-9567-685dfe816d65 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.522544 Mar 29 02:34:48.531675 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2287/4789] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:47 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:49.538442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:49.539687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:49.548032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:49.551623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:49.551623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:49.551623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:49.909312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:49.921975 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4fdf3e09-311f-430c-bc79-79845d4651c7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1513 microversion: 2.1 time: 0.387256 Mar 29 02:34:49.923836 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2503/4790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:49 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1513 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:50.941648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:50.942425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:50.957422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:50.960050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:50.960050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:50.964208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:51.187279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-610717705", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:51.276408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] validate_networks() for [('b1ae1b04-d401-4f86-bfae-31532326f213', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:34:51.763467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:51.776549 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-248770b0-937d-4167-af7d-6c5aa7fe0948 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.840154 Mar 29 02:34:51.779708 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2504/4791] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:50 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:52.250671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:34:52.251140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:34:52.251587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:34:52.252418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:34:52.253065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:34:52.270638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:52.271097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:52.271914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:52.272351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:52.296985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Getting quotas for project 44c01d2df74242cfa4d52436c674a9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:34:52.303511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Getting quotas for user 80a1e5a10b3b4cceb353e924db8a940d and project 44c01d2df74242cfa4d52436c674a9c0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:34:52.358826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:34:52.361507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:34:52.568019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c38fa9bc-9326-4d14-b870-f1723ef773d3 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882471 Mar 29 02:34:52.569322 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2288/4792] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:34:52.584241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ec2770d-fb11-46cb-8bba-87c803ae9214 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:52.585437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ec2770d-fb11-46cb-8bba-87c803ae9214 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:52.761893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ec2770d-fb11-46cb-8bba-87c803ae9214 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:52.773561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ec2770d-fb11-46cb-8bba-87c803ae9214 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1223 microversion: 2.1 time: 0.197532 Mar 29 02:34:52.784017 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2505/4793] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:52 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1223 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:52.798318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:52.799025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:52.831382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:52.831838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:52.832734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:52.835351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:53.750661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:53.775687 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-911c13bc-80a7-486b-8ba1-e1643fa4c9ab tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.981993 Mar 29 02:34:53.790595 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2289/4794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:52 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:53.792360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e19c8bbd-07dc-4b1c-8c41-7d50860bcc2a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:53.793052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e19c8bbd-07dc-4b1c-8c41-7d50860bcc2a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:53.973314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e19c8bbd-07dc-4b1c-8c41-7d50860bcc2a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:53.992812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e19c8bbd-07dc-4b1c-8c41-7d50860bcc2a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1223 microversion: 2.1 time: 0.200891 Mar 29 02:34:54.012032 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2506/4795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:53 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1223 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:54.800112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:54.800112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:54.812140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:54.817204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:54.818156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:54.818840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:55.012604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:55.013449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:55.032098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:55.032610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:55.033621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:55.034223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:55.225571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:55.235878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1788adb1-db0d-4096-8d43-63acc45d848a tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1275 microversion: 2.1 time: 0.227831 Mar 29 02:34:55.237192 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2507/4796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:55 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1275 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:55.665844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:55.676120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6abdf1fe-cec2-4f63-8ba5-bbb6f0851be9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.884386 Mar 29 02:34:55.689234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2290/4797] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:54 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:56.254119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:56.254783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:56.268098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:56.268548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:56.277962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:56.279990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:56.542215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:56.552369 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f67cc251-2c60-4124-a5a8-fd2c97febde4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1281 microversion: 2.1 time: 0.302244 Mar 29 02:34:56.563515 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2508/4798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:56 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:56.696882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:56.697509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:56.711175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:56.713496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:56.714487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:56.717443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:57.367314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:57.376138 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bfa7130d-2089-4f09-a99d-1fd2872af009 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.682944 Mar 29 02:34:57.377311 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2291/4799] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:56 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:57.578086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:57.579901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:57.591869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:57.592772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:57.593955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:57.595305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:57.928113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:57.939935 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55fc1caf-0f67-4c6e-a381-9ae16de7383f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.367859 Mar 29 02:34:57.942919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2509/4800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:57 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:58.393570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:58.394353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:58.410405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.410984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.412807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.417988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.561223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-75a485a9-b9d3-4682-97ca-70c1406420b9 req-0c9715da-d487-46e5-aafd-ab2440e0f60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b17e49-731d-4ae0-a761-6878392921c3", "name": "network-vif-plugged", "status": "completed", "tag": "a4cef7fe-92f3-45b5-a118-47220656dddf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:58.563457 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:58.563457 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:34:58.586848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-75a485a9-b9d3-4682-97ca-70c1406420b9 req-0c9715da-d487-46e5-aafd-ab2440e0f60a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.587473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-75a485a9-b9d3-4682-97ca-70c1406420b9 req-0c9715da-d487-46e5-aafd-ab2440e0f60a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.605296 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-75a485a9-b9d3-4682-97ca-70c1406420b9 req-0c9715da-d487-46e5-aafd-ab2440e0f60a service nova] Creating event network-vif-plugged:a4cef7fe-92f3-45b5-a118-47220656dddf for instance f7b17e49-731d-4ae0-a761-6878392921c3 on n-h1-828148-1 Mar 29 02:34:58.630858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-75a485a9-b9d3-4682-97ca-70c1406420b9 req-0c9715da-d487-46e5-aafd-ab2440e0f60a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057655 Mar 29 02:34:58.637543 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2510/4801] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:34:58.743909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:58.744745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:58.755600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.756291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.757318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.757904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.841740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25508bc6-8cf4-401d-b3da-ae257e3d9fb9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/ips" status: 200 len: 151 microversion: 2.20 time: 0.102246 Mar 29 02:34:58.842972 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2511/4802] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Mar 29 02:34:58 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/ips => generated 151 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:34:58.965754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:34:58.966977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:34:58.973821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.974270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:58.975050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:58.975676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:59.236692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:59.247902 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49ca3e69-7c10-4a2b-b6f2-cdf2b89014be tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.857351 Mar 29 02:34:59.260930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2292/4803] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:58 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:34:59.312976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:34:59.321510 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7a821f8-6c17-4eb5-9497-2d159e46bbb8 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.359338 Mar 29 02:34:59.322148 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2512/4804] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:34:58 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:34:59.886097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d695ae77-0b86-4877-b265-691f58b4001f req-a139e7ac-4c50-4de5-ae82-31609176ef63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c325860-d8e8-44bb-8e08-75b11de33e34", "tag": "cd8b17df-0287-4ba8-853a-900c00666a2d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:34:59.887998 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:34:59.887998 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:34:59.912292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d695ae77-0b86-4877-b265-691f58b4001f req-a139e7ac-4c50-4de5-ae82-31609176ef63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:34:59.916133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d695ae77-0b86-4877-b265-691f58b4001f req-a139e7ac-4c50-4de5-ae82-31609176ef63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:34:59.941353 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d695ae77-0b86-4877-b265-691f58b4001f req-a139e7ac-4c50-4de5-ae82-31609176ef63 service nova] Creating event network-changed:cd8b17df-0287-4ba8-853a-900c00666a2d for instance 0c325860-d8e8-44bb-8e08-75b11de33e34 on n-h1-828148-1 Mar 29 02:34:59.947177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d695ae77-0b86-4877-b265-691f58b4001f req-a139e7ac-4c50-4de5-ae82-31609176ef63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064521 Mar 29 02:34:59.948437 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2293/4805] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:00.266613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:00.267242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:00.294994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:00.296635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:00.299932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:00.301208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:00.339083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:00.339864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:00.351928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:00.361353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:00.365888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:00.366878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:01.152482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:01.170022 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32deb2ca-9410-469b-9c8c-7ca3ec6002ff tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1519 microversion: 2.1 time: 0.908159 Mar 29 02:35:01.177220 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2513/4806] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:00 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1519 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:01.868992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:01.878317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50e31270-b480-47ec-890e-e69562f0dd1f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 1.543594 Mar 29 02:35:01.878880 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2294/4807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:00 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:02.188485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:02.189689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:02.198492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.199155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:02.200214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.200802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:02.570738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:02.574582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:02.583635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.584468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:02.587192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.587632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:02.653563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lazy-loading 'flavor' on Instance uuid 8ff3d3b6-e435-4b4b-ae28-1b549576c943 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:35:02.686472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:02.695840 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4779b25b-29c9-4834-af0a-19d1a32c8118 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1504 microversion: 2.1 time: 0.512422 Mar 29 02:35:02.696413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2514/4808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:02 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:02.712865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:02.713715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:02.722059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.722796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:02.724095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:02.724095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:03.430852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:03.451083 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf79b909-8543-45b4-840c-c8a0873f67a7 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 200 len: 1504 microversion: 2.1 time: 0.738105 Mar 29 02:35:03.452830 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2515/4809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:02 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:03.458332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:03.460238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:03.471912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:03.472718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:03.473792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:03.474597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:03.508684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0af1541-9c80-4ce0-9769-b07afa0e6112 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/action" status: 202 len: 0 microversion: 2.20 time: 0.944400 Mar 29 02:35:03.513268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2295/4810] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:35:02 2022] POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:35:03.519791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:03.520599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:03.533291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:03.533919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:03.535467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:03.536139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:03.657179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:35:03.959874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:03.976686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-33648c03-ba4e-4313-8072-82cdd65c7ee6 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.522154 Mar 29 02:35:03.977322 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2516/4811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:03 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:03.986961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:04.001238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:04.016831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:04.018660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:04.020382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:04.021152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:04.335400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3791691e-15d8-4ed9-bed3-a6b0f3889cad tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 204 len: 0 microversion: 2.1 time: 0.819177 Mar 29 02:35:04.337117 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2296/4812] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:35:03 2022] DELETE /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:35:04.400403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:04.412608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:04.424380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:04.425835 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d98dd646-8643-43cc-9a5b-41ae5c8a2015 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.442955 Mar 29 02:35:04.426661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2517/4813] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:03 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:04.609671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-668854568", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "36554e6a-2a50-4d62-afdb-29cf6905975f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:04.768310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] validate_networks() for [('36554e6a-2a50-4d62-afdb-29cf6905975f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:35:04.994591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:04.995093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:05.010952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.014289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:05.016700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.016700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:05.445313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:05.483755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29f36061-2641-4889-a86f-64fcd551ddd5 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.493772 Mar 29 02:35:05.484951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2518/4814] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:04 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:05.490305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:05.491165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:05.502439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.503046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:05.513457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.513457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:05.975208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:35:05.975796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:35:05.976164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:35:05.976753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:35:05.977463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:35:05.996529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.997853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:05.998861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:05.999290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:06.046847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:35:06.056887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for user 446cf893ae6343219c5293cfcee725eb and project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:35:06.071090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:35:06.073550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:35:06.101037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:06.131210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:06.134260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:06.134260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f97ec491-0ef1-4a2f-b5b8-7d13792e875d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.647691 Mar 29 02:35:06.145268 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2519/4815] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:05 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:06.217086 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5f638d7c-f07f-4c9d-8a67-f735a06adf67 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611346 Mar 29 02:35:06.231033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad164b6d-5822-4cc2-ad2b-59866f59f6b6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:06.232994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad164b6d-5822-4cc2-ad2b-59866f59f6b6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:06.236409 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2297/4816] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:35:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:35:06.503817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad164b6d-5822-4cc2-ad2b-59866f59f6b6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:06.507876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:06.508877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:06.520213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad164b6d-5822-4cc2-ad2b-59866f59f6b6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1217 microversion: 2.1 time: 0.294947 Mar 29 02:35:06.523514 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2520/4817] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:06 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1217 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:06.530566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:06.531324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:06.532377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:06.533095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.155260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:07.156639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:07.168678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:07.172039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.174791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:07.175466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.362035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:07.377133 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4db02eb6-d826-4685-9ae3-e3a4bad2d314 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.879807 Mar 29 02:35:07.389988 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2298/4818] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:06 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:07.544553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:07.547772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:07.571026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:07.571875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.573139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:07.573858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.922831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:07.933640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c6af14e8-d321-408b-b82a-71920f574ecb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1221 microversion: 2.1 time: 0.395763 Mar 29 02:35:07.935283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2299/4819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:07 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:07.943794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1480ce92-4383-41ee-84fb-ab23c4e2cd54 req-27492538-1740-458b-b7e7-94b7ee608b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7b17e49-731d-4ae0-a761-6878392921c3", "name": "network-vif-deleted", "tag": "a4cef7fe-92f3-45b5-a118-47220656dddf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:07.949183 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:07.949183 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:07.969800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1480ce92-4383-41ee-84fb-ab23c4e2cd54 req-27492538-1740-458b-b7e7-94b7ee608b8f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:07.970386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1480ce92-4383-41ee-84fb-ab23c4e2cd54 req-27492538-1740-458b-b7e7-94b7ee608b8f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:07.993808 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1480ce92-4383-41ee-84fb-ab23c4e2cd54 req-27492538-1740-458b-b7e7-94b7ee608b8f service nova] Creating event network-vif-deleted:a4cef7fe-92f3-45b5-a118-47220656dddf for instance f7b17e49-731d-4ae0-a761-6878392921c3 on n-h1-828148-1 Mar 29 02:35:07.999644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1480ce92-4383-41ee-84fb-ab23c4e2cd54 req-27492538-1740-458b-b7e7-94b7ee608b8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062007 Mar 29 02:35:08.000410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2300/4820] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:08.253429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:08.269499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:08.271264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:08.272758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b47d322a-7eed-4ee5-a2bf-410a0295120e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 1.122125 Mar 29 02:35:08.274701 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2521/4821] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:07 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:08.409928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:08.411022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:08.421553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:08.422515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:08.423685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:08.424399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:08.847595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:08.873032 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-25705a8a-2220-41a6-a5f4-4a88c1641c42 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 0.469782 Mar 29 02:35:08.885815 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2301/4822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:08 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:08.952608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:08.953489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:08.976411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:08.976887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:08.977883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:08.978484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.234905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0be19bfd-88ca-4859-85f5-8bf7fe5b599c req-3907f44f-3011-4dad-b191-90cf1ceedfbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c325860-d8e8-44bb-8e08-75b11de33e34", "name": "network-vif-plugged", "status": "completed", "tag": "cd8b17df-0287-4ba8-853a-900c00666a2d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:09.236996 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:09.236996 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:09.246128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0be19bfd-88ca-4859-85f5-8bf7fe5b599c req-3907f44f-3011-4dad-b191-90cf1ceedfbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:09.246128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0be19bfd-88ca-4859-85f5-8bf7fe5b599c req-3907f44f-3011-4dad-b191-90cf1ceedfbe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.264678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0be19bfd-88ca-4859-85f5-8bf7fe5b599c req-3907f44f-3011-4dad-b191-90cf1ceedfbe service nova] Creating event network-vif-plugged:cd8b17df-0287-4ba8-853a-900c00666a2d for instance 0c325860-d8e8-44bb-8e08-75b11de33e34 on n-h1-828148-1 Mar 29 02:35:09.270536 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0be19bfd-88ca-4859-85f5-8bf7fe5b599c req-3907f44f-3011-4dad-b191-90cf1ceedfbe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Mar 29 02:35:09.273972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2302/4823] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:35:09.297213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:09.301212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:09.327987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:09.328860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.334370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:09.335197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.360000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:09.376453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-425611cd-de40-4d3d-93b2-2f1569c6f827 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1277 microversion: 2.1 time: 0.428470 Mar 29 02:35:09.385979 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2522/4824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:08 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1277 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:09.893067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:09.894614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:09.912618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:09.913157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.914337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:09.914773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:09.936295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:09.950991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:09.952423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:09.953654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1742804-03df-48e4-8e52-7ccbcdf724af tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.663847 Mar 29 02:35:09.955252 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2303/4825] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:09 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:10.402002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:10.402768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:10.423472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:10.428043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:10.429632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:10.432505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:10.686236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:10.694820 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c0b42ed4-ce0e-4aa9-a044-e3b48a993b5c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1275 microversion: 2.1 time: 0.296475 Mar 29 02:35:10.703383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2304/4826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:10 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:10.933219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:10.943561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-848d6ec4-bbe7-421e-96d3-44bae253fd35 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1323 microversion: 2.1 time: 1.055175 Mar 29 02:35:10.945115 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2523/4827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:09 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:10.971943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:10.973311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:10.990218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:10.991614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:10.994605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:10.995277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:11.291725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:11.307493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:11.309121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:11.311602 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-263f4ce1-62c0-4930-959e-d175775e4903 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.343632 Mar 29 02:35:11.312597 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2305/4828] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:10 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:11.719977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:11.720671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:11.734881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:11.735009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:11.735697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:11.736125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:11.960322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:11.960992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:11.970416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:11.970871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:11.971737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:11.975268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:12.093015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:12.107120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d0293fc-427b-4720-87a2-7588da619752 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1275 microversion: 2.1 time: 0.389414 Mar 29 02:35:12.111226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2524/4829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:11 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1275 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:12.201352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:12.210876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f50ef989-be2d-4432-83fd-2721978c5715 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1517 microversion: 2.1 time: 0.254368 Mar 29 02:35:12.211446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2306/4830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:11 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:12.337390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:12.338045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:12.354614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:12.354614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:12.354614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:12.354614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:12.359379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ceb9e3fc-3f9c-4ecd-bd63-0222412fc0ef tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2137266429", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:12.360772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ceb9e3fc-3f9c-4ecd-bd63-0222412fc0ef tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.361594 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ceb9e3fc-3f9c-4ecd-bd63-0222412fc0ef tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.005996 Mar 29 02:35:12.362108 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2307/4831] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:35:12 2022] POST /compute/v2.1/servers => generated 175 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:35:12.374441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc7ef8e0-b580-48ad-ad76-15d080198841 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:12.375177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bc7ef8e0-b580-48ad-ad76-15d080198841 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 16a0cd8c-61b5-47b7-ba3d-eac9d4caa79a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:12.391791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-bc7ef8e0-b580-48ad-ad76-15d080198841 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] HTTP exception thrown: Instance 16a0cd8c-61b5-47b7-ba3d-eac9d4caa79a could not be found. Mar 29 02:35:12.392684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bc7ef8e0-b580-48ad-ad76-15d080198841 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 404 to user: Instance 16a0cd8c-61b5-47b7-ba3d-eac9d4caa79a could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.393703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bc7ef8e0-b580-48ad-ad76-15d080198841 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/16a0cd8c-61b5-47b7-ba3d-eac9d4caa79a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.023721 Mar 29 02:35:12.405494 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2308/4832] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:35:12 2022] GET /compute/v2.1/servers/16a0cd8c-61b5-47b7-ba3d-eac9d4caa79a/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:35:12.480032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e92fcd4f-280a-48eb-98db-3e96482cca49 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-147201799", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:12.482072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e92fcd4f-280a-48eb-98db-3e96482cca49 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.482858 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e92fcd4f-280a-48eb-98db-3e96482cca49 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006617 Mar 29 02:35:12.483365 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2309/4833] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:35:12 2022] POST /compute/v2.1/servers => generated 687 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 29 02:35:12.536481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a87f5ccb-fe46-4355-9e02-aeafa1792440 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-737514013", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:12.539424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a87f5ccb-fe46-4355-9e02-aeafa1792440 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.541301 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a87f5ccb-fe46-4355-9e02-aeafa1792440 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009968 Mar 29 02:35:12.542508 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2310/4834] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:35:12 2022] POST /compute/v2.1/servers => generated 689 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:35:12.594078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dba92ee8-8003-4dbb-b26f-39ea2a64c47b tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2036063832", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:12.595479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dba92ee8-8003-4dbb-b26f-39ea2a64c47b tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.596271 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dba92ee8-8003-4dbb-b26f-39ea2a64c47b tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006060 Mar 29 02:35:12.596783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2311/4835] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:35:12 2022] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Mar 29 02:35:12.761238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7185e9f-1a03-4188-a160-2ddc67f347a4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-742932353", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b1ae1b04-d401-4f86-bfae-31532326f213"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:12.763517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7185e9f-1a03-4188-a160-2ddc67f347a4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.764302 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d7185e9f-1a03-4188-a160-2ddc67f347a4 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.006951 Mar 29 02:35:12.765038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2312/4836] 10.222.0.36 () {60 vars in 1147 bytes} [Tue Mar 29 02:35:12 2022] POST /compute/v2.1/servers => generated 2221 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Mar 29 02:35:12.775992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fae696a-edbc-47ba-b92d-5513c1aee9fb tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:12.776568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fae696a-edbc-47ba-b92d-5513c1aee9fb tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: cfc7b374-cfbb-422d-899b-36b8b250ddb9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:12.788681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1fae696a-edbc-47ba-b92d-5513c1aee9fb tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] HTTP exception thrown: Instance cfc7b374-cfbb-422d-899b-36b8b250ddb9 could not be found. Mar 29 02:35:12.789661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fae696a-edbc-47ba-b92d-5513c1aee9fb tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 404 to user: Instance cfc7b374-cfbb-422d-899b-36b8b250ddb9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:12.794900 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fae696a-edbc-47ba-b92d-5513c1aee9fb tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/cfc7b374-cfbb-422d-899b-36b8b250ddb9/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.018421 Mar 29 02:35:12.794900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2313/4837] 10.222.0.36 () {58 vars in 1280 bytes} [Tue Mar 29 02:35:12 2022] GET /compute/v2.1/servers/cfc7b374-cfbb-422d-899b-36b8b250ddb9/metadata/test2 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:35:12.811439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:12.811996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:12.831272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:12.831823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:12.838756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:12.839372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:12.964447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:35:13.261179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:13.271095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:13.273523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:13.274681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31c2dd4d-bb65-4999-ad59-67aab2b1659c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.942952 Mar 29 02:35:13.279053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2525/4838] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:12 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:13.284552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:13.285294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:13.292901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f648cd69-09b2-4bdd-9a2a-962f6683d625 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 204 len: 0 microversion: 2.1 time: 0.484338 Mar 29 02:35:13.295216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2314/4839] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:35:12 2022] DELETE /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:35:13.301746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:13.302654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:13.305135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:13.306917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:13.309273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:13.310077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:13.317922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:13.318712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:13.319712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:13.320372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:13.602834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:13.630888 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4946a6ec-1e48-4dce-96dc-ab8deffce858 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1523 microversion: 2.1 time: 0.323472 Mar 29 02:35:13.634086 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2315/4840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:13 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:14.258198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:14.267526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-567871b8-02f3-486d-b558-8ecf7ea73ab8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.990057 Mar 29 02:35:14.277798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2526/4841] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:13 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:14.295523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:14.296219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:14.312652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:14.313170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:14.315136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:14.315579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:14.650611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:14.651472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:14.666270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:14.666977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:14.668414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:14.669807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:15.214223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:15.229869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:15.232695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:15.234592 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c5d73c3-bd39-450c-a6b4-1d267d771eae tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.943923 Mar 29 02:35:15.235307 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2316/4842] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:14 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:15.289935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:15.291483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:15.309172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:15.310496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:15.312212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:15.312828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:15.322740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:15.335518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fba0bdf1-3f3b-4e4b-b393-029bb3ddc11e tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1523 microversion: 2.1 time: 0.687505 Mar 29 02:35:15.350671 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2527/4843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:14 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:16.116794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:16.129316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c5e74a16-6248-4c1c-b2c4-bf8c114c0fef tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.849041 Mar 29 02:35:16.138661 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2317/4844] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:15 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:16.255643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:16.256260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:16.292119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:16.292614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:16.295666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:16.295666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:16.355206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:16.355838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:16.369300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:16.371192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:16.372255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:16.375962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:17.082588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:17.100287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:17.104279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:17.108211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2168910c-d924-444b-a1b5-e78a8d996e95 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.856179 Mar 29 02:35:17.110354 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2528/4845] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:16 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:17.119671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:17.130146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-dbf83bc4-712a-42ba-98af-ba377c1df526 req-b6c42b22-8f1a-4736-802b-662c07e034c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "718b000c-5142-4e90-9015-b5ef1e9c8f20", "tag": "e58e0ba9-865c-4c17-9ed7-23d36b2aeba0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:17.130651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-48f4c268-9275-458e-adbe-aafb9724d603 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1523 microversion: 2.1 time: 0.777955 Mar 29 02:35:17.132064 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:17.132064 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:17.142797 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2318/4846] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:16 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1523 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:17.155612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:17.164242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:17.166793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dbf83bc4-712a-42ba-98af-ba377c1df526 req-b6c42b22-8f1a-4736-802b-662c07e034c9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:17.170059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-dbf83bc4-712a-42ba-98af-ba377c1df526 req-b6c42b22-8f1a-4736-802b-662c07e034c9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:17.196495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:17.197244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:17.198364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:17.198971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:17.208858 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-dbf83bc4-712a-42ba-98af-ba377c1df526 req-b6c42b22-8f1a-4736-802b-662c07e034c9 service nova] Creating event network-changed:e58e0ba9-865c-4c17-9ed7-23d36b2aeba0 for instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 on n-h2-828148-1 Mar 29 02:35:17.221617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-dbf83bc4-712a-42ba-98af-ba377c1df526 req-b6c42b22-8f1a-4736-802b-662c07e034c9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106248 Mar 29 02:35:17.222646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2529/4847] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:17.284440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1e5f18a7-3548-4084-bd6e-c868e7acd24c req-6089af15-9250-4bad-bed5-b7cd1af59260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c325860-d8e8-44bb-8e08-75b11de33e34", "name": "network-vif-deleted", "tag": "cd8b17df-0287-4ba8-853a-900c00666a2d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:17.286192 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:17.286192 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:17.301866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1e5f18a7-3548-4084-bd6e-c868e7acd24c req-6089af15-9250-4bad-bed5-b7cd1af59260 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:17.302754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1e5f18a7-3548-4084-bd6e-c868e7acd24c req-6089af15-9250-4bad-bed5-b7cd1af59260 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:17.323664 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1e5f18a7-3548-4084-bd6e-c868e7acd24c req-6089af15-9250-4bad-bed5-b7cd1af59260 service nova] Creating event network-vif-deleted:cd8b17df-0287-4ba8-853a-900c00666a2d for instance 0c325860-d8e8-44bb-8e08-75b11de33e34 on n-h1-828148-1 Mar 29 02:35:17.330477 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1e5f18a7-3548-4084-bd6e-c868e7acd24c req-6089af15-9250-4bad-bed5-b7cd1af59260 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052119 Mar 29 02:35:17.331649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2530/4848] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:17.942498 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:35:18.129296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:18.130648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:18.146736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:18.148483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:18.149560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:18.152875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:18.153913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:18.171670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d7dc61ad-80b6-4954-8906-617acd3572bb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 1.019590 Mar 29 02:35:18.174707 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2319/4849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:17 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:18.188099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:18.188718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:18.204220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:18.205189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:18.207965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:18.208674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:18.363482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:18.363482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:18.363482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lazy-loading 'fault' on Instance uuid 0c325860-d8e8-44bb-8e08-75b11de33e34 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:35:18.648688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a1e5a10b3b4cceb353e924db8a940d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c01d2df74242cfa4d52436c674a9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:18.666335 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29587f73-0205-44db-82b1-97ee5d6f6426 tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 200 len: 1313 microversion: 2.1 time: 0.486053 Mar 29 02:35:18.670546 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2320/4850] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:18 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:18.775519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:18.792498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:18.796268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:18.799629 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8fe616bc-d8a3-4401-b7c3-d7ea3e074c48 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.675343 Mar 29 02:35:18.800768 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2531/4851] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:18 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:19.198024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:19.198652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:19.214691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.215148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:19.218384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.218384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:19.285437 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51408. Mar 29 02:35:19.685783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:19.686387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] [instance: 0c325860-d8e8-44bb-8e08-75b11de33e34] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:19.699638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.700083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:19.701502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.701931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:19.823372 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] HTTP exception thrown: Instance 0c325860-d8e8-44bb-8e08-75b11de33e34 could not be found. Mar 29 02:35:19.830807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] Returning 404 to user: Instance 0c325860-d8e8-44bb-8e08-75b11de33e34 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:35:19.832263 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2da2dcf8-dab2-4ac0-857e-41ad0c60ba8f tempest-ServerMetadataNegativeTestJSON-1339183161 tempest-ServerMetadataNegativeTestJSON-1339183161-project] 10.222.0.36 "GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34" status: 404 len: 111 microversion: 2.1 time: 0.150360 Mar 29 02:35:19.836883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2532/4852] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:19 2022] GET /compute/v2.1/servers/0c325860-d8e8-44bb-8e08-75b11de33e34 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:35:19.844503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:19.845372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:19.864608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.864608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:19.864608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:19.865619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:20.100127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:20.112783 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f27fac0-07af-45d8-8a4e-9a8169246e9a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.925208 Mar 29 02:35:20.113621 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2321/4853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:19 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:20.238012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:20.248376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:20.250207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:20.251494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-79cf1fea-c64b-4c22-8edc-2350ba1e9bf3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1741 microversion: 2.20 time: 0.413463 Mar 29 02:35:20.264907 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2533/4854] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:19 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1741 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:21.132657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:21.133944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:21.148285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:21.149014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:21.150157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:21.151439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:21.269779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:21.271977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:21.286669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:21.290345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:21.291382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:21.301099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:21.770140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:21.792248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:21.796932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:21.808131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3d017bf-2cbc-48d6-981f-eb7dc51bbe3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.537634 Mar 29 02:35:21.808131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2534/4855] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:21 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:22.077023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:22.089956 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0586ca4-f89a-4f48-a5cb-6bf8ec01b007 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.961327 Mar 29 02:35:22.091073 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2322/4856] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:21 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:22.827449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:22.828816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:22.844811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:22.844811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:22.844811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:22.844811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:23.112080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:23.113362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:23.126487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:23.130299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:23.131449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:23.133379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:23.204563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:23.217958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:23.220477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:23.222677 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-79c8013f-1c59-48ce-9c86-5b13364e5aa6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.403763 Mar 29 02:35:23.224373 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2535/4857] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:22 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:23.967853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:23.979783 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c6b8f52-2d7e-4e0e-a08e-a1ea341815bc tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.871711 Mar 29 02:35:23.983095 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2323/4858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:23 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:24.242262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:24.242871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:24.256090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:24.256889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:24.261003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:24.261003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:24.998662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:24.999909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:25.020169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:25.026087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:25.027169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:25.028133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:25.236401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:25.253303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:25.259451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:25.281050 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-05d8d35b-cd9a-4387-996d-c1c9415363cf tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.042213 Mar 29 02:35:25.283185 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2536/4859] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:24 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:25.838763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:25.855718 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-102a9682-b60d-4c15-a4e7-da63bc5c3a99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 0.861030 Mar 29 02:35:25.860184 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2324/4860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:24 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:26.300164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:26.300868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:26.311273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:26.328237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:26.328365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:26.329505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:26.883016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:26.885988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:26.899113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:26.901497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:26.903313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:26.917545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:26.988685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:26.998223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:27.013772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:27.015035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de676d33-872e-4463-a63c-5ad8b6ba66ba tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.718792 Mar 29 02:35:27.019268 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2537/4861] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:26 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:28.029667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1557735495", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:28.136270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:28.147484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:35:28.147910 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67c8cee6-4c3c-4843-9165-8273d5567d09 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 1.275026 Mar 29 02:35:28.148275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:35:28.148506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2325/4862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:26 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:28.148915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:35:28.149426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:35:28.149912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:35:28.167685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-34847188-a486-4529-9ab9-bd13d2c9b801 req-4caffeb4-e6f7-4a69-9763-9b5505c1ddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718b000c-5142-4e90-9015-b5ef1e9c8f20", "name": "network-vif-plugged", "status": "completed", "tag": "e58e0ba9-865c-4c17-9ed7-23d36b2aeba0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:28.171633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:28.172473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:28.175508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:28.176274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:28.180468 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:28.180468 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:28.194783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-34847188-a486-4529-9ab9-bd13d2c9b801 req-4caffeb4-e6f7-4a69-9763-9b5505c1ddd5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:28.197377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-34847188-a486-4529-9ab9-bd13d2c9b801 req-4caffeb4-e6f7-4a69-9763-9b5505c1ddd5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:28.234720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Getting quotas for project 915eebe4aa27479dbf0ea71567f85152. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:35:28.238538 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-34847188-a486-4529-9ab9-bd13d2c9b801 req-4caffeb4-e6f7-4a69-9763-9b5505c1ddd5 service nova] Creating event network-vif-plugged:e58e0ba9-865c-4c17-9ed7-23d36b2aeba0 for instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 on n-h2-828148-1 Mar 29 02:35:28.250984 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-34847188-a486-4529-9ab9-bd13d2c9b801 req-4caffeb4-e6f7-4a69-9763-9b5505c1ddd5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095515 Mar 29 02:35:28.252446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2326/4863] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:28.259210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Getting quotas for user de48307409984d918e91bb4f71481376 and project 915eebe4aa27479dbf0ea71567f85152. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:35:28.272628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:28.273376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:28.284306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:28.284782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:28.285598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:28.286039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:28.336889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:35:28.348246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:35:28.516587 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-528b6693-1203-4672-aa79-cd71ee1ca926 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.277253 Mar 29 02:35:28.535129 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2538/4864] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:35:28.539875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:28.562858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:28.740036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:28.754455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:28.759841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:28.769599 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6e05cacf-5c18-4f27-9072-d80edbda5352 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 200 len: 1278 microversion: 2.47 time: 0.224804 Mar 29 02:35:28.770248 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2539/4865] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:28 2022] GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 1278 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:29.119055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1165646572", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": "none"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:29.298031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:35:29.300571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:35:29.301251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:35:29.303403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:35:29.303403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:35:29.332881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:29.336023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:29.343338 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:35:29.349778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:29.351095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:29.410424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:29.427936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:29.430041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Getting quotas for project 915eebe4aa27479dbf0ea71567f85152. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:35:29.433672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:29.438318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Getting quotas for user de48307409984d918e91bb4f71481376 and project 915eebe4aa27479dbf0ea71567f85152. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:35:29.440588 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c5b822a-bdac-46e3-bc62-31541d8d44ac tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.179831 Mar 29 02:35:29.444543 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2327/4866] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:28 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:29.456347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:29.461318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:29.480092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:29.483066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:29.485014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:29.485625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:29.486169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:35:29.491003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:35:30.059497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-645e8e62-87ca-4308-ad0d-75cb5f225c33 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.946410 Mar 29 02:35:30.061259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2540/4867] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 29 02:35:30.073451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15c786c8-ddee-49f3-b1b3-0c2d735eff4d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:30.074955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15c786c8-ddee-49f3-b1b3-0c2d735eff4d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:30.200580 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15c786c8-ddee-49f3-b1b3-0c2d735eff4d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "PUT /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 992 microversion: 2.47 time: 0.131620 Mar 29 02:35:30.224236 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2541/4868] 10.222.0.36 () {62 vars in 1296 bytes} [Tue Mar 29 02:35:30 2022] PUT /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 992 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:35:30.243893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:30.248295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:30.358276 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 51692. Mar 29 02:35:30.491298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:30.509613 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cfe7361b-b1f6-484f-8486-2bb519a2c94b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1317 microversion: 2.1 time: 1.062603 Mar 29 02:35:30.510944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:30.511186 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2328/4869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:29 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1317 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:30.520192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:30.524019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:30.533094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:30.539217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:30.543456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:30.543681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-383e2d7c-f614-4baf-80aa-64f7813c3687 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1278 microversion: 2.47 time: 0.304307 Mar 29 02:35:30.543935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:30.545259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:30.546737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2542/4870] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:30 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:30.547381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:30.678414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1345a50c-6c74-49c1-94cc-4afd58484189 req-e3bf976f-2e67-4c10-ac0a-050ffa9fa52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "name": "network-vif-plugged", "status": "completed", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:30.680626 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:30.680626 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:30.704011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1345a50c-6c74-49c1-94cc-4afd58484189 req-e3bf976f-2e67-4c10-ac0a-050ffa9fa52d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:30.706472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1345a50c-6c74-49c1-94cc-4afd58484189 req-e3bf976f-2e67-4c10-ac0a-050ffa9fa52d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:30.751385 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1345a50c-6c74-49c1-94cc-4afd58484189 req-e3bf976f-2e67-4c10-ac0a-050ffa9fa52d service nova] Creating event network-vif-plugged:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:35:30.764097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1345a50c-6c74-49c1-94cc-4afd58484189 req-e3bf976f-2e67-4c10-ac0a-050ffa9fa52d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090414 Mar 29 02:35:30.775058 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2543/4871] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:31.530506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:31.531208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:31.553819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:31.554627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:31.555879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:31.556725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:32.156610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.172587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.174728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.176206 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c5901c0-4b28-4b4e-873b-7f83da712f92 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.663773 Mar 29 02:35:32.177291 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2329/4872] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:30 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:32.182551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:32.183363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:32.231942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:32.232469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:32.233499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:32.234823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:32.529852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.540245 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a77b3cd7-e783-44c9-88b9-677548c64a14 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1505 microversion: 2.1 time: 1.015029 Mar 29 02:35:32.542219 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2544/4873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:31 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1505 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:32.569952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:32.572058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:32.589462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:32.590300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:32.591162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:32.592216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:32.632106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.646285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.651550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:32.659537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a67f3e4-34b0-4da2-833c-b0fa952f5303 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1274 microversion: 2.47 time: 0.480789 Mar 29 02:35:32.661477 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2330/4874] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:32 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1274 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:33.050893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:33.072744 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed01a27d-c208-407d-8167-3713f840e2ca tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1505 microversion: 2.1 time: 0.512240 Mar 29 02:35:33.076685 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2545/4875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:32 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:33.095021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:33.096655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:33.114515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.114515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:33.114515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.117449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:33.196651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:33.197393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:33.221789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.231377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:33.235474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.236160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:33.526212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4207ec06-dd1d-4f60-8990-0c43bbe4cee4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "PUT /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1077 microversion: 2.1 time: 0.434231 Mar 29 02:35:33.526212 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2331/4876] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:35:33 2022] PUT /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1077 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:33.546472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:33.547358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:33.568875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.569745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:33.570696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:33.571327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:34.385595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.402041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.406825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.420645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbc7dc47-2d63-443d-b55a-06b80a0720fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.215959 Mar 29 02:35:34.421285 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2546/4877] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:33 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:34.432382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:34.433490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:34.437152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.448159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7e6f963d-215a-42af-a8a8-22482f850224 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1503 microversion: 2.1 time: 0.912465 Mar 29 02:35:34.449020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2332/4878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:33 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1503 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:34.463085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:34.463085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:34.463085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:34.463085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:34.475188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:34.475188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:34.481364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:34.482238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:34.483197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:34.483791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:34.833591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.865869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.869084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:34.869084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f932909a-fa05-4f6a-8bc5-4f8ea1c75e0b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1336 microversion: 2.47 time: 0.446185 Mar 29 02:35:34.877554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2547/4879] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:34 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1336 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:35.438978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:35.439860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:35.450793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:35.451975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:35.453450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:35.454195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:35.618424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:35.634234 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9fdf4050-6c1f-4443-b943-352666e0960c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1503 microversion: 2.1 time: 1.168282 Mar 29 02:35:35.651076 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2333/4880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:34 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1503 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:35.665852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:35.674186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:35.695744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:35.699379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:35.700248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:35.705800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:35.939761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:35:35.940401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:35:35.941095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:35:35.941866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:35:35.942474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:35:36.147326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.170339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.184653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.186695 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-922302c2-7193-407a-9958-2da5e1b54c7e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.751684 Mar 29 02:35:36.192225 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2548/4881] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:35 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:36.210153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:36.211048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:36.234096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.234096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.234096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.234096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.364019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:36.393970 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.398992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.401129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.403510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.615230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e30828af-8b50-4066-b820-b8ed1016dd9e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "POST /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20/action" status: 202 len: 1109 microversion: 2.1 time: 0.962835 Mar 29 02:35:36.627230 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2334/4882] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:35:35 2022] POST /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20/action => generated 1109 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 29 02:35:36.634118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:36.635567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:36.645523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.646900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.647941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:36.648969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:36.834706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.853487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.855231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:36.856372 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb7da4bc-0a1e-4c42-98df-6b2808376e2c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1336 microversion: 2.47 time: 0.662348 Mar 29 02:35:36.873401 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2549/4883] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:36 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1336 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:37.210867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:37.212382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:37.226550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:37.227286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:37.233533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:37.241017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:37.989609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.002094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.006329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.015929 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c69ba10-3676-45b7-aa4f-1926ed897c19 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.804328 Mar 29 02:35:38.017076 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2550/4884] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:37 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:38.025448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:38.029001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:38.047013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:38.048246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:38.050146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:38.051483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:38.058983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.071190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0953d97-52a1-4ec2-b863-072050f19d40 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 1.441953 Mar 29 02:35:38.078113 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2335/4885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:36 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:38.298882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.318975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.322294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:38.325906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20da35b2-35c5-4db1-b03b-af915204a73b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1336 microversion: 2.47 time: 0.307613 Mar 29 02:35:38.328554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2551/4886] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:38 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1336 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:39.037639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:39.038367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:39.061762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.063675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:39.064737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.065490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:39.090114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:39.091355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:39.112268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.115182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:39.116191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.120579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:39.804383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:39.820226 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c66038f-62df-4730-a791-c8610638671b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.734627 Mar 29 02:35:39.828055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2552/4887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:39 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:39.847443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:39.852154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:39.878402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.878860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:39.879679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:39.880119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.119595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.129899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.132089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.133557 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd2d2fe3-4593-4e5c-a1cd-1a5c2cc55b37 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1357 microversion: 2.47 time: 0.304494 Mar 29 02:35:40.134368 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2553/4888] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:39 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:40.221012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.221012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.221012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:40.221012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a991532f-bba3-487a-a901-4ef8a4000cc2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.159651 Mar 29 02:35:40.221012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2336/4889] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:39 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:40.225505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:40.227086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:40.236401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.237185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.238341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.239047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.465265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:35:40.469359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:35:40.477845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:35:40.477845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:35:40.477845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:35:40.844083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:40.845317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:40.881489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.881936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.901814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:40.907781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.910517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.955277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.955757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:40.964558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:40.967129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:41.374872 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-678e7461-51ad-4e01-adc7-3301cbc6e8e3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "POST /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd/action" status: 202 len: 1079 microversion: 2.47 time: 1.153157 Mar 29 02:35:41.387496 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2554/4890] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:35:40 2022] POST /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd/action => generated 1079 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Mar 29 02:35:41.415419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:41.416331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:41.440934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:41.443854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:41.446438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:41.447051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:42.523842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:42.535639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c49b0653-3788-41d7-8c6c-5e092d4cc0a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 1.694361 Mar 29 02:35:42.536475 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2337/4891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:40 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:42.549097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:42.551490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:42.574102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:42.574640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:42.575506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:42.576325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:42.877720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:42.887634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:42.894423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:42.902487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ac6a1f61-6c13-459e-83ed-2adb178629a0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.361311 Mar 29 02:35:42.908365 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2338/4892] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:42 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:43.019886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:43.029905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:43.035891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:43.037108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49e3ffb4-6d5e-402e-b459-af636d605449 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.658197 Mar 29 02:35:43.037680 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2555/4893] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:41 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:43.553223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:43.554086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:43.574309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:43.574760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:43.579420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:43.579956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:43.857137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-206cc06f-66d4-41c3-9d92-95bee4fb4216 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2100663008", "availability_zone": "foo_zone"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:43.860114 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:43.860114 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:43.865116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.aggregate [None req-206cc06f-66d4-41c3-9d92-95bee4fb4216 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Generated uuid 5f52da0f-9bff-4745-b22a-3201766b7983 for aggregate {{(pid=103514) create /opt/stack/nova/nova/objects/aggregate.py:299}} Mar 29 02:35:44.006560 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-206cc06f-66d4-41c3-9d92-95bee4fb4216 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.550647 Mar 29 02:35:44.009963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2339/4894] 10.222.0.36 () {60 vars in 1163 bytes} [Tue Mar 29 02:35:43 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:44.021042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:44.021898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:44.058783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.062337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.065971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.067716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.444633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:44.459266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:44.461917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:44.463100 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7cfeb783-345a-459d-b187-560dbeb0f442 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.451903 Mar 29 02:35:44.466507 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2340/4895] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:44 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:44.478609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e3306d9-83d8-42b8-9770-8166f7fbec49 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:44.479934 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:44.479934 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:44.627963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:44.639086 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5e3306d9-83d8-42b8-9770-8166f7fbec49 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.170314 Mar 29 02:35:44.641429 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2341/4896] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:35:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:44.646969 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24b0be8c-351e-4f6a-ab6d-881da2e75d4a tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 1.093615 Mar 29 02:35:44.646969 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2556/4897] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:43 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:44.653861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:44.662209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:44.665208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:44.667301 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:44.667301 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:44.673756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.679197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.679584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.679715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.680418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.682043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.683003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.683688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:44.814956 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f077ce31-0a4f-4378-a7f0-b3bdfb7191ef tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.166287 Mar 29 02:35:44.819247 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2342/4898] 10.222.0.36 () {58 vars in 1175 bytes} [Tue Mar 29 02:35:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:44.836594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69853e08-9df3-4e0e-b20e-f49eebf235b2 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:44.837475 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:index failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:44.837475 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:44.875234 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69853e08-9df3-4e0e-b20e-f49eebf235b2 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.047514 Mar 29 02:35:44.879305 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2343/4899] 10.222.0.36 () {58 vars in 1142 bytes} [Tue Mar 29 02:35:44 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:44.889777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bfa07388-27c9-4ebb-b3ac-ddd6f818fdbd tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-828148-1"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:44.894953 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:add_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:44.894953 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:44.907206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa07388-27c9-4ebb-b3ac-ddd6f818fdbd tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:44.909037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bfa07388-27c9-4ebb-b3ac-ddd6f818fdbd tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:45.212925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:45.226591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:45.229166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:45.230833 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2410d5f1-540e-4db0-9cb9-cb63aa89d3de tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.583639 Mar 29 02:35:45.231958 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2557/4900] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:44 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:45.499898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:45.502053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:45.525919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:45.528598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:45.531699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:45.533654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:45.641884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bfa07388-27c9-4ebb-b3ac-ddd6f818fdbd tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.758689 Mar 29 02:35:45.642500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2344/4901] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:35:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:35:45.657338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-377f5a03-0add-4803-8f96-06ee44e0dcd1 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:45.658088 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:45.658088 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:35:45.687476 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-377f5a03-0add-4803-8f96-06ee44e0dcd1 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.035807 Mar 29 02:35:45.697856 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2345/4902] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:35:45 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:45.705367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:45.712723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:45.728727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:45.729432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:45.730407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:45.731059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:45.993259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.008872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.012565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.019357 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90b8208d-c2d0-4b5d-84b2-f6654914e4c3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.537717 Mar 29 02:35:46.029000 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2558/4903] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:45 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:46.034357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf070a47-948b-4fcd-a7b6-16d0daf112c9 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1816392261", "availability_zone": "foo_zone"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:46.042510 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:update failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:46.042510 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:46.233192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf070a47-948b-4fcd-a7b6-16d0daf112c9 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.201983 Mar 29 02:35:46.235191 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2559/4904] 10.222.0.36 () {60 vars in 1172 bytes} [Tue Mar 29 02:35:46 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:46.242918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.252724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f866a05-da3f-4ac5-90b3-071110b1f761 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:46.259558 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a20fdd1-1b6a-487f-af81-b2f0801831a5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1518 microversion: 2.1 time: 0.560319 Mar 29 02:35:46.261393 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:set_metadata failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:46.261393 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:46.272088 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2346/4905] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:45 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1518 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:46.290656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:46.291578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:46.306764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:46.307663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:46.308694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:46.309499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:46.391801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f866a05-da3f-4ac5-90b3-071110b1f761 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.142641 Mar 29 02:35:46.392751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2560/4906] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:35:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:46.402782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c49bd22b-143d-4fad-b725-aca07a3bc24f tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:46.405364 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:show failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:46.405364 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:46.433936 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c49bd22b-143d-4fad-b725-aca07a3bc24f tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.034708 Mar 29 02:35:46.435083 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2561/4907] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:35:46 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:46.457918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9f4df39-e07c-44c6-b5fc-3e3069dd9967 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-828148-1"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:46.459691 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:remove_host failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:46.459691 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:46.478633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9f4df39-e07c-44c6-b5fc-3e3069dd9967 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:46.479081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9f4df39-e07c-44c6-b5fc-3e3069dd9967 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:46.962819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.976514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.981797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:46.983777 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5304c709-0797-4257-9cfa-bc25295fc65b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1740 microversion: 2.20 time: 0.710318 Mar 29 02:35:46.989142 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2347/4908] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:46 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1740 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:47.039310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:47.040178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:47.058722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:47.059347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:47.060419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:47.061660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:47.115965 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9f4df39-e07c-44c6-b5fc-3e3069dd9967 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.661841 Mar 29 02:35:47.116951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2562/4909] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Mar 29 02:35:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:47.127352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f56a86c-e371-484d-baed-27dc36e3e8a2 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:47.128111 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-aggregates:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:47.128111 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:47.259907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f56a86c-e371-484d-baed-27dc36e3e8a2 tempest-TestAggregatesBasicOps-1281527296 tempest-TestAggregatesBasicOps-1281527296-project-admin] 10.222.0.36 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.136090 Mar 29 02:35:47.261241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2563/4910] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Mar 29 02:35:47 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Mar 29 02:35:47.288970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:47.292731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:47.319379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:47.321499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:47.323292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:47.324514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:47.447090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:47.462348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:47.472352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:47.478675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16987b7b-d1c7-4a24-ac65-e4cbbb6aa729 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.442969 Mar 29 02:35:47.481141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2348/4911] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:47 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:48.011562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:48.013278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:48.034721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:48.036516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:48.041896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:48.042414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:48.484937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.504191 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-985e3c03-d904-4bd2-963b-a96d3e158f77 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 1.218787 Mar 29 02:35:48.507562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2564/4912] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:47 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:35:48.515602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:48.516544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:48.525655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:48.526428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:48.527446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:48.528105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:48.816491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.828081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.830511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.831495 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e502bee-48b4-436d-bbe7-753a744e0cb3 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.320873 Mar 29 02:35:48.848768 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2565/4913] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:48 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:48.927249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.938669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.946417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:48.947590 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e892a942-d49e-49c4-9981-f61beb6d3c3a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.944351 Mar 29 02:35:48.962701 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2349/4914] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:48 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:49.525851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:49.526479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:49.547831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:49.563345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:49.569240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:49.570092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:49.854169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:49.904330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:49.904330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:49.904330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:49.904330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:49.904330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:50.095233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:50.115940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:50.118187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:50.119552 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-253cd77d-3a24-4b67-ad51-271c4d5a73f9 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.271897 Mar 29 02:35:50.133678 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2350/4915] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:49 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:50.139936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:50.140544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:50.148305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:50.149066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:50.150028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:50.150684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:50.226537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:50.237192 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-769f08d5-f74e-4d54-a6d9-46f686b2dd4e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.716281 Mar 29 02:35:50.238422 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2566/4916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:49 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:51.139404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:51.141155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:51.155745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:51.159626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:51.161794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:51.163174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:51.457174 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:35:51.481135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.491303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.500111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.505567 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2feffcd-e3a1-45c0-b0ba-801339bb55b9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 1.370271 Mar 29 02:35:51.510458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2351/4917] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:50 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:51.539769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.542285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:51.545351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:51.554296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.556520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:51.560309 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-447dd4b9-8f30-48a2-9419-456be605ab98 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.424116 Mar 29 02:35:51.562315 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2567/4918] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:51 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:51.574794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:51.585584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:51.586811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:51.588177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:52.126064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:52.142009 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-744c18e4-8d3f-4697-b94c-d06a33c78233 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.630085 Mar 29 02:35:52.143243 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2352/4919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:51 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:52.525679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:52.526849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:52.537385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:52.538047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:52.539009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:52.539594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:52.583820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:52.585033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:52.599522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:52.603612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:52.604593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:52.607997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:52.646138 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52142. Mar 29 02:35:52.993604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.005504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.007016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.017094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0883f78f-c38c-4ee4-9642-12f456b6c2af tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.437539 Mar 29 02:35:53.018283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2353/4920] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:52 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:53.131510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.142885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.144408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:53.146441 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f926c56-2032-41b5-8940-b23e0ffe321c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1736 microversion: 2.20 time: 0.624504 Mar 29 02:35:53.147039 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2568/4921] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:52 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1736 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:53.169957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:53.169957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:53.172706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:53.173190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:53.174065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:53.174522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:54.036240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:54.036882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:54.052295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:54.052745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:54.053560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:54.053993 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:54.173228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.183850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8e6aafb-c137-46c4-8a36-23b547a62a8d tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 1.025270 Mar 29 02:35:54.194208 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2354/4922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:53 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:54.199225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:54.200129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:54.208196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:54.209319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:54.213563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:54.213563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:54.259779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.288295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.292295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.298054 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1c7f4c88-f9b0-427c-83cb-2202747bbfe6 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.265425 Mar 29 02:35:54.300164 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2569/4923] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:54 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:54.692783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.713426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.715050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:54.716298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f170cd4-6c20-4575-a38d-fb4899447ffe tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1718 microversion: 2.20 time: 0.520727 Mar 29 02:35:54.728852 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2355/4924] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:54 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1718 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:55.214427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:55.214427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:55.217983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.218990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.220033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.233654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.318000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:55.318584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:55.332031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.332482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.333360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.333791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.559690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:55.570301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:55.572055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:55.573490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4b1b8ef-98ea-4619-ba86-230f14c11a5b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.259218 Mar 29 02:35:55.573690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:55.574403 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2356/4925] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:55 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:35:55.584319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-08c453ef-fece-460d-95af-f2c36c8f25a8 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.387126 Mar 29 02:35:55.585427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2570/4926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:55 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:55.737237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:55.737983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:55.752535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.753026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.754055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.754484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:55.945857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cb7447fc-f90e-43df-b3fe-4c70db6fe162 req-f5dcdf41-ff44-48a6-a597-575c101a8ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "name": "network-vif-unplugged", "status": "completed", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:55.949548 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:35:55.949548 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:35:55.965023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cb7447fc-f90e-43df-b3fe-4c70db6fe162 req-f5dcdf41-ff44-48a6-a597-575c101a8ea6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:55.969060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cb7447fc-f90e-43df-b3fe-4c70db6fe162 req-f5dcdf41-ff44-48a6-a597-575c101a8ea6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:56.026755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cb7447fc-f90e-43df-b3fe-4c70db6fe162 req-f5dcdf41-ff44-48a6-a597-575c101a8ea6 service nova] Creating event network-vif-unplugged:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:35:56.038930 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cb7447fc-f90e-43df-b3fe-4c70db6fe162 req-f5dcdf41-ff44-48a6-a597-575c101a8ea6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096634 Mar 29 02:35:56.039778 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2571/4927] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:35:56.471337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.486657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.491368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.492677 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dbddc6d9-816a-46df-9313-e865ca6990fa tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1718 microversion: 2.20 time: 0.761051 Mar 29 02:35:56.494564 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2357/4928] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:55 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1718 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:56.594101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:56.595537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:56.608985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:56.609608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:56.610873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:56.613040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:56.616061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:56.616687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:56.621431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:56.621866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:56.622644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:56.623117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:56.925410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.935493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.937082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:56.938409 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b033d9ce-7ccc-4bec-8d9f-a3d8106ae5f0 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.348813 Mar 29 02:35:56.938979 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2572/4929] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:56 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:57.140546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:57.148852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-80387a2e-83cd-4180-8079-b92cfa49d922 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.544138 Mar 29 02:35:57.158708 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2358/4930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:56 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:57.513287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:57.514573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:57.522309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.523595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:57.524566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.525205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:57.747966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:57.758228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:57.759808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:57.760984 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcc72e7f-e6df-4f22-bf84-e6faf4584f96 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1661 microversion: 2.20 time: 0.251707 Mar 29 02:35:57.765211 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2573/4931] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:57 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1661 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:57.780601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0050a33a-d14d-4de0-aa7c-1a61a07e046a"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:57.781784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:57.789042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.789493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:57.790440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.790877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:57.957301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:57.958211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:57.972713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.973431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:57.981608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:57.981608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:58.268619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:58.283117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:58.286281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:58.288622 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f5e7445-b2eb-4fc0-a310-b7b7ec94de83 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.334144 Mar 29 02:35:58.289458 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2574/4932] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:57 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:35:58.296981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:58.297899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:58.332162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:58.334894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:58.336481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:58.336938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:58.995911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:59.007795 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3831e88-f3ec-4030-a23f-11f6e166f927 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1514 microversion: 2.1 time: 0.716918 Mar 29 02:35:59.008373 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2575/4933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:35:58 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1514 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:35:59.188870 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d3c216b-a0a5-4e6c-8f21-80cbda808fad tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.412658 Mar 29 02:35:59.189761 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2359/4934] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Mar 29 02:35:57 2022] POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments => generated 188 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:35:59.307391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:35:59.318487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:59.340179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:59.348810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:59.350006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:59.352530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:59.563742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:35:59.563742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:35:59.578380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:59.580953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:59.582089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:35:59.583162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:35:59.746745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:59.757802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:59.766260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:35:59.767669 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f472dbb-9772-47b8-a0d5-25b870bfdcb4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.464807 Mar 29 02:35:59.768784 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2576/4935] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:35:59 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:00.024774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:00.027730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:00.033705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.034155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.034927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.035358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.115010 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-849e81cf-8ba0-4ca5-a61d-ccf541eead10 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/action" status: 202 len: 0 microversion: 2.20 time: 0.558109 Mar 29 02:36:00.119139 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2360/4936] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:35:59 2022] POST /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:36:00.128500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9a64da66-e252-4b95-8f75-4802275f6729 req-9a8abe7c-71d3-4844-bec9-c356618a7fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718b000c-5142-4e90-9015-b5ef1e9c8f20", "name": "network-vif-unplugged", "status": "completed", "tag": "e58e0ba9-865c-4c17-9ed7-23d36b2aeba0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:00.135241 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:00.135241 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:00.148363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9a64da66-e252-4b95-8f75-4802275f6729 req-9a8abe7c-71d3-4844-bec9-c356618a7fb5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.148536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9a64da66-e252-4b95-8f75-4802275f6729 req-9a8abe7c-71d3-4844-bec9-c356618a7fb5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.169343 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9a64da66-e252-4b95-8f75-4802275f6729 req-9a8abe7c-71d3-4844-bec9-c356618a7fb5 service nova] Creating event network-vif-unplugged:e58e0ba9-865c-4c17-9ed7-23d36b2aeba0 for instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 on n-h2-828148-1 Mar 29 02:36:00.175796 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9a64da66-e252-4b95-8f75-4802275f6729 req-9a8abe7c-71d3-4844-bec9-c356618a7fb5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054157 Mar 29 02:36:00.176963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2361/4937] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:00.182855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:00.183776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:00.193428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.194580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.195653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.196252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.325429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.335091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04d30e40-1514-42e8-ab02-54edfb2b9763 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1520 microversion: 2.1 time: 0.313949 Mar 29 02:36:00.341070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2577/4938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:00 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:00.787459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:00.788196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:00.795658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.796115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.797103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:00.797704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:00.946958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.957180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.959107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.960491 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37ce820e-6ac3-4ee0-ba1f-6cef85b13a1d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1747 microversion: 2.20 time: 0.781865 Mar 29 02:36:00.961247 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2362/4939] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:00 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1747 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:00.975072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.985728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.987810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:00.989548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2ba126a1-6dc9-4eb1-a891-e544f16bbec1 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.205790 Mar 29 02:36:01.001786 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2578/4940] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:00 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:01.353173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:01.353775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:01.366992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:01.367440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:01.368211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:01.368637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:01.694491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:01.713101 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08176384-d808-441a-b972-1c9fc365baa3 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1520 microversion: 2.1 time: 0.363325 Mar 29 02:36:01.723940 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2363/4941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:01 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:01.983671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:01.983671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:01.997770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:01.999302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:02.000473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:02.001108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:02.008228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:02.009141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:02.027196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:02.029727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:02.030777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:02.032111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:02.335753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.352032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.358166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.358166 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2eca3a7c-ba0c-4eb0-8eef-83d69e247545 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.350389 Mar 29 02:36:02.358166 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2364/4942] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:02 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:02.652598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.664942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.673808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:02.677035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6347e995-6e9d-4eee-97c2-f273a4cc3f64 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1747 microversion: 2.20 time: 0.699473 Mar 29 02:36:02.677035 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2579/4943] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:01 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1747 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:02.730796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:02.731573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:02.751507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:02.752474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:02.753397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:02.753915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:03.377849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:03.379116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:03.394698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:03.395392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:03.398248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:03.398909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:03.556158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:03.567939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:03.570094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:03.571510 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b7b8c3a-14b9-4078-aa04-8dccffbf5d1c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.199912 Mar 29 02:36:03.572249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2580/4944] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:03 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:03.693534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:03.694448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:03.702988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:03.704178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:03.705022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:03.705625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:03.870576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:03.887300 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0efee437-686f-4d18-857c-930c68e0df7f tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1520 microversion: 2.1 time: 1.160217 Mar 29 02:36:03.892530 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2365/4945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:02 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1520 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:04.201960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-588280bc-92e5-487e-b5af-b5fdb5fc3b25 req-2b61174c-ca9c-4ef9-95d8-6180d9dd6db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718b000c-5142-4e90-9015-b5ef1e9c8f20", "name": "network-vif-plugged", "status": "completed", "tag": "e58e0ba9-865c-4c17-9ed7-23d36b2aeba0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:04.203717 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:04.203717 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:04.224655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-588280bc-92e5-487e-b5af-b5fdb5fc3b25 req-2b61174c-ca9c-4ef9-95d8-6180d9dd6db6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:04.225129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-588280bc-92e5-487e-b5af-b5fdb5fc3b25 req-2b61174c-ca9c-4ef9-95d8-6180d9dd6db6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:04.248949 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-588280bc-92e5-487e-b5af-b5fdb5fc3b25 req-2b61174c-ca9c-4ef9-95d8-6180d9dd6db6 service nova] Creating event network-vif-plugged:e58e0ba9-865c-4c17-9ed7-23d36b2aeba0 for instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 on n-h2-828148-1 Mar 29 02:36:04.275030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-588280bc-92e5-487e-b5af-b5fdb5fc3b25 req-2b61174c-ca9c-4ef9-95d8-6180d9dd6db6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076537 Mar 29 02:36:04.275639 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2366/4946] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:36:04.295127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.314112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.324305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.326356 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f82ceee7-1e00-451d-b26d-bbdf06b24c63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1749 microversion: 2.20 time: 0.636062 Mar 29 02:36:04.329729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2581/4947] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:03 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1749 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:04.593353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:04.594061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:04.603786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:04.608243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:04.608243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:04.608243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:04.784407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.805134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.806942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:04.808169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fd8632ff-9a32-44ae-b987-31241427afd7 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.220944 Mar 29 02:36:04.808731 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2367/4948] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:04 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:04.909349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:04.910704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:04.919685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:04.920382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:04.921475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:04.922164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:05.351350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:05.353014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:05.361311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:05.361869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:05.363041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:05.363289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:05.557303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:05.567410 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74a075fa-c1ae-4cbf-a1b1-aa655bbd4fc4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1520 microversion: 2.1 time: 0.661808 Mar 29 02:36:05.568324 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2582/4949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:04 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1520 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:05.826696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:05.827778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:05.841526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:05.842710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:05.854209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:05.854761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:05.984644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:05.994196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:05.998741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:05.998741 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7925c00b-736a-438a-9fa2-4a186407880c tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.174582 Mar 29 02:36:05.998741 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2583/4950] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:05 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:06.048983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:06.063463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:06.065507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:06.067222 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99119686-fb37-4fe2-8f72-eedac0e1b849 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1749 microversion: 2.20 time: 0.720023 Mar 29 02:36:06.067944 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2368/4951] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:05 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1749 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:06.588872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:06.589994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:06.605611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:06.607103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:06.608558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:06.609245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.016588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:07.017224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:07.028043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.035648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.036763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.037390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.239041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.248156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.254650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.261365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0bdd5858-7237-4e47-8e9a-8800b6a46115 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.249207 Mar 29 02:36:07.262561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2369/4952] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:07 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:07.269300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:07.270598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:07.288990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.289586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.290486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.291268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.659040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.674905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-59e75926-6196-442c-bad8-441c9a3e8a85 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1505 microversion: 2.1 time: 1.092056 Mar 29 02:36:07.676587 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2584/4953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:06 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1505 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:07.681189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.692784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:07.693839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:07.711489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.711617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.711617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.711818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:07.711936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:07.712030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-762e1e76-1045-43ee-abe5-43881740c431 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.440178 Mar 29 02:36:07.712119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:07.712211 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2370/4954] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:07 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:08.285564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:08.286870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:08.294626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.295339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.296897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.297568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.479806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:08.497905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:08.503560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:08.506439 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-04333782-f910-49ae-b79d-e90202120e80 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1366 microversion: 2.47 time: 0.225245 Mar 29 02:36:08.508740 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2371/4955] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:08 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:08.606275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:08.619793 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be2b9cb1-9e09-4098-b4de-2fd1685172e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 200 len: 1505 microversion: 2.1 time: 0.931093 Mar 29 02:36:08.632167 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2585/4956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:07 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 1505 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:08.636757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:08.637307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:08.656322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.661783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.661783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.661783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.728140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:08.729385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:08.741339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.745447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.746440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:08.747045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:08.768075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:36:09.127205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-deb9d87c-f02e-4c89-8b7c-10aa5fc4f793 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 204 len: 0 microversion: 2.1 time: 0.493237 Mar 29 02:36:09.145223 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2372/4957] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:36:08 2022] DELETE /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:36:09.266014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-487712025", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "36554e6a-2a50-4d62-afdb-29cf6905975f"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:09.350926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] validate_networks() for [('36554e6a-2a50-4d62-afdb-29cf6905975f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:36:09.815746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:09.827627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:09.829498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:09.831225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2c6c6d3-4e72-4456-b2be-86eb6d2a9a0a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 1.107555 Mar 29 02:36:09.831868 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2586/4958] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:08 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:09.843571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:09.844567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:09.852594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:09.853193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:09.854135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:09.854677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:10.007693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:10.017743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:10.019931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:10.022132 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f693a9b-bc4b-4912-8f62-b1262af844d4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1372 microversion: 2.47 time: 0.188874 Mar 29 02:36:10.034716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2587/4959] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:09 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:10.850298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:10.850917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:10.875808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:10.877697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:10.879524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:10.880228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:11.077762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:36:11.078329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:36:11.078755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:36:11.079410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:36:11.080048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:36:11.096360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:11.097129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:11.102725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:11.103188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:11.148384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:11.158571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Getting quotas for user 446cf893ae6343219c5293cfcee725eb and project 1d27fcdefe5c40dd8b722f7e8bd4498b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:11.192322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:36:11.194784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:36:11.397730 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4a94d19-bf71-4167-8501-13fb75f91751 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.134899 Mar 29 02:36:11.402075 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2373/4960] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:36:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:36:11.422117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:11.425542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:11.470713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:11.474815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:11.475994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:11.479129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:11.895264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:11.904719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:11.911157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:11.919768 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-286ef224-fde6-4b14-be82-18fcc2a0eb46 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1372 microversion: 2.47 time: 0.516246 Mar 29 02:36:11.921051 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2374/4961] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:11 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1372 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:11.925753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-373626ec-ffd6-4b34-bc9a-bc98de394e96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:11.929346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-373626ec-ffd6-4b34-bc9a-bc98de394e96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:12.204689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-373626ec-ffd6-4b34-bc9a-bc98de394e96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:12.220035 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-373626ec-ffd6-4b34-bc9a-bc98de394e96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1217 microversion: 2.1 time: 0.291936 Mar 29 02:36:12.220035 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2375/4962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:11 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1217 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:12.940650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:12.942136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:12.967275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:12.969330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:12.979305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:12.980105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:13.369961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.392265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.398178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.403887 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7b9cc71-884b-4391-9bad-55f5aa617b06 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 2.557555 Mar 29 02:36:13.405030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2588/4963] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:10 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:13.441760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:13.442542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:13.460324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:13.465182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:13.470272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:13.481280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:13.779637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.796286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-478f4145-aeee-49f3-b9bc-35ef2ea4e844 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1213 microversion: 2.1 time: 0.388810 Mar 29 02:36:13.799608 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2589/4964] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:13 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1213 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:13.966990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.982436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.984630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:13.990263 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab0f3215-11b8-4823-8511-64bae4f17a01 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1372 microversion: 2.47 time: 1.054442 Mar 29 02:36:13.991338 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2376/4965] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:12 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1372 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:14.425118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:14.426465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:14.451479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:14.458260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:14.459362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:14.460047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:14.816166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:14.816962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:14.844047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:14.844706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:14.848292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:14.852213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:15.077051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:15.086029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1b2ec469-d9d2-4bd1-8c3a-f8f2b6d614d5 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1287 microversion: 2.1 time: 0.274146 Mar 29 02:36:15.086618 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2377/4966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:14 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1287 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:15.113766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:15.115205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:15.144010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:15.144010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:15.144558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:15.149182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:15.870432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:15.888175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:15.893420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:15.899416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1785c4fe-13a5-4388-9841-66962e84c481 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1357 microversion: 2.47 time: 0.792031 Mar 29 02:36:15.902517 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2378/4967] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:15 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1357 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:15.913405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cb8ee808-885d-4f99-9d8b-de45e50b4658 req-225e9d71-70f5-4c85-84e0-fd690b1ddcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "718b000c-5142-4e90-9015-b5ef1e9c8f20", "name": "network-vif-deleted", "tag": "e58e0ba9-865c-4c17-9ed7-23d36b2aeba0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:15.924614 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:15.924614 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:15.960915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cb8ee808-885d-4f99-9d8b-de45e50b4658 req-225e9d71-70f5-4c85-84e0-fd690b1ddcec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:15.962763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cb8ee808-885d-4f99-9d8b-de45e50b4658 req-225e9d71-70f5-4c85-84e0-fd690b1ddcec service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.033154 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cb8ee808-885d-4f99-9d8b-de45e50b4658 req-225e9d71-70f5-4c85-84e0-fd690b1ddcec service nova] Creating event network-vif-deleted:e58e0ba9-865c-4c17-9ed7-23d36b2aeba0 for instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 on n-h2-828148-1 Mar 29 02:36:16.048613 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cb8ee808-885d-4f99-9d8b-de45e50b4658 req-225e9d71-70f5-4c85-84e0-fd690b1ddcec service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140810 Mar 29 02:36:16.050931 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2379/4968] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:16.063766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:16.073516 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:16.073516 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:16.080198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.091430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Searching by: {'deleted': False, 'project_id': '915eebe4aa27479dbf0ea71567f85152'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:36:16.104748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:16.105265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.109923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:16.112239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.417753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:36:16.504533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.526690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.532180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.542907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-55e8cd7a-8338-4be1-8832-eb5fd16690d3 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 2.119856 Mar 29 02:36:16.543543 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2590/4969] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:14 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:16.569320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:16.572322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:16.603297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:16.606045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.627828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:16.627828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.735998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.770878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:16.773411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:16.807090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.821178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:16.977411 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1b1b5f6f-4d79-4246-9564-56f2a360780b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.925188 Mar 29 02:36:16.992498 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2380/4970] 10.222.0.36 () {60 vars in 1186 bytes} [Tue Mar 29 02:36:16 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:17.011985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:17.014335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:17.031926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:17.032568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:17.033570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:17.034177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:17.273448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:36:17.831241 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efa77261-8fa8-406c-98d0-6392b16d243a tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 204 len: 0 microversion: 2.47 time: 0.819482 Mar 29 02:36:17.831241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2381/4971] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:36:17 2022] DELETE /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:36:17.834620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:17.835576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:17.844595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:17.845404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:17.846804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:17.847434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:17.969430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:17.978723 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb690863-caec-4190-a7e0-1859ea691b62 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1275 microversion: 2.1 time: 1.434080 Mar 29 02:36:17.979862 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2591/4972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:16 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1275 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:18.017154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:18.018065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:18.050527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:18.051326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:18.052454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:18.054291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:18.381914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:18.395053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:18.396583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:18.397789 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe59224a-30db-481b-9832-7e5786d49f44 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1363 microversion: 2.47 time: 0.412350 Mar 29 02:36:18.417101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2592/4973] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:17 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1363 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:18.995258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:18.995899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:19.009707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:19.010154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:19.010962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:19.011375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:19.179740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:19.215254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:19.239743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:19.245772 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b5290cc-2814-4673-9d9d-e3a4fac167fb tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 1.417684 Mar 29 02:36:19.252791 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2382/4974] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:17 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:19.423224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:19.425887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:19.465247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:19.467483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:19.476560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:19.477403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:19.620768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:19.650061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-08143048-04f9-4d89-8bcd-7c8529d1736e tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1275 microversion: 2.1 time: 0.658347 Mar 29 02:36:19.656547 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2593/4975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:18 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1275 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:20.157586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.173770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.175772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.178286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cba3eadb-2bd5-41fd-b510-60fb171b9d72 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1363 microversion: 2.47 time: 0.764898 Mar 29 02:36:20.181347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2383/4976] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:19 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1363 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:20.270622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:20.271955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:20.283795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:20.286195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:20.287235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:20.290822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:20.668105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:20.669295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:20.694758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:20.695980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:20.706323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:20.708176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:20.848865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.868798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.878720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:20.887300 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-37b40e76-3de4-46a0-b84d-9d668613482f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.618806 Mar 29 02:36:20.892188 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2594/4977] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:20 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:21.201202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:21.202280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:21.219388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:21.222469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:21.224736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:21.225386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:21.455619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:21.459134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:21.459876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lazy-loading 'fault' on Instance uuid 3e4ece3c-ba39-449c-a606-f373cfe3abbd {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:36:21.774865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:21.790742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:21.798392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:21.811737 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1411fe41-26d3-4e0f-818a-afa97606169d tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 200 len: 1368 microversion: 2.47 time: 0.603544 Mar 29 02:36:21.811737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2595/4978] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:21 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 1368 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:21.913520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:21.914514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:21.942847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:21.946884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:21.947562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:21.948538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:21.951637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:21.959924 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8bc038e-ccc8-48cf-94ed-c8e6913f0cc6 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 1.296561 Mar 29 02:36:21.963009 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2384/4979] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:20 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:22.699497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:22.742989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:22.752770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:22.761470 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78d3bb03-8723-41b2-adce-dba36b5fee67 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.851272 Mar 29 02:36:22.765565 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2596/4980] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:21 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:22.819748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:22.820566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 3e4ece3c-ba39-449c-a606-f373cfe3abbd] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:22.839052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:22.840690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:22.849455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:22.850354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:22.985234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:22.986102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:22.986821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] HTTP exception thrown: Instance 3e4ece3c-ba39-449c-a606-f373cfe3abbd could not be found. Mar 29 02:36:22.987449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Returning 404 to user: Instance 3e4ece3c-ba39-449c-a606-f373cfe3abbd could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:22.988250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7ecf13ed-2597-4fff-8e7d-c10a5196d972 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd" status: 404 len: 111 microversion: 2.47 time: 0.173521 Mar 29 02:36:22.993655 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2385/4981] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:22 2022] GET /compute/v2.1/servers/3e4ece3c-ba39-449c-a606-f373cfe3abbd => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:36:22.999570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:23.000066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:23.003523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.004259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.005453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.011574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.027081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.040586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.041785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.042253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.179284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:36:23.503520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:23.529914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12777bd1-aec1-4a7d-a261-7b978653f713 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 0.547820 Mar 29 02:36:23.539904 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2597/4982] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:22 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:23.783700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:23.784469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:23.799795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-393703b8-b011-4594-a148-0e21b530aed4 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "DELETE /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 204 len: 0 microversion: 2.47 time: 0.804908 Mar 29 02:36:23.803639 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2386/4983] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:36:22 2022] DELETE /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:36:23.808409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.808896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.813000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:23.813000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:23.813237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.813237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.831403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.838043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:23.839212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:23.841417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:24.258875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.278907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.280792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.282229 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-430db330-6d5e-4843-9008-6eec15533974 tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 200 len: 1363 microversion: 2.47 time: 0.477098 Mar 29 02:36:24.294087 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2387/4984] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:23 2022] GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 1363 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:24.299591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: .version_select at 0x7f8717e55a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1428311122"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:24.369265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:24.392746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:24.646216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.662742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.664235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:24.689351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c37e1e44-ead7-42ee-89e3-05748ccb6e4a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.886061 Mar 29 02:36:24.690003 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2598/4985] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:23 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:24.720398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:24.729545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:24.778528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:24.778528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:24.778528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:24.778528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.285188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:25.320112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:25.377336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8676f8b-501a-4dc5-83b7-8f6925cc18e3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.080590 Mar 29 02:36:25.384181 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2388/4986] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:36:24 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:25.389264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:25.390565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:25.408194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:25.409299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.412242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:25.413109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.715103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:25.735707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:25.737579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:25.757680 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94200900-f7e6-4480-9ae9-596f7e7336dc tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 200 len: 1363 microversion: 2.47 time: 0.353596 Mar 29 02:36:25.760806 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2389/4987] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:25 2022] GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:25.775343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9df9d6f4-345c-4bc0-8471-e19c2b87e32b req-8e40f0fd-8e38-4bb9-b2f2-9bcc86ce501a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26", "tag": "70c8307a-0e55-47c9-8550-87c2f93d6a19"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:25.776954 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:25.776954 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:25.806555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9df9d6f4-345c-4bc0-8471-e19c2b87e32b req-8e40f0fd-8e38-4bb9-b2f2-9bcc86ce501a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:25.807130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9df9d6f4-345c-4bc0-8471-e19c2b87e32b req-8e40f0fd-8e38-4bb9-b2f2-9bcc86ce501a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.832090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9df9d6f4-345c-4bc0-8471-e19c2b87e32b req-8e40f0fd-8e38-4bb9-b2f2-9bcc86ce501a service nova] Creating event network-changed:70c8307a-0e55-47c9-8550-87c2f93d6a19 for instance 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 on n-h2-828148-1 Mar 29 02:36:25.839822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9df9d6f4-345c-4bc0-8471-e19c2b87e32b req-8e40f0fd-8e38-4bb9-b2f2-9bcc86ce501a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075601 Mar 29 02:36:25.841102 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2390/4988] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:25.851163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:25.852544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:25.865439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:25.868283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:25.869141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.870685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:25.871679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:25.875003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d9a55bf7-663a-46d5-8f3d-41e1f92ca921 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 1.168027 Mar 29 02:36:25.881720 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2599/4989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:24 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:26.291037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:26.306081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:26.306081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:26.306081 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99fad367-60ee-4a34-8288-334dec2e1661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.462121 Mar 29 02:36:26.306081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2391/4990] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:25 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:26.779602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:26.780235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:26.791088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:26.791547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:26.797197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:26.797849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:26.907551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:26.908205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:26.912441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:26.912975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:26.913506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lazy-loading 'fault' on Instance uuid 278c7df6-bca7-4741-9002-82e82b482da7 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:36:26.931657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:26.932100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:26.932914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:26.942220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:27.083112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:27.096330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:27.101815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de48307409984d918e91bb4f71481376', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915eebe4aa27479dbf0ea71567f85152', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:27.104881 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-218eb97e-6794-44ee-bcd9-2fc37b4d6dce tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 200 len: 1368 microversion: 2.47 time: 0.328748 Mar 29 02:36:27.108261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2600/4991] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:26 2022] GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:27.323985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:27.325567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:27.335371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:27.336410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:27.337472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:27.338145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:27.530121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:27.541066 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86e32953-1e15-4d2d-8a30-e98e6ed4f374 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 0.641040 Mar 29 02:36:27.545946 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2392/4992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:26 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:27.800365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: .version_select at 0x7f8724233c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1841528173"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:27.832307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:27.840267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:28.033663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:28.040369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:28.057207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4b8bc09-2d05-4c88-bb2b-6729d9d15886 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.513788 Mar 29 02:36:28.064591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2393/4993] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:36:27 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:28.126625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:28.127631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] [instance: 278c7df6-bca7-4741-9002-82e82b482da7] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:28.136658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:28.137648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:28.138769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:28.139467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:28.277180 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] HTTP exception thrown: Instance 278c7df6-bca7-4741-9002-82e82b482da7 could not be found. Mar 29 02:36:28.278479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] Returning 404 to user: Instance 278c7df6-bca7-4741-9002-82e82b482da7 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:28.279407 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e997584-fd53-4e2f-8a52-0b550e58a46b tempest-ServerShowV247Test-568691675 tempest-ServerShowV247Test-568691675-project] 10.222.0.36 "GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7" status: 404 len: 111 microversion: 2.47 time: 0.157164 Mar 29 02:36:28.280873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2394/4994] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:28 2022] GET /compute/v2.1/servers/278c7df6-bca7-4741-9002-82e82b482da7 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:36:28.424369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:28.435848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:28.442642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:28.444299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-92a77258-a9d9-473f-ae7a-357503969ec5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 1.124415 Mar 29 02:36:28.456983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2601/4995] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:27 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:28.558450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:28.559160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:28.566844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:28.567295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:28.568203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:28.568849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:29.001361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:29.019817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c30c85fa-2eff-4094-8be2-f5af2882307b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 0.460283 Mar 29 02:36:29.019817 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2395/4996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:28 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:29.464206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:29.465395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:29.474837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:29.475551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:29.476709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:29.477343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:30.036694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:30.037346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:30.047312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:30.048003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:30.049117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:30.049708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:30.082788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:30.093210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:30.095181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:30.096538 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1beaa71b-6a88-4a86-89b0-35ca43a3a85a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.637103 Mar 29 02:36:30.097667 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2602/4997] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:29 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:30.395204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:30.407359 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67401573-1722-4088-b5e1-5ec3fb1523de tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 0.376707 Mar 29 02:36:30.409042 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2396/4998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:30 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:31.115149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:31.115812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:31.123100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:31.123548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:31.124790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:31.125242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:31.443914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:31.443914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:31.443914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:31.443914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9b8023d5-1d37-4532-9d3d-50fcc69cf5b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.254124 Mar 29 02:36:31.443914 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2603/4999] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:31 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:31.444517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:31.780077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:31.789739 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-73c9385f-2805-457d-9e8c-085cd4712186 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 0.368395 Mar 29 02:36:31.790311 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2397/5000] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:31 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:32.305216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-999056438", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "1d9c2743-68ce-4830-a683-a1feab4ff652"}], "key_name": "tempest-TestNetworkBasicOps-1428311122", "security_groups": [{"name": "tempest-secgroup-smoke-740271134"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:32.496790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37cbb2fe-a717-4bf9-9a57-de35cf70e9c5 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Action: 'create', calling method: .version_select at 0x7f8724d4d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1393829752"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:32.587318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] validate_networks() for [('1d9c2743-68ce-4830-a683-a1feab4ff652', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:36:33.458336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37cbb2fe-a717-4bf9-9a57-de35cf70e9c5 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.125885 Mar 29 02:36:33.458897 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2398/5001] 10.222.0.36 () {60 vars in 1154 bytes} [Tue Mar 29 02:36:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1127 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 29 02:36:33.463344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:33.463938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:33.474449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.475285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.476208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.476644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.781982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:36:33.782611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:36:33.783132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:36:33.784105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:36:33.784765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:36:33.806163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.806706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.809919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.810693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.843832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:33.853521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:33.859693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:33.863296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:33.864495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b945e0b-2966-42b4-a96a-cd65e3a76f90 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.404585 Mar 29 02:36:33.864785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:33.868181 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2399/5002] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:33 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:33.878626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d9520bcc-8b8d-47e9-a4ef-dd12ac7d0f23 req-c19999d2-4b97-4e32-9f62-88300cf98f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26", "name": "network-vif-plugged", "status": "completed", "tag": "70c8307a-0e55-47c9-8550-87c2f93d6a19"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:33.884665 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:33.884665 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:33.889808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:36:33.889808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:36:33.905964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d9520bcc-8b8d-47e9-a4ef-dd12ac7d0f23 req-c19999d2-4b97-4e32-9f62-88300cf98f91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.907111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d9520bcc-8b8d-47e9-a4ef-dd12ac7d0f23 req-c19999d2-4b97-4e32-9f62-88300cf98f91 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.936414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d9520bcc-8b8d-47e9-a4ef-dd12ac7d0f23 req-c19999d2-4b97-4e32-9f62-88300cf98f91 service nova] Creating event network-vif-plugged:70c8307a-0e55-47c9-8550-87c2f93d6a19 for instance 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 on n-h2-828148-1 Mar 29 02:36:33.944661 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d9520bcc-8b8d-47e9-a4ef-dd12ac7d0f23 req-c19999d2-4b97-4e32-9f62-88300cf98f91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074444 Mar 29 02:36:33.945561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2400/5003] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:33.955980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:33.959780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:33.978421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.978878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:33.979654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:33.980083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:34.105282 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a6f52c79-bea6-48b1-9a03-859ff09b4c25 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.804444 Mar 29 02:36:34.109138 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2604/5004] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:36:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:36:34.118881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-944b7c35-f129-4c92-8ac5-74e5e7534d4d tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8717e79b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:34.324814 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-944b7c35-f129-4c92-8ac5-74e5e7534d4d tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 200 len: 345 microversion: 2.1 time: 0.208932 Mar 29 02:36:34.324814 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2605/5005] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:34 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:34.324814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-758292ac-8e04-40ab-94cf-409a263a71d8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:34.325148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-758292ac-8e04-40ab-94cf-409a263a71d8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:34.486957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-758292ac-8e04-40ab-94cf-409a263a71d8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:34.494474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-758292ac-8e04-40ab-94cf-409a263a71d8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1248 microversion: 2.1 time: 0.173448 Mar 29 02:36:34.495715 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2606/5006] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:34 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1248 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:34.886995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:34.887605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:34.905267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:34.906288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:34.907651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:34.908500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:35.098513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:35.111388 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-108b3a80-bd72-4e96-81b4-3d5f72459a3c tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1317 microversion: 2.1 time: 1.160160 Mar 29 02:36:35.112575 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2401/5007] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:33 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1317 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:35.159003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:35.178459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:35.179901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:35.183971 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5ec990b-b91d-41ca-aab4-27760adc2db5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.300610 Mar 29 02:36:35.185118 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2607/5008] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:34 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:36:35.331639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aafaef41-0fb4-41d3-91d5-2f95434cd74b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f872405dd30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:35.434802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aafaef41-0fb4-41d3-91d5-2f95434cd74b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 200 len: 346 microversion: 2.1 time: 0.107168 Mar 29 02:36:35.435440 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2402/5009] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:35 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 346 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:35.446911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6cc93dba-5c75-4eba-a564-c209b8202a91 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Action: 'create', calling method: .version_select at 0x7f87240d5ca0>, body: {"snapshot": {"volume_id": "f1bc28e7-6832-4289-99da-70090ad1c6a5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2145585631"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:35.512384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:35.513423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:35.540890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:35.543356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:35.544733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:35.548233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:35.977947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:35.995939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af6bb018-5f5e-40c0-bd51-d9b9eff77474 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1252 microversion: 2.1 time: 0.487885 Mar 29 02:36:36.000319 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2403/5010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:35 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1252 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:36.130152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:36.130824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:36.141213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.141661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.142423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.151210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.316131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6cc93dba-5c75-4eba-a564-c209b8202a91 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.872577 Mar 29 02:36:36.322084 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2608/5011] 10.222.0.36 () {60 vars in 1161 bytes} [Tue Mar 29 02:36:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:36.323077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-794bf35b-238c-4e7f-abae-1622f8ed87b2 req-b999df0c-ee55-42fb-be50-e1adf9a52700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "name": "network-vif-plugged", "status": "completed", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:36.325223 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:36.325223 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:36:36.342366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-794bf35b-238c-4e7f-abae-1622f8ed87b2 req-b999df0c-ee55-42fb-be50-e1adf9a52700 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.342366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-794bf35b-238c-4e7f-abae-1622f8ed87b2 req-b999df0c-ee55-42fb-be50-e1adf9a52700 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.361884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-794bf35b-238c-4e7f-abae-1622f8ed87b2 req-b999df0c-ee55-42fb-be50-e1adf9a52700 service nova] Creating event network-vif-plugged:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:36:36.367133 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-794bf35b-238c-4e7f-abae-1622f8ed87b2 req-b999df0c-ee55-42fb-be50-e1adf9a52700 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047924 Mar 29 02:36:36.368327 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2609/5012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:36.374129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:36.375728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:36.387406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.388243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.389318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.390684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.818967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:36.830745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f39974a-9895-46dd-8b7a-ca82a47bbd64 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1505 microversion: 2.1 time: 0.705586 Mar 29 02:36:36.832200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2404/5013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:36 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:36.855898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fb8da05a-4fa9-4cfc-9662-cc1b470059f1 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724233c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:36.952138 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fb8da05a-4fa9-4cfc-9662-cc1b470059f1 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 200 len: 287 microversion: 2.1 time: 0.117847 Mar 29 02:36:36.953763 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2405/5014] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:36 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 287 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:36.959829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:36.960664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:36.972196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.973220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:36.974861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:36.975482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:37.099954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:37.124277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:37.124277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:37.124277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cde4a4c6-ae05-40d3-98ce-1898aeac41a4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.754380 Mar 29 02:36:37.125151 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2610/5015] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:36 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:37.129983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d026f07a-c55a-4c53-b358-e8868a369a25 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724bf9af0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:37.183340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d026f07a-c55a-4c53-b358-e8868a369a25 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.057028 Mar 29 02:36:37.184374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2611/5016] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Mar 29 02:36:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:37.193097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:37.194207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:37.204704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:37.205822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:37.206857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:37.207683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:37.347702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:37.356805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef2cafcc-9fe3-4067-b769-15577c9cee60 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1308 microversion: 2.1 time: 0.170650 Mar 29 02:36:37.359795 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2612/5017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:37 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:37.373149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a943ad2-563c-4a22-b44a-0cb4d573c389 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8717ed6310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:37.427033 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a943ad2-563c-4a22-b44a-0cb4d573c389 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 200 len: 287 microversion: 2.1 time: 0.065243 Mar 29 02:36:37.428101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2613/5018] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:37 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:38.105083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:38.113697 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0aeac048-f3c9-4c0e-b993-27c760569e73 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1505 microversion: 2.1 time: 1.158471 Mar 29 02:36:38.114960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2406/5019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:36 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1505 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:38.131211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:38.132599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:38.143628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:38.144176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.144329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:38.144629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.145424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.146311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.165117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.165569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.179389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.181242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.413567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1182ef94-6aaf-4c6a-8f9b-49c66e857d11 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "PUT /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1077 microversion: 2.1 time: 0.285296 Mar 29 02:36:38.415342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2614/5020] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:36:38 2022] PUT /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1077 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:38.439027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:38.439751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:38.458388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.460737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.462162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.464217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.628578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:38.639378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbe1ced8-0638-467a-85a2-9901367f573b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1306 microversion: 2.1 time: 0.211191 Mar 29 02:36:38.641802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2615/5021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:38 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1306 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:38.647250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:38.648235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:38.657452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.658234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.659699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:38.660494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:38.903690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:38.912134 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae00caaf-241a-4b34-8dfe-aad6e57bea99 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1503 microversion: 2.1 time: 0.269248 Mar 29 02:36:38.912916 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2616/5022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:38 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:38.927256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7804331-4620-49ef-90b0-5cdd53691dae tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724bad0d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:38.990244 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7804331-4620-49ef-90b0-5cdd53691dae tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 200 len: 288 microversion: 2.1 time: 0.066232 Mar 29 02:36:38.990903 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2617/5023] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:38 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:38.996476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:38.997209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:39.006206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.006744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.007584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.008360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.088343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:39.104814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:39.106410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:39.107535 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-afa214e8-3179-473a-b1ae-f0cb6cd61a5a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.968637 Mar 29 02:36:39.113986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2407/5024] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:38 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:39.125755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e799e42d-7b66-4a87-a81d-104120dae45b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f872436da60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:39.367726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e799e42d-7b66-4a87-a81d-104120dae45b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 202 len: 0 microversion: 2.1 time: 0.252456 Mar 29 02:36:39.368446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2408/5025] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Mar 29 02:36:39 2022] DELETE /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:36:39.377399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5550bbba-1a79-44b8-a49e-c9a6c5663e2b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f872436d310>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:39.462628 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5550bbba-1a79-44b8-a49e-c9a6c5663e2b tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 200 len: 287 microversion: 2.1 time: 0.089574 Mar 29 02:36:39.463195 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2409/5026] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:39 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:36:39.560814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:39.573195 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a54b4109-0567-492e-8e09-f740d42026e9 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1503 microversion: 2.1 time: 0.580908 Mar 29 02:36:39.574199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2618/5027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:38 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1503 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:39.591019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:39.592187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:39.606574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.611365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.614078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.614078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.660107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:39.660785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:39.677090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.678151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.681240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.681877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.949995 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1115b21f-608e-4b18-9992-00b47814cff0 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "PUT /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1079 microversion: 2.1 time: 0.363695 Mar 29 02:36:39.954913 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2410/5028] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 02:36:39 2022] PUT /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1079 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:39.966755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:39.967351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:39.994273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.994706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:39.997503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:39.999092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:40.298740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:40.308593 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a8b7542-2644-4a86-bbc0-057f787c6c11 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.654509 Mar 29 02:36:40.311278 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2619/5029] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:39 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:40.317952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:40.322531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:40.337477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:40.341454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:40.342531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:40.345453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:40.645546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:40.663364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:40.669336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:40.673920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc173453-bcb9-43a5-9dfc-21aabc32f113 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1805 microversion: 2.20 time: 0.359291 Mar 29 02:36:40.677727 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2620/5030] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:40 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1805 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:40.687574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a7f5a26-55ff-4ce8-af7e-70ca75d1d196 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724b09550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:40.776310 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a7f5a26-55ff-4ce8-af7e-70ca75d1d196 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 200 len: 287 microversion: 2.1 time: 0.095252 Mar 29 02:36:40.776897 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2621/5031] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:40 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:40.879599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:40.892499 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2bb8f411-3630-4481-a1a2-e002a9b06ab4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1505 microversion: 2.1 time: 0.929347 Mar 29 02:36:40.894145 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2411/5032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:39 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:40.910881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:40.913197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:40.920053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:40.920756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:40.922330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:40.924455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.188723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:41.198947 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8258426e-b332-4c3e-8c8a-d944391536cb tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1505 microversion: 2.1 time: 0.293905 Mar 29 02:36:41.201740 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2622/5033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:40 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1505 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:41.217020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:41.217331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:41.229242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.229677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.234532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.234697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.307375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:36:41.328550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:41.329496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:41.348480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.349324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.350740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.351613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.770550 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dbec6e5-6c72-431a-ba07-a78ea802a357 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 204 len: 0 microversion: 2.1 time: 0.557125 Mar 29 02:36:41.772500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2412/5034] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:36:41 2022] DELETE /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:36:41.776792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:41.780675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:41.798520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.798982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.799780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.800217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.879249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:41.894801 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26e15892-b70e-4ae8-afb3-4eef99d56e46 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.569644 Mar 29 02:36:41.906909 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2623/5035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:41 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:41.914557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:41.917509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:41.929257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.930365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:41.931898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:41.932622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:42.027600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:36:42.235397 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Instance is already in deleting state, ignoring this request Mar 29 02:36:42.236210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56f2f8e8-b919-4291-9b7f-cf34004c1b96 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 204 len: 0 microversion: 2.1 time: 0.327902 Mar 29 02:36:42.236889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2624/5036] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:36:41 2022] DELETE /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:36:42.244287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8cd03ecb-74ec-4dca-a0d8-7fdb92bc18cd tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8725ec6a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:42.320020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-8cd03ecb-74ec-4dca-a0d8-7fdb92bc18cd tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] HTTP exception thrown: Snapshot a6b73636-7a47-458c-a8b1-cfe754bf79a3 could not be found. Mar 29 02:36:42.321130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8cd03ecb-74ec-4dca-a0d8-7fdb92bc18cd tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Returning 404 to user: Snapshot a6b73636-7a47-458c-a8b1-cfe754bf79a3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:42.323346 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8cd03ecb-74ec-4dca-a0d8-7fdb92bc18cd tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3" status: 404 len: 111 microversion: 2.1 time: 0.081446 Mar 29 02:36:42.324798 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2625/5037] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:36:42 2022] GET /compute/v2.1/os-snapshots/a6b73636-7a47-458c-a8b1-cfe754bf79a3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:42.331922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:42.332793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:42.343525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:42.344323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:42.345777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:42.346447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:42.714429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:42.747163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:42.755854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:42.760033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18caf766-3cd2-455f-9f86-490e9e856750 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1792 microversion: 2.20 time: 0.985324 Mar 29 02:36:42.762647 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2413/5038] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:41 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1792 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:42.803140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ecc1144-183c-446f-8622-3159c2e2372a tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724464a60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:42.983148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:42.993663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e63173fb-b92c-465e-9b88-9a831ef85532 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1511 microversion: 2.1 time: 0.666975 Mar 29 02:36:43.005750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2626/5039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:42 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1511 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:43.017528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:43.018149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:43.036383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:43.036851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:43.037634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:43.038071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:43.143148 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ecc1144-183c-446f-8622-3159c2e2372a tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 202 len: 0 microversion: 2.1 time: 0.378977 Mar 29 02:36:43.143702 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2414/5040] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:36:42 2022] DELETE /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:36:43.151592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5365ebbd-3cdf-4c72-8f1b-1433dc87244e tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f87241dc430>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:43.343894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5365ebbd-3cdf-4c72-8f1b-1433dc87244e tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 200 len: 345 microversion: 2.1 time: 0.195269 Mar 29 02:36:43.345111 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2415/5041] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:43 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:36:43.812346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a8eebaa6-f557-44d5-9eff-31a30de775bc req-8a408017-a621-4343-bcef-2567dac886e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2fdcee-f948-4e39-8f07-3c6bed071962", "tag": "bc652a6a-82a0-447f-a76d-389e43a16911"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:43.814025 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:43.814025 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:43.830214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a8eebaa6-f557-44d5-9eff-31a30de775bc req-8a408017-a621-4343-bcef-2567dac886e9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:43.835837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a8eebaa6-f557-44d5-9eff-31a30de775bc req-8a408017-a621-4343-bcef-2567dac886e9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:43.862420 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a8eebaa6-f557-44d5-9eff-31a30de775bc req-8a408017-a621-4343-bcef-2567dac886e9 service nova] Creating event network-changed:bc652a6a-82a0-447f-a76d-389e43a16911 for instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 on n-h1-828148-1 Mar 29 02:36:43.894073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a8eebaa6-f557-44d5-9eff-31a30de775bc req-8a408017-a621-4343-bcef-2567dac886e9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089078 Mar 29 02:36:43.895148 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2416/5042] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:36:43.960156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:43.975792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ce8021f-d9dd-4f2f-bb88-51a7a349a485 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.966671 Mar 29 02:36:43.976654 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2627/5043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:43 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:44.011087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:44.011805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:44.031628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:44.031628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:44.031628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:44.031628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:44.357652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d2ed3a8-b9b1-4f9e-a5a8-389d89d4a212 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8717ed6550>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:44.568670 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d2ed3a8-b9b1-4f9e-a5a8-389d89d4a212 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 200 len: 345 microversion: 2.1 time: 0.215663 Mar 29 02:36:44.569616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2628/5044] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:44 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:44.993961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:44.994579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:45.004213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:45.010518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:45.010518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:45.010518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:45.417435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:45.447224 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4fe2870-aa5c-4223-bdb4-2260c761d1c3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.447061 Mar 29 02:36:45.447224 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2629/5045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:44 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:45.447224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1d55e139-ebbb-4e0b-b4fd-7f10cdd539f9 req-22289a3c-06e7-42f9-a836-b34227feab64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26", "name": "network-vif-deleted", "tag": "70c8307a-0e55-47c9-8550-87c2f93d6a19"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:45.447224 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:45.447224 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:36:45.457341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1d55e139-ebbb-4e0b-b4fd-7f10cdd539f9 req-22289a3c-06e7-42f9-a836-b34227feab64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:45.457902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1d55e139-ebbb-4e0b-b4fd-7f10cdd539f9 req-22289a3c-06e7-42f9-a836-b34227feab64 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:45.476353 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1d55e139-ebbb-4e0b-b4fd-7f10cdd539f9 req-22289a3c-06e7-42f9-a836-b34227feab64 service nova] Creating event network-vif-deleted:70c8307a-0e55-47c9-8550-87c2f93d6a19 for instance 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 on n-h2-828148-1 Mar 29 02:36:45.482001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1d55e139-ebbb-4e0b-b4fd-7f10cdd539f9 req-22289a3c-06e7-42f9-a836-b34227feab64 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042580 Mar 29 02:36:45.483242 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2630/5046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:45.495513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:45.512384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-433063db-1a23-4f8a-97ca-e1a19bf76667 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1511 microversion: 2.1 time: 1.505172 Mar 29 02:36:45.513891 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2417/5047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:44 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1511 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:45.589732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0bf62d8-bce8-4bfc-898f-013a1574432d tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8725ec6d30>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:45.772603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0bf62d8-bce8-4bfc-898f-013a1574432d tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 200 len: 345 microversion: 2.1 time: 0.194556 Mar 29 02:36:45.773960 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2631/5048] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:45 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 345 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:46.455247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:46.456061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:46.465218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:46.465986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:46.467140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:46.467645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:46.530619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:46.531879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:46.560354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:46.561027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:46.562033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:46.562914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:46.668983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:46.669588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:46.670131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lazy-loading 'fault' on Instance uuid 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:36:46.847583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446cf893ae6343219c5293cfcee725eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d27fcdefe5c40dd8b722f7e8bd4498b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:46.868933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-312cbd04-3da2-4918-aa84-895ec840dcfe tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 200 len: 1307 microversion: 2.1 time: 0.339012 Mar 29 02:36:46.870057 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2632/5049] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:46 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:46.875805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d651bbd-4b16-4912-91d5-f1329a00c0a7 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724b095e0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:46.969430 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1d651bbd-4b16-4912-91d5-f1329a00c0a7 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] HTTP exception thrown: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. Mar 29 02:36:46.970275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d651bbd-4b16-4912-91d5-f1329a00c0a7 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Returning 404 to user: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:46.970819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d651bbd-4b16-4912-91d5-f1329a00c0a7 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 404 len: 109 microversion: 2.1 time: 0.099644 Mar 29 02:36:46.974383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2633/5050] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:46 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:46.987321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-349c70fc-4ed5-40e3-a7f2-ea6650e61f78 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724bf9670>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:47.077007 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-349c70fc-4ed5-40e3-a7f2-ea6650e61f78 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] HTTP exception thrown: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. Mar 29 02:36:47.077745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-349c70fc-4ed5-40e3-a7f2-ea6650e61f78 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Returning 404 to user: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:47.079545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-349c70fc-4ed5-40e3-a7f2-ea6650e61f78 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 404 len: 109 microversion: 2.1 time: 0.098394 Mar 29 02:36:47.080262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2634/5051] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:36:46 2022] DELETE /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:36:47.088480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6acd839d-9035-4ec9-aa3f-1005ad50e0d9 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Calling method '.version_select at 0x7f8724bf9e50>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:47.180556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-6acd839d-9035-4ec9-aa3f-1005ad50e0d9 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] HTTP exception thrown: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. Mar 29 02:36:47.181192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6acd839d-9035-4ec9-aa3f-1005ad50e0d9 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] Returning 404 to user: Volume f1bc28e7-6832-4289-99da-70090ad1c6a5 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:47.182037 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6acd839d-9035-4ec9-aa3f-1005ad50e0d9 tempest-VolumesSnapshotsTestJSON-1650303427 tempest-VolumesSnapshotsTestJSON-1650303427-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5" status: 404 len: 109 microversion: 2.1 time: 0.097486 Mar 29 02:36:47.182644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2635/5052] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:36:47 2022] GET /compute/v2.1/os-volumes/f1bc28e7-6832-4289-99da-70090ad1c6a5 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:47.642376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:47.658467 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e74b34d9-8096-4a5a-84dd-e53d2b6bf3d6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 1.207554 Mar 29 02:36:47.659590 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2418/5053] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:46 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:47.893875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:47.895477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:47.906031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:47.907317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:47.908351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:47.909105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.011164 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] HTTP exception thrown: Instance 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 could not be found. Mar 29 02:36:48.012380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Returning 404 to user: Instance 70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:48.017900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44147402-0628-463a-beeb-73e916c17145 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26" status: 404 len: 111 microversion: 2.1 time: 0.127840 Mar 29 02:36:48.021527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2636/5054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:47 2022] GET /compute/v2.1/servers/70bc4c3f-04f2-4e36-bbeb-0bbd4a5e7f26 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:48.026523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:48.027441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:48.036793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.037651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.038670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.039336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.116811 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] HTTP exception thrown: Instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 could not be found. Mar 29 02:36:48.117784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Returning 404 to user: Instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:48.118872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9cae2f7-d170-4f17-8ca1-6a927b478fb4 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 404 len: 111 microversion: 2.1 time: 0.096076 Mar 29 02:36:48.119957 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2419/5055] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:36:48 2022] DELETE /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:48.129087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:48.130596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: 718b000c-5142-4e90-9015-b5ef1e9c8f20] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:48.143186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.143633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.144411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.144860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.197901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] HTTP exception thrown: Instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 could not be found. Mar 29 02:36:48.198507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Returning 404 to user: Instance 718b000c-5142-4e90-9015-b5ef1e9c8f20 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:48.199342 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b283f7d9-bebc-4ade-b94c-d0ce6d122a83 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20" status: 404 len: 111 microversion: 2.1 time: 0.074906 Mar 29 02:36:48.200975 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2637/5056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:48 2022] GET /compute/v2.1/servers/718b000c-5142-4e90-9015-b5ef1e9c8f20 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:48.215445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:48.215445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:48.220378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.221126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.222281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.222729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.286274 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] HTTP exception thrown: Instance f7b17e49-731d-4ae0-a761-6878392921c3 could not be found. Mar 29 02:36:48.288036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Returning 404 to user: Instance f7b17e49-731d-4ae0-a761-6878392921c3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:48.289343 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0fde7196-34dc-48a5-a6b3-6a162e0c1069 tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 404 len: 111 microversion: 2.1 time: 0.084430 Mar 29 02:36:48.290972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2420/5057] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:36:48 2022] DELETE /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:36:48.300119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:48.301261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] [instance: f7b17e49-731d-4ae0-a761-6878392921c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:48.312630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.313268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.314310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.314924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.381061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] HTTP exception thrown: Instance f7b17e49-731d-4ae0-a761-6878392921c3 could not be found. Mar 29 02:36:48.381894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] Returning 404 to user: Instance f7b17e49-731d-4ae0-a761-6878392921c3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:36:48.382904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ede930e-c189-4b51-b686-230234ec6f0b tempest-ServerDiskConfigTestJSON-745349128 tempest-ServerDiskConfigTestJSON-745349128-project] 10.222.0.36 "GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3" status: 404 len: 111 microversion: 2.1 time: 0.087085 Mar 29 02:36:48.384272 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2638/5058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:48 2022] GET /compute/v2.1/servers/f7b17e49-731d-4ae0-a761-6878392921c3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:36:48.679337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:48.679337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:48.684061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.684745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:48.685796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:48.686404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:49.200048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:49.209377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f2ce9b9-9589-4fb7-94bb-5707e14c0d57 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.538136 Mar 29 02:36:49.214066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2421/5059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:48 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:50.226501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:50.227129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:50.238747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:50.241006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:50.242811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:50.243712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:51.131746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:51.144240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ea706bb-a20a-401f-9b64-7dd3f2cd0a5b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.921189 Mar 29 02:36:51.147092 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2639/5060] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:50 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:51.597683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1530646333", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "d2282094-0cea-475f-bfb3-b086ac1af29f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1841528173", "security_groups": [{"name": "tempest-secgroup-smoke-40153018"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:52.072864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] validate_networks() for [('d2282094-0cea-475f-bfb3-b086ac1af29f', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:36:52.162212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:52.163449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:52.178706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:52.178706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:52.178706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:52.178706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:52.715452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:52.725332 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19e90bf7-3d5b-400f-8d18-3ec2b0596a6e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.566572 Mar 29 02:36:52.726018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2640/5061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:52 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:53.744071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:53.744909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:53.762680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:53.768548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:53.770379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:53.777442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:53.812851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:36:53.813331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:36:53.813738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:36:53.814143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:36:53.814740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:36:53.826977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:53.826977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:53.827425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:53.837427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:53.869580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:53.878497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:53.891155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:36:53.893745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:36:54.101680 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-28841531-f414-4d4f-804c-f6f71baaad40 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.505224 Mar 29 02:36:54.102534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2422/5062] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:36:51 2022] POST /compute/v2.1/servers => generated 404 bytes in 2510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:36:54.126836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-681e68bf-ba5b-4651-b9af-662a8726ac04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:54.130732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-681e68bf-ba5b-4651-b9af-662a8726ac04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:54.298627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:54.310436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d995cd0-d162-495d-b098-11df450523c5 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.570651 Mar 29 02:36:54.320140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-681e68bf-ba5b-4651-b9af-662a8726ac04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:54.336275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2641/5063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:53 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:54.337314 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-681e68bf-ba5b-4651-b9af-662a8726ac04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1267 microversion: 2.1 time: 0.211046 Mar 29 02:36:54.337314 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2423/5064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:54 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:55.329446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:55.330420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:55.342436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20f7c9fb-7c4e-4996-bcc0-e4f217f98c88 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:55.343063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20f7c9fb-7c4e-4996-bcc0-e4f217f98c88 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:55.348446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:55.348446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:55.348668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:55.349717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:55.554379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-20f7c9fb-7c4e-4996-bcc0-e4f217f98c88 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:55.569492 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20f7c9fb-7c4e-4996-bcc0-e4f217f98c88 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1267 microversion: 2.1 time: 0.230721 Mar 29 02:36:55.570384 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2424/5065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:55 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:55.783544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7752dab4-7249-4401-bc53-cf4e139fb402 req-7237a18e-7d56-49c1-9c1c-440f73a83605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2fdcee-f948-4e39-8f07-3c6bed071962", "name": "network-vif-plugged", "status": "completed", "tag": "bc652a6a-82a0-447f-a76d-389e43a16911"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:55.788180 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:36:55.788180 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:36:55.836012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7752dab4-7249-4401-bc53-cf4e139fb402 req-7237a18e-7d56-49c1-9c1c-440f73a83605 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:55.836453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7752dab4-7249-4401-bc53-cf4e139fb402 req-7237a18e-7d56-49c1-9c1c-440f73a83605 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:55.861471 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7752dab4-7249-4401-bc53-cf4e139fb402 req-7237a18e-7d56-49c1-9c1c-440f73a83605 service nova] Creating event network-vif-plugged:bc652a6a-82a0-447f-a76d-389e43a16911 for instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 on n-h1-828148-1 Mar 29 02:36:55.868937 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7752dab4-7249-4401-bc53-cf4e139fb402 req-7237a18e-7d56-49c1-9c1c-440f73a83605 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090643 Mar 29 02:36:55.869235 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2425/5066] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:36:55.945526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:55.954778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-494bc09a-55bf-4596-b37c-2078bf572850 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.629583 Mar 29 02:36:55.955417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2642/5067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:55 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:56.586632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:56.587317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:56.596193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:56.596900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:56.597862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:56.598511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:56.738722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:56.757044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f04945a1-693e-43cc-b17d-13003dee5ea6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1319 microversion: 2.1 time: 0.170920 Mar 29 02:36:56.757655 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2426/5068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:56 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:56.972333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:56.973716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:56.988274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:56.990848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:56.992731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:56.997084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:57.910336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:57.919336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6cda4a2-2638-4cf0-992d-219bf41f348d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1373 microversion: 2.1 time: 0.951442 Mar 29 02:36:57.920646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2643/5069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:56 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1373 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:57.926140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:57.927056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:57.935338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:57.935779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:57.936545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:57.937679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:57.981916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1084910648", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "590ed10e-0f9c-4778-8a32-1e2b6edddada"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:36:58.066201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] validate_networks() for [('590ed10e-0f9c-4778-8a32-1e2b6edddada', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:36:58.095025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:58.103788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-579d4ed9-301b-4324-9642-988b00149e09 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1325 microversion: 2.1 time: 0.182184 Mar 29 02:36:58.104467 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2644/5070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:57 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:36:58.935158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:58.936096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:58.946350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:58.946854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:58.947639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:58.948106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.229778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:36:59.230756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:36:59.231394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:36:59.231985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:36:59.232558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:36:59.248029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.248996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.250825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.251410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.290138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Getting quotas for project 372c705fe61848dfb53a022303b53848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:36:59.298953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Getting quotas for user b7aa1f340e7744d5a858d20ea3f64ff5 and project 372c705fe61848dfb53a022303b53848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:36:59.316826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:36:59.323390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:36:59.451548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cc9771df-5775-44ab-bdcd-232e46ebbbab tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.734030 Mar 29 02:36:59.452999 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2427/5071] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1736 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:36:59.463320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:59.464395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:59.477606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.478858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.480033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.480768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.511638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:59.528633 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0ada664a-c33f-4145-810e-fb78c07de1c6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1544 microversion: 2.1 time: 0.596859 Mar 29 02:36:59.529899 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2645/5072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:58 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1544 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:36:59.545037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:59.545894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:59.755925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:59.775607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:59.777153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:59.781899 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cb6bd397-b9ea-4358-9ae3-37724187ee62 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1259 microversion: 2.21 time: 0.246398 Mar 29 02:36:59.782502 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2646/5073] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:36:59 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:36:59.797913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:36:59.798529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:36:59.813669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.814122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.815133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:36:59.815822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:36:59.828807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:36:59.837307 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c980f80f-c517-48d9-91e1-9db290114115 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.382981 Mar 29 02:36:59.838247 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2428/5074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:59 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:00.802233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:00.807678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:00.813773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:00.815896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:00.816720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:00.817604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:00.818513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:00.825183 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9564c8fc-99bf-4041-ac0e-faa8ecb1dc5d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1544 microversion: 2.1 time: 1.031327 Mar 29 02:37:00.826045 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2647/5075] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:36:59 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1544 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:00.856676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:00.857787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:00.876221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:00.877008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:00.879027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:00.880335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:01.039992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:01.057280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:01.059708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:01.061618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ecd56704-4e0e-4b9a-b804-0d8bf1c3f2ac tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1263 microversion: 2.21 time: 0.265136 Mar 29 02:37:01.072162 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2429/5076] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:00 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1263 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:01.370730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8c8d0ea4-6f92-4158-8caa-01cebfb4113f req-2ccfd6f1-e58a-4022-8416-327b61c8a921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:01.372406 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:01.372406 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:01.390629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c8d0ea4-6f92-4158-8caa-01cebfb4113f req-2ccfd6f1-e58a-4022-8416-327b61c8a921 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:01.392457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c8d0ea4-6f92-4158-8caa-01cebfb4113f req-2ccfd6f1-e58a-4022-8416-327b61c8a921 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:01.407428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:01.417559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-33bf7b5e-f40f-4bc5-adeb-bbe1096a9c80 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.566348 Mar 29 02:37:01.417712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8c8d0ea4-6f92-4158-8caa-01cebfb4113f req-2ccfd6f1-e58a-4022-8416-327b61c8a921 service nova] Creating event network-changed:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h2-828148-1 Mar 29 02:37:01.418622 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2648/5077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:00 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:01.423664 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8c8d0ea4-6f92-4158-8caa-01cebfb4113f req-2ccfd6f1-e58a-4022-8416-327b61c8a921 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056464 Mar 29 02:37:01.424339 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2430/5078] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:37:02.080079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:02.081474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:02.090608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:02.091496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:02.092552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:02.093268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:02.315592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:02.336154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:02.338824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:02.342304 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44c5b4cf-b6db-47d6-9642-1fb06053a86f tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1311 microversion: 2.21 time: 0.264704 Mar 29 02:37:02.354052 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2649/5079] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:02 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:02.436669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:02.438362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:02.448233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:02.449076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:02.450913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:02.451667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:03.306841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:03.322013 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa673e21-7437-4030-aaaf-f574406f1fc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.889380 Mar 29 02:37:03.330390 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2431/5080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:02 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:03.362461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:03.363128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:03.370929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:03.371376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:03.372374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:03.373100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:03.508261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:03.520052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:03.521612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:03.525062 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a480fb10-0d14-45d4-aab7-acafe258e2dd tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1317 microversion: 2.21 time: 0.165323 Mar 29 02:37:03.525062 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2650/5081] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:03 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:04.345349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:04.346571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:04.355764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:04.356476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:04.357889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:04.358399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:04.540908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:04.547219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:04.552709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:04.553193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:04.553968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:04.554644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:04.855585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:04.869810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:04.871519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:04.873459 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-809117e8-6787-46ce-a8f2-63d9c1a7e3ce tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.335814 Mar 29 02:37:04.874489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2651/5082] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:04 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:05.139486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:05.148792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a5e6daa-f410-422e-842f-2cde58f863af tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.809021 Mar 29 02:37:05.149414 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2432/5083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:04 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:05.893773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:05.894496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:05.903946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:05.904491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:05.906611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:05.907173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:06.165887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:06.170230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:06.179873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:06.180329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:06.184011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:06.184509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:06.312017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:06.329132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:06.331086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:06.332610 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad37d09b-cf3e-4f95-9ab8-3c7dd40e6237 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.444297 Mar 29 02:37:06.345325 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2652/5084] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:05 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:06.906548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:06.922001 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50a90fef-8aea-4e14-a980-1864557fc919 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.758896 Mar 29 02:37:06.934990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2433/5085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:06 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:07.351815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:07.353066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:07.363418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:07.364435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:07.365791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:07.368430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:07.370779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-305c76eb-4775-4d0d-a551-24bc77e1cec7 req-c8f60449-df03-41f3-ac62-58e2e8720e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2fdcee-f948-4e39-8f07-3c6bed071962", "tag": "bc652a6a-82a0-447f-a76d-389e43a16911"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:07.372450 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:07.372450 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:07.388613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-305c76eb-4775-4d0d-a551-24bc77e1cec7 req-c8f60449-df03-41f3-ac62-58e2e8720e0f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:07.389089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-305c76eb-4775-4d0d-a551-24bc77e1cec7 req-c8f60449-df03-41f3-ac62-58e2e8720e0f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:07.429690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-305c76eb-4775-4d0d-a551-24bc77e1cec7 req-c8f60449-df03-41f3-ac62-58e2e8720e0f service nova] Creating event network-changed:bc652a6a-82a0-447f-a76d-389e43a16911 for instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 on n-h1-828148-1 Mar 29 02:37:07.439609 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-305c76eb-4775-4d0d-a551-24bc77e1cec7 req-c8f60449-df03-41f3-ac62-58e2e8720e0f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072774 Mar 29 02:37:07.443648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2434/5086] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:07.736333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:07.746052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:07.747558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:07.748684 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9842c606-747d-466b-8c98-821e23a4e605 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.400526 Mar 29 02:37:07.767860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2653/5087] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:07 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:07.940363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:07.949957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:07.953809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:07.954262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:07.955040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:07.956573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:08.769235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:08.770848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:08.779861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:08.782480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:08.783574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:08.784621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:08.888675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:08.909200 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d3de099-2801-49f7-934c-dc39ce67d61d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.971306 Mar 29 02:37:08.910171 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2435/5088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:07 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:08.993853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-bdb32749-1eb5-4b16-ad58-5770a7af628e req-0e2ac1ae-ed46-42a6-a245-31e83e81d501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "name": "network-vif-plugged", "status": "completed", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:08.996546 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:08.996546 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:09.015834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-bdb32749-1eb5-4b16-ad58-5770a7af628e req-0e2ac1ae-ed46-42a6-a245-31e83e81d501 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:09.020027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-bdb32749-1eb5-4b16-ad58-5770a7af628e req-0e2ac1ae-ed46-42a6-a245-31e83e81d501 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:09.070745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-bdb32749-1eb5-4b16-ad58-5770a7af628e req-0e2ac1ae-ed46-42a6-a245-31e83e81d501 service nova] Creating event network-vif-plugged:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h2-828148-1 Mar 29 02:37:09.086187 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-bdb32749-1eb5-4b16-ad58-5770a7af628e req-0e2ac1ae-ed46-42a6-a245-31e83e81d501 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096912 Mar 29 02:37:09.088741 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2436/5089] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:09.285238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:09.303925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:09.306101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:09.307299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-218cfc6e-8dd7-4c6b-82dd-fd493999880d tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.543926 Mar 29 02:37:09.307812 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2654/5090] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:08 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:09.467721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c95c65b3-2f51-4f8a-99b5-47415e52eec0 req-49018c57-58ba-4247-953e-596526a81c44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ba2abcb-ed23-4679-b381-86e6bb7ff3b1", "tag": "2c938e9f-e928-4e39-b261-11abd15cc48c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:09.470009 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:09.470009 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:09.491469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c95c65b3-2f51-4f8a-99b5-47415e52eec0 req-49018c57-58ba-4247-953e-596526a81c44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:09.493428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c95c65b3-2f51-4f8a-99b5-47415e52eec0 req-49018c57-58ba-4247-953e-596526a81c44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:09.521149 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c95c65b3-2f51-4f8a-99b5-47415e52eec0 req-49018c57-58ba-4247-953e-596526a81c44 service nova] Creating event network-changed:2c938e9f-e928-4e39-b261-11abd15cc48c for instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 on n-h1-828148-1 Mar 29 02:37:09.527051 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c95c65b3-2f51-4f8a-99b5-47415e52eec0 req-49018c57-58ba-4247-953e-596526a81c44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064018 Mar 29 02:37:09.528045 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2437/5091] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:09.928814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:09.930397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:09.950463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:09.953949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:09.958936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:09.960272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:10.326273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:10.327248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:10.348425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:10.349544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:10.351568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:10.352221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:10.490326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:10.499230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ad44612-fd49-4d15-999b-463e772d8a91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1391 microversion: 2.1 time: 0.575801 Mar 29 02:37:10.509750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2655/5092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:09 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1391 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:11.183304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:11.192695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:11.194214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:11.195329 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e90c3deb-ed12-4e40-a206-3a4cb0596ba7 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.873630 Mar 29 02:37:11.195881 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2438/5093] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:10 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:11.518118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:11.519398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:11.528946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:11.529983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:11.531525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:11.532303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:11.763425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:11.773232 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d348546c-08de-45b5-b527-558fd01fa0f7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1564 microversion: 2.1 time: 0.260423 Mar 29 02:37:11.778353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2656/5094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:11 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1564 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:11.792905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:11.793493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:11.803407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:11.803936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:11.804985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:11.805639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.009956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:12.019537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34351c66-80b2-4f62-8a29-4be3a76cb48a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1564 microversion: 2.1 time: 0.230004 Mar 29 02:37:12.020053 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2439/5095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:11 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:12.213038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:12.213648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:12.221132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.221563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.222733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.223297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.473550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:12.474438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:12.485773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.486546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.488049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.488952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.522640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:12.531882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:12.536770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:12.536770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc4637ab-f2d8-4b14-b5a9-2be9da4177a2 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.325157 Mar 29 02:37:12.536770 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2657/5096] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:12 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:12.569302 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2df06ea-7d52-4633-9ab5-49aa39f6c604 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments/0050a33a-d14d-4de0-aa7c-1a61a07e046a" status: 200 len: 194 microversion: 2.20 time: 0.101909 Mar 29 02:37:12.570077 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2440/5097] 10.222.0.36 () {60 vars in 1453 bytes} [Tue Mar 29 02:37:12 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments/0050a33a-d14d-4de0-aa7c-1a61a07e046a => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:37:12.684996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:12.685511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:12.707259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.708187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.710046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:12.710734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:12.882736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lazy-loading 'services' on Instance uuid 8ff3d3b6-e435-4b4b-ae28-1b549576c943 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:37:13.286986 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b977500-50a6-450c-b408-dbb4fa892368 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments/0050a33a-d14d-4de0-aa7c-1a61a07e046a" status: 202 len: 0 microversion: 2.20 time: 0.619488 Mar 29 02:37:13.289392 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2658/5098] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Mar 29 02:37:12 2022] DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments/0050a33a-d14d-4de0-aa7c-1a61a07e046a => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:37:13.304880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:13.307357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:13.318951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:13.320958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:13.321888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:13.322432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:13.395696 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5af5993-0cf2-4abf-9d0e-c4a1bac58e25 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.100688 Mar 29 02:37:13.396826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2441/5099] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:37:13 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:13.553884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:13.554716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:13.578696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:13.578696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:13.578696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:13.578696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:14.296018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:14.309663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:14.312696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:14.315519 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d992023-81c3-4343-b1aa-4507d133b632 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.765897 Mar 29 02:37:14.320200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2659/5100] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:13 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:14.407675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:14.408558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:14.428991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:14.429431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:14.430447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:14.430945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:14.533766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a37e621-f0b7-42eb-aadb-dcbb5e09244e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.129800 Mar 29 02:37:14.534705 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2442/5101] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:37:14 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:15.258763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3ff7f387-b296-4583-bc42-55873fa4bfba req-bbd553fa-85bf-44a5-92a8-277054a87672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba2abcb-ed23-4679-b381-86e6bb7ff3b1", "name": "network-vif-plugged", "status": "completed", "tag": "2c938e9f-e928-4e39-b261-11abd15cc48c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:15.260396 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:15.260396 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:37:15.279314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3ff7f387-b296-4583-bc42-55873fa4bfba req-bbd553fa-85bf-44a5-92a8-277054a87672 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.283527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3ff7f387-b296-4583-bc42-55873fa4bfba req-bbd553fa-85bf-44a5-92a8-277054a87672 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.325004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3ff7f387-b296-4583-bc42-55873fa4bfba req-bbd553fa-85bf-44a5-92a8-277054a87672 service nova] Creating event network-vif-plugged:2c938e9f-e928-4e39-b261-11abd15cc48c for instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 on n-h1-828148-1 Mar 29 02:37:15.334816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:15.336065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:15.337131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3ff7f387-b296-4583-bc42-55873fa4bfba req-bbd553fa-85bf-44a5-92a8-277054a87672 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083438 Mar 29 02:37:15.337746 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2660/5102] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:15.352476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.353488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.354661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.355294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.545914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:15.548241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:15.556209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.557080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.558242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.558939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.654709 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58e4c9b9-e6b7-4400-99d4-bf04c52c9868 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.113039 Mar 29 02:37:15.656108 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2661/5103] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:37:15 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:15.750941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:15.751441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:15.758871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.760002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.760133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:15.760499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:15.848101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:37:16.053007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.061938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.063685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.064866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1077dbd4-7ebf-456f-89d3-99232f46aa52 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.733960 Mar 29 02:37:16.065566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2443/5104] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:15 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:16.227617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cfc5a573-dd41-4d34-a4ef-978d11343552 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 204 len: 0 microversion: 2.20 time: 0.479451 Mar 29 02:37:16.228178 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2662/5105] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:37:15 2022] DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 29 02:37:16.237950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:16.238560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:16.258964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:16.259589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:16.260550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:16.261233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:16.371363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:16.372698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:16.385452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:16.386175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:16.387132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:16.387769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:16.588412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.602200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.604258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:16.606013 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b64a686a-dca8-425c-885f-2b48f99ac27c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.373455 Mar 29 02:37:16.606874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2444/5106] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:16 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:16.623522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-506de34b-29b4-4387-8a7f-4b53ac0f9c2c req-34081987-76e9-4dc9-be65-5d6c70b4ba12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:16.625712 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:16.625712 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:16.635644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-506de34b-29b4-4387-8a7f-4b53ac0f9c2c req-34081987-76e9-4dc9-be65-5d6c70b4ba12 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:16.636149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-506de34b-29b4-4387-8a7f-4b53ac0f9c2c req-34081987-76e9-4dc9-be65-5d6c70b4ba12 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:16.653495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-506de34b-29b4-4387-8a7f-4b53ac0f9c2c req-34081987-76e9-4dc9-be65-5d6c70b4ba12 service nova] Creating event network-changed:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h2-828148-1 Mar 29 02:37:16.658740 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-506de34b-29b4-4387-8a7f-4b53ac0f9c2c req-34081987-76e9-4dc9-be65-5d6c70b4ba12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039609 Mar 29 02:37:16.661709 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2445/5107] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:17.061344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:17.084686 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-111b9f53-33ce-4c9e-9736-c4727f7eaf69 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1564 microversion: 2.1 time: 0.721168 Mar 29 02:37:17.084914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:17.085532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:17.093308 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2663/5108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:16 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1564 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:17.103456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:17.104026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:17.104944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:17.105645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:17.538704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:17.550881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:17.552936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:17.554252 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3d2ab932-da16-4425-88a4-47fb13ad6811 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1359 microversion: 2.21 time: 0.474323 Mar 29 02:37:17.555366 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2446/5109] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:17 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1359 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:17.624945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:17.625560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:17.647064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:17.647516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:17.648476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:17.649130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:18.510965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:18.525030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:18.526648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:18.534690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ddfca1a9-1d9a-4028-9808-7bab0ddf2493 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1720 microversion: 2.20 time: 0.912646 Mar 29 02:37:18.546380 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2664/5110] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:17 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1720 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:18.573354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:18.574027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:18.581889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:18.582341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:18.583122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:18.583563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.056129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.066777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.068658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.070349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0b68f3eb-2a47-44b4-b0e9-953001a05292 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1553 microversion: 2.21 time: 0.501726 Mar 29 02:37:19.075468 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2447/5111] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:18 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1553 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:19.088916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:19.090077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:19.097626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.098309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.099939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.100537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.170548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:37:19.551975 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4e6f728-7738-4e2f-a9bb-737431bf6d3a tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 204 len: 0 microversion: 2.21 time: 0.466351 Mar 29 02:37:19.552764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2665/5112] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:37:19 2022] DELETE /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:37:19.556155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:19.556871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:19.564578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:19.565324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:19.575086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.575945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.576430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.576886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.592186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.592978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.594520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:19.594962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:19.867123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.880267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.882520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:19.884018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd59a5ba-1ef8-4510-a75a-a057d0219635 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1653 microversion: 2.20 time: 0.335021 Mar 29 02:37:19.885136 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2448/5113] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:19 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1653 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:20.093191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:20.110912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:20.112635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:20.116147 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6a4fe766-b285-4fae-a899-fca8523a8a92 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1559 microversion: 2.21 time: 0.553738 Mar 29 02:37:20.117091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2666/5114] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:19 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1559 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:20.457642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-89b101bc-cf7f-4a65-9e99-ba9d11b27564 req-3b400328-7946-41b7-8e30-aa0d47c34347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff3d3b6-e435-4b4b-ae28-1b549576c943", "name": "network-vif-deleted", "tag": "d6409b96-a964-4781-b6d1-8431eb2f8aa8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:20.459964 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:20.459964 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:20.472700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-89b101bc-cf7f-4a65-9e99-ba9d11b27564 req-3b400328-7946-41b7-8e30-aa0d47c34347 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:20.473311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-89b101bc-cf7f-4a65-9e99-ba9d11b27564 req-3b400328-7946-41b7-8e30-aa0d47c34347 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:20.493203 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-89b101bc-cf7f-4a65-9e99-ba9d11b27564 req-3b400328-7946-41b7-8e30-aa0d47c34347 service nova] Creating event network-vif-deleted:d6409b96-a964-4781-b6d1-8431eb2f8aa8 for instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 on n-h2-828148-1 Mar 29 02:37:20.498914 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-89b101bc-cf7f-4a65-9e99-ba9d11b27564 req-3b400328-7946-41b7-8e30-aa0d47c34347 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045656 Mar 29 02:37:20.500665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2449/5115] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:20.903333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:20.904216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:20.913019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:20.914669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:20.914669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:20.915136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:21.017555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:21.018279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:21.019188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lazy-loading 'fault' on Instance uuid 8ff3d3b6-e435-4b4b-ae28-1b549576c943 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:37:21.135495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:21.137300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:21.145706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:21.146519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:21.147559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:21.148253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:21.496039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:21.506960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:21.512691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:21.514570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-41b36804-c7b8-41ee-8665-147051bfc68b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 200 len: 1369 microversion: 2.20 time: 0.614930 Mar 29 02:37:21.527865 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2667/5116] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:20 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 1369 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:22.095597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:22.114044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:22.115948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:22.117113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e21ac1b2-82dc-4c59-9dcb-cfaaa37acba0 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1559 microversion: 2.21 time: 0.985864 Mar 29 02:37:22.117669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2450/5117] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:21 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1559 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:22.545984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:22.546590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:22.550442 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:37:22.556088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:22.556789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:22.557766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:22.558258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:22.609145 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. Mar 29 02:37:22.610266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:22.611084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bfd3a91e-8be4-4305-9e95-c4541c1905b6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 404 len: 111 microversion: 2.20 time: 0.069358 Mar 29 02:37:22.615244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2668/5118] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:22 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:37:22.620265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40792f34-d4f2-4d9b-8e3b-b9301e80c007 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '.version_select at 0x7f8717e55af0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:22.725109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40792f34-d4f2-4d9b-8e3b-b9301e80c007 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896805179" status: 204 len: 0 microversion: 2.20 time: 0.108632 Mar 29 02:37:22.726066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2451/5119] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Mar 29 02:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896805179 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 29 02:37:22.993812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-33267c5b-0ce9-4000-aca9-da4a07e422ed req-d94d20f9-34f7-442d-a780-3fc7946bd8da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ba2abcb-ed23-4679-b381-86e6bb7ff3b1", "name": "network-vif-deleted", "tag": "2c938e9f-e928-4e39-b261-11abd15cc48c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:22.995686 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:22.995686 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:37:23.005515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-33267c5b-0ce9-4000-aca9-da4a07e422ed req-d94d20f9-34f7-442d-a780-3fc7946bd8da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:23.008532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-33267c5b-0ce9-4000-aca9-da4a07e422ed req-d94d20f9-34f7-442d-a780-3fc7946bd8da service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:23.024331 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-33267c5b-0ce9-4000-aca9-da4a07e422ed req-d94d20f9-34f7-442d-a780-3fc7946bd8da service nova] Creating event network-vif-deleted:2c938e9f-e928-4e39-b261-11abd15cc48c for instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 on n-h1-828148-1 Mar 29 02:37:23.029490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-33267c5b-0ce9-4000-aca9-da4a07e422ed req-d94d20f9-34f7-442d-a780-3fc7946bd8da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039216 Mar 29 02:37:23.030258 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2669/5120] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:23.139706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:23.139706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:23.146771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:23.147475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:23.148259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:23.148696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:23.493835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:23.506850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:23.508746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7aa1f340e7744d5a858d20ea3f64ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372c705fe61848dfb53a022303b53848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:23.510185 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d6600bd-e863-4b34-b392-bfc7f3c66411 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 200 len: 1344 microversion: 2.21 time: 0.378513 Mar 29 02:37:23.510802 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2452/5121] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:23 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 1344 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:24.504725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: .version_select at 0x7f8724c6d040>, body: {"keypair": {"name": "tempest-keypair-464650738"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:24.538066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:37:24.538925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:24.539895 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54994. Mar 29 02:37:24.541320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:24.544391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:37:24.549789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.551068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.551952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.552472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.616878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] HTTP exception thrown: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. Mar 29 02:37:24.617687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Returning 404 to user: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:24.618875 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c3352d36-d4de-4d49-9381-9173c2b26e5c tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 404 len: 111 microversion: 2.21 time: 0.090149 Mar 29 02:37:24.620703 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2453/5122] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:24 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:37:24.627430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '.version_select at 0x7f8724d6d9d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:24.628189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:24.636433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.637268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.638553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.639221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.726860 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-abfe0953-264f-4435-8df0-cd9a4d915224 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.102984 Mar 29 02:37:24.733940 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2454/5123] 10.222.0.36 () {60 vars in 1336 bytes} [Tue Mar 29 02:37:24 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1/os-instance-actions => generated 611 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:24.745156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:24.745703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:24.754289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.755055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.756102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.756704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.813104 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] HTTP exception thrown: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. Mar 29 02:37:24.813700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Returning 404 to user: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:24.814713 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-53930a71-c5b0-41a7-8778-c6c8e6ed4615 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 404 len: 111 microversion: 2.21 time: 0.078134 Mar 29 02:37:24.815591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2455/5124] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:37:24 2022] DELETE /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:37:24.824382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:24.824763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] [instance: 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:24.833820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.834268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.835105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:24.835540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:24.892172 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] HTTP exception thrown: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. Mar 29 02:37:24.892769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] Returning 404 to user: Instance 3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:24.893670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c7b9e9f1-0b46-46d9-bd6c-bfc62282f2c4 tempest-InstanceActionsV221TestJSON-1629283199 tempest-InstanceActionsV221TestJSON-1629283199-project] 10.222.0.36 "GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1" status: 404 len: 111 microversion: 2.21 time: 0.074176 Mar 29 02:37:24.894216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2456/5125] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:24 2022] GET /compute/v2.1/servers/3ba2abcb-ed23-4679-b381-86e6bb7ff3b1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:37:24.919778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:37:24.925519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:37:24.940781 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4458c6c0-9ed9-4e93-a33d-a6a831f3581d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.440155 Mar 29 02:37:24.941720 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2670/5126] 10.222.0.36 () {62 vars in 1198 bytes} [Tue Mar 29 02:37:24 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 442 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:37:28.611980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-312493612", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb65f99d-8de1-4775-8513-7351ce939995"}], "security_groups": [{"name": "tempest-securitygroup--1738718327"}], "key_name": "tempest-keypair-464650738", "user_data": "}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:28.745074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] validate_networks() for [('bb65f99d-8de1-4775-8513-7351ce939995', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:37:29.521241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:37:29.521241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:37:29.521241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:37:29.521591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:37:29.521714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:37:29.530472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:29.530915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:29.532204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:29.532702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:29.552327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for project a977261edd7f406ba26b8f21c81bf451. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:37:29.558722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Getting quotas for user ea660a07e13b40f8ae133f954d109917 and project a977261edd7f406ba26b8f21c81bf451. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:37:29.572472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:37:29.574972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:37:29.767307 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40d8b5d8-13db-4ffd-956d-1251a6d8c441 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.158805 Mar 29 02:37:29.772587 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2457/5127] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Mar 29 02:37:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 29 02:37:29.778507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:29.779566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:30.082863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:30.095037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:30.097533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:30.105619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-84d1614e-8d9d-4d50-a8b1-d62025357e6a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1280 microversion: 2.20 time: 0.324712 Mar 29 02:37:30.112882 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2671/5128] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:29 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1280 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:31.128368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:31.129001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:31.136963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:31.137406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:31.138586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:31.139069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:31.359156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:31.369620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:31.374249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:31.376207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9ee70d5c-48ba-422a-9653-3cf9acf49879 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1276 microversion: 2.20 time: 0.252172 Mar 29 02:37:31.377301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2458/5129] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:31 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:31.635602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-198051802", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "52092e9c-dfc1-4170-8dd6-7535feec3f42"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:31.674158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:31.675495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:31.688062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:31.692571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:31.695186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:31.702869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:31.797406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] validate_networks() for [('52092e9c-dfc1-4170-8dd6-7535feec3f42', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:37:31.883678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ee1e7cec-ef4a-466f-a491-7c0e7f6421a2 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962/action" status: 200 len: 24564 microversion: 2.1 time: 0.208623 Mar 29 02:37:31.883678 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2459/5130] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:37:31 2022] POST /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962/action => generated 24564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:37:32.398247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:32.400062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:32.411060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:32.412321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:32.413373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:32.414945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:32.589837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:32.602773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:32.618356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:32.618356 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6915ec82-2f1a-4234-9bd7-d0aee097e7d5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1350 microversion: 2.20 time: 0.215566 Mar 29 02:37:32.621416 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2460/5131] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:32 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1350 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:33.322042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:37:33.323180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:37:33.323658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:37:33.324063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:37:33.324463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:37:33.343151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:33.343970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:33.345752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:33.351306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:33.370890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Getting quotas for project 1335f52ebd5a4681aa0070d42cc6375b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:37:33.377855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Getting quotas for user ab98f1ee32554a4a8b72cc63e66305ab and project 1335f52ebd5a4681aa0070d42cc6375b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:37:33.393368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:37:33.396236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:37:33.546805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d6ee49b-28fb-4bbe-82a5-e16e7d4ef598 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082135 Mar 29 02:37:33.547602 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2672/5132] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:37:33.559174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39d0d651-a6ce-417d-9b68-b658739f1966 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:33.562682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39d0d651-a6ce-417d-9b68-b658739f1966 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:33.625749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:33.626364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:33.645184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:33.645184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:33.645184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:33.645184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:33.762125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39d0d651-a6ce-417d-9b68-b658739f1966 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:33.774952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39d0d651-a6ce-417d-9b68-b658739f1966 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1224 microversion: 2.1 time: 0.220130 Mar 29 02:37:33.780235 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2461/5133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:33 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1224 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:34.245392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:34.263932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:34.267746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:34.274114 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f8872108-bad3-418f-9d2e-006c18b758ed tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.650933 Mar 29 02:37:34.274851 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2673/5134] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:33 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:34.791881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-26e564a5-bd2b-42c9-87fb-fff073a43009 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:34.794877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26e564a5-bd2b-42c9-87fb-fff073a43009 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:35.097548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26e564a5-bd2b-42c9-87fb-fff073a43009 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:35.106470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-26e564a5-bd2b-42c9-87fb-fff073a43009 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1224 microversion: 2.1 time: 0.318532 Mar 29 02:37:35.117164 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2462/5135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:34 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1224 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:35.291986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:35.292601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:35.312435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:35.313788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:35.314765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:35.315394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:35.675772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ebe11015-e952-4422-8bb1-3b43b40310e9 req-d08d6fee-81c4-4d46-b5a1-7f0abfd27b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:35.677676 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:35.677676 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:35.689573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ebe11015-e952-4422-8bb1-3b43b40310e9 req-d08d6fee-81c4-4d46-b5a1-7f0abfd27b96 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:35.690362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ebe11015-e952-4422-8bb1-3b43b40310e9 req-d08d6fee-81c4-4d46-b5a1-7f0abfd27b96 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:35.726690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ebe11015-e952-4422-8bb1-3b43b40310e9 req-d08d6fee-81c4-4d46-b5a1-7f0abfd27b96 service nova] Creating event network-changed:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h1-828148-1 Mar 29 02:37:35.732503 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ebe11015-e952-4422-8bb1-3b43b40310e9 req-d08d6fee-81c4-4d46-b5a1-7f0abfd27b96 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060958 Mar 29 02:37:35.733856 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2463/5136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:37:36.049810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:36.059757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:36.061277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:36.062603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e6f26921-5680-49c6-9c4b-0ee488def458 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.774398 Mar 29 02:37:36.063977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2674/5137] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:35 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:36.124060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:36.128350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:36.133115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:36.133574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:36.134352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:36.134792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:36.324870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:36.339624 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82b8bd60-a3c2-48c8-aaab-9d35b56998a7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1276 microversion: 2.1 time: 0.219710 Mar 29 02:37:36.340299 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2464/5138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:36 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:36.698207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:36.699250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:36.713862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:36.714315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:36.715284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:36.715723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:36.811108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95896426-58e5-4e24-b237-5199ecfec914 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action" status: 200 len: 24568 microversion: 2.1 time: 0.116464 Mar 29 02:37:36.812051 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2675/5139] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:37:36 2022] POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action => generated 24568 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:37.083824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:37.083824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:37.090782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:37.091257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:37.092022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:37.092445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:37.361392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:37.362772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:37.373031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:37.373900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:37.374942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:37.376797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:37.607008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:37.617068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-466b5efc-8424-4d9e-b076-684317e40ae0 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1282 microversion: 2.1 time: 0.262022 Mar 29 02:37:37.631086 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2676/5140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:37 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:37.653720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:37.664061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:37.665634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:37.666945 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19d4d805-6ce5-46f7-840b-f4168a79f885 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.589337 Mar 29 02:37:37.678660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2465/5141] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:37 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:38.634676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:38.635288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:38.645868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:38.647676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:38.650000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:38.651024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:38.685922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:38.686534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:38.699905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:38.701003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:38.702014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:38.704899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:38.998850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:39.009849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:39.011809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:39.013177 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-45a9fa2f-29a1-431c-b9d6-82323cde2415 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.331370 Mar 29 02:37:39.024450 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2466/5142] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:38 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:37:39.440730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:39.449760 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7aee5aea-f525-4948-81b7-502469ddb6d4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.818694 Mar 29 02:37:39.459390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2677/5143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:38 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:40.031945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:40.032575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:40.041900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:40.042640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:40.043627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:40.043755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:40.413954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:40.429227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:40.431616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:40.432966 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2026abd-788f-4a0d-86b6-6fa016035865 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.405245 Mar 29 02:37:40.434800 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2467/5144] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:40 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:40.483926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:40.483926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:40.491227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:40.492393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:40.493977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:40.494650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:40.969849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4736fe39-c884-4e29-9348-e4cbfe7c579c req-57cce03d-9f08-44d2-bcdb-673714126a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd88d3d-288b-4b5a-91ab-baf8c1b31dd8", "tag": "11bae547-c4b0-4833-ab3a-fb483783a4df"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:40.972069 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:40.972069 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:40.981231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4736fe39-c884-4e29-9348-e4cbfe7c579c req-57cce03d-9f08-44d2-bcdb-673714126a97 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:40.982023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4736fe39-c884-4e29-9348-e4cbfe7c579c req-57cce03d-9f08-44d2-bcdb-673714126a97 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:40.987754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:41.006205 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4405f66-54a5-48bb-9815-6da68f32a97d tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.531728 Mar 29 02:37:41.014035 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2678/5145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:40 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:41.028502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4736fe39-c884-4e29-9348-e4cbfe7c579c req-57cce03d-9f08-44d2-bcdb-673714126a97 service nova] Creating event network-changed:11bae547-c4b0-4833-ab3a-fb483783a4df for instance acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 on n-h2-828148-1 Mar 29 02:37:41.033788 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4736fe39-c884-4e29-9348-e4cbfe7c579c req-57cce03d-9f08-44d2-bcdb-673714126a97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068098 Mar 29 02:37:41.035110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2468/5146] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:37:41.455142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:41.455816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:41.486141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:41.486726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:41.487392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:41.487831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:42.021506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:42.022540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:42.023249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:42.036473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:42.038696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:42.039050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:42.041072 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-993e3b76-4766-40a4-966f-f0822b1dcf8a tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.591893 Mar 29 02:37:42.042173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2679/5147] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:41 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:42.046394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:42.047559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:42.048174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:42.790807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:42.800291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13b9904e-c435-4226-9216-9b9769461fd4 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.781879 Mar 29 02:37:42.800896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2469/5148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:42 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:43.059110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:43.059712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:43.074678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.075128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.076241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.076937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.247116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:43.248403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:43.256445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.257055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.257909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.258409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.649928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:43.660166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:43.665152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:43.668498 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-caf735e6-8449-4fbc-856e-b9a7698a34a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.613155 Mar 29 02:37:43.681738 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2680/5149] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:43 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:43.686752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ebf0bf4f-a903-4ac4-a281-7cedb2f0bc45 req-63cdf055-e00d-4e11-b32a-6d6d771f392c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "name": "network-vif-plugged", "status": "completed", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:43.688643 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:43.688643 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:37:43.711048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ebf0bf4f-a903-4ac4-a281-7cedb2f0bc45 req-63cdf055-e00d-4e11-b32a-6d6d771f392c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.711497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ebf0bf4f-a903-4ac4-a281-7cedb2f0bc45 req-63cdf055-e00d-4e11-b32a-6d6d771f392c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.732651 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ebf0bf4f-a903-4ac4-a281-7cedb2f0bc45 req-63cdf055-e00d-4e11-b32a-6d6d771f392c service nova] Creating event network-vif-plugged:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h1-828148-1 Mar 29 02:37:43.739556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ebf0bf4f-a903-4ac4-a281-7cedb2f0bc45 req-63cdf055-e00d-4e11-b32a-6d6d771f392c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056363 Mar 29 02:37:43.741174 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2681/5150] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:43.818199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:43.819033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:43.833239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.833239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:43.840229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:43.840229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.019820 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4c53076-c148-4e81-a23f-3df0a02bb819 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1834 microversion: 2.1 time: 0.776986 Mar 29 02:37:44.021150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2470/5151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:43 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1834 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:44.036447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:44.038161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:44.048771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.049458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.050689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.051180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.205611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.214260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-216e238d-cc24-4fb3-a82b-b0fa62ed4847 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.400448 Mar 29 02:37:44.217054 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2682/5152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:43 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:44.311829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.321828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cebfa87b-6514-4031-a4f8-85dbe705e0cd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1683 microversion: 2.1 time: 0.288953 Mar 29 02:37:44.322492 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2471/5153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:44 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1683 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:44.501950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:44.502980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:44.511486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.512151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.513291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.514189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.603028 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d36e4005-817e-4425-a5df-fbfeddc3d3c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action" status: 200 len: 32635 microversion: 2.1 time: 0.105045 Mar 29 02:37:44.603920 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2683/5154] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:37:44 2022] POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action => generated 32635 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:44.689078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:44.689958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:44.697320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.697972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.698902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.699596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.810935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:44.811950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:44.830305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.830861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.831654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:44.832085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:44.917317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '390351ec7bf84366970cb7d9cd47a22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ce70c945994035942ff3ffd69cb99a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.918548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] flavor_id is None. Assuming migration. {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4011}} Mar 29 02:37:44.919063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:37:44.963503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.974088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.975741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:44.976872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5572f648-2510-4659-b029-0639cedb9b63 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1406 microversion: 2.20 time: 0.291637 Mar 29 02:37:44.977424 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2472/5155] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:44 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1406 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:45.233911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:45.234267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:45.241725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:45.242590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:45.243368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:45.243800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:45.434194 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3385b62-584c-4982-9b57-507954cfcd19 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action" status: 202 len: 0 microversion: 2.1 time: 0.627783 Mar 29 02:37:45.439015 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2684/5156] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:37:44 2022] POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:37:45.449602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:45.454030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:45.470728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:45.477237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:45.479509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:45.479509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:45.480734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:45.490213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4d4e2f50-7908-4332-bcb8-57d300b011d7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.260364 Mar 29 02:37:45.492875 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2473/5157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:45 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:45.994394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:45.995126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:46.003826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.004050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:46.004925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.005453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:46.052023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:46.083953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e54d3f2-221f-4499-9457-18a1055fbfea tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1692 microversion: 2.1 time: 0.639475 Mar 29 02:37:46.086626 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2685/5158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:45 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1692 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:46.438386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:46.449620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:46.452988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:46.453840 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50e72171-56fa-412a-a0ae-44b3cd4b7e87 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1598 microversion: 2.20 time: 0.463856 Mar 29 02:37:46.454577 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2474/5159] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:37:45 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1598 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:37:46.471334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:46.472390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:46.480811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.481496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:46.483756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.485718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:46.507219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:46.507820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:46.528256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.528695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:46.529722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:46.530160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:47.133534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6daf03ce-e9e7-49e4-aee4-35d8813a4c7b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.665812 Mar 29 02:37:47.135185 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2686/5160] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Mar 29 02:37:46 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-interface => generated 285 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:37:47.140353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:47.140943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:47.150908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:47.151457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:47.152240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:47.152760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:47.420444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:47.435897 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d6dcd5e-ae59-4257-98e6-d57aa157bfc5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1692 microversion: 2.1 time: 0.299001 Mar 29 02:37:47.446408 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2687/5161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:47 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1692 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:47.482361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:47.497396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-707e1848-7433-452a-ab33-3fc0d2ee2ca1 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.993685 Mar 29 02:37:47.499393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2475/5162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:46 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:48.456149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:48.457694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:48.481482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:48.482113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ebe601cd-d7f7-45de-bcec-a8f1d7264024 req-700b48d3-573e-446b-9b20-d6aaa368e58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd88d3d-288b-4b5a-91ab-baf8c1b31dd8", "name": "network-vif-plugged", "status": "completed", "tag": "11bae547-c4b0-4833-ab3a-fb483783a4df"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:48.483311 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:48.483311 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:37:48.485347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:48.486496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:48.487317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:48.499853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ebe601cd-d7f7-45de-bcec-a8f1d7264024 req-700b48d3-573e-446b-9b20-d6aaa368e58e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:48.501137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ebe601cd-d7f7-45de-bcec-a8f1d7264024 req-700b48d3-573e-446b-9b20-d6aaa368e58e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:48.521322 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ebe601cd-d7f7-45de-bcec-a8f1d7264024 req-700b48d3-573e-446b-9b20-d6aaa368e58e service nova] Creating event network-vif-plugged:11bae547-c4b0-4833-ab3a-fb483783a4df for instance acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 on n-h2-828148-1 Mar 29 02:37:48.526512 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ebe601cd-d7f7-45de-bcec-a8f1d7264024 req-700b48d3-573e-446b-9b20-d6aaa368e58e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049407 Mar 29 02:37:48.527559 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2476/5163] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:37:48.532824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:48.538179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:48.541445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:48.542088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:48.543035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:48.543640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:49.332171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:49.344997 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2ca29b8-a1d8-406d-9619-a9b88ad059ec tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1692 microversion: 2.1 time: 0.893803 Mar 29 02:37:49.345575 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2688/5164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:48 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1692 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:49.377438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:49.397054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f7ac137-7f4b-4424-8d18-482b8171e493 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.867913 Mar 29 02:37:49.398117 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2477/5165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:48 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:50.362816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:50.363585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:50.371947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:50.372691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:50.374025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:50.374705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:50.413906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:50.414515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:50.432241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:50.432807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:50.438591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:50.438591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:50.648192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:50.658739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ff435921-e0ab-4f9f-8e7c-1112793ee1f4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1692 microversion: 2.1 time: 0.300458 Mar 29 02:37:50.659354 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2689/5166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:50 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1692 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:50.817376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3674fff3-dead-4b6a-b50e-487e97419adf req-542959e0-187d-4bb1-ae84-e4cac7cb143c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:50.818804 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:50.818804 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:37:50.834937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3674fff3-dead-4b6a-b50e-487e97419adf req-542959e0-187d-4bb1-ae84-e4cac7cb143c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:50.835380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3674fff3-dead-4b6a-b50e-487e97419adf req-542959e0-187d-4bb1-ae84-e4cac7cb143c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:50.863857 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3674fff3-dead-4b6a-b50e-487e97419adf req-542959e0-187d-4bb1-ae84-e4cac7cb143c service nova] Creating event network-changed:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h1-828148-1 Mar 29 02:37:50.869392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3674fff3-dead-4b6a-b50e-487e97419adf req-542959e0-187d-4bb1-ae84-e4cac7cb143c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056742 Mar 29 02:37:50.870939 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2690/5167] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:50.894141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:50.910075 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3b4a5212-b8c5-437c-a3ea-18781b7d24c6 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1324 microversion: 2.1 time: 0.499714 Mar 29 02:37:50.919689 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2478/5168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:50 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1324 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:51.676279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:51.677067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:51.693554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:51.694047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:51.694926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:51.695360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:51.927000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:51.928348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:51.936293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:51.937256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:51.938787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:51.939448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.226018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:52.241516 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1863bd8e-c3f0-4978-b8ce-4ff7a96131f3 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1521 microversion: 2.1 time: 0.316472 Mar 29 02:37:52.242024 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2479/5169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:51 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:52.263381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:52.264229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:52.272708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.273545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.274544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.275198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.353473 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] HTTP exception thrown: Action 999 not found Mar 29 02:37:52.356481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Returning 404 to user: Action 999 not found {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:52.357784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-50bedab6-36e9-4a99-a520-1fdef0e05bc9 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.098347 Mar 29 02:37:52.358564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:52.364807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2480/5170] 10.222.0.36 () {58 vars in 1307 bytes} [Tue Mar 29 02:37:52 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8/os-instance-actions/999 => generated 66 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 29 02:37:52.370070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9880e8af-bf20-4228-82c4-d726a4515f83 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '.version_select at 0x7f8717e7cdc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:52.370837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9880e8af-bf20-4228-82c4-d726a4515f83 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: 165f19e4-77d5-4372-96de-d745fe12f49c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:52.376461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8d2e21b-1828-46e5-9f4e-26b53593a2a8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.702738 Mar 29 02:37:52.378073 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2691/5171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:51 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:52.380006 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9880e8af-bf20-4228-82c4-d726a4515f83 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] HTTP exception thrown: Instance 165f19e4-77d5-4372-96de-d745fe12f49c could not be found. Mar 29 02:37:52.380757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9880e8af-bf20-4228-82c4-d726a4515f83 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Returning 404 to user: Instance 165f19e4-77d5-4372-96de-d745fe12f49c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:52.381532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9880e8af-bf20-4228-82c4-d726a4515f83 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/165f19e4-77d5-4372-96de-d745fe12f49c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015465 Mar 29 02:37:52.382305 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2481/5172] 10.222.0.36 () {58 vars in 1295 bytes} [Tue Mar 29 02:37:52 2022] GET /compute/v2.1/servers/165f19e4-77d5-4372-96de-d745fe12f49c/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:37:52.391194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:52.391695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:52.414189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.415121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.415833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.416456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.506459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:37:52.864794 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce90dc54-209d-4b20-84ca-a132372eb39c tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "DELETE /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 204 len: 0 microversion: 2.1 time: 0.476986 Mar 29 02:37:52.869806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2692/5173] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:37:52 2022] DELETE /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:37:52.874274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:52.874882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:52.883526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.883975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:52.884737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:52.885208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:53.105380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:53.128138 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-752d7c62-3e33-4516-b208-e6b557634b13 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1527 microversion: 2.1 time: 0.257404 Mar 29 02:37:53.129191 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2482/5174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:52 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1527 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:53.396750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:53.398745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:53.406309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:53.406839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:53.407673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:53.408168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:53.732739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:53.756110 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cc8d9b1-d538-4e04-9ab8-4798edd30e73 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.364565 Mar 29 02:37:53.767336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2693/5175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:53 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:54.145358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:54.145964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:54.153908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:54.154354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:54.155174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:54.155540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:54.556184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:54.566185 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b889f8ff-c8d0-4fb1-872e-702c02211964 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1527 microversion: 2.1 time: 0.425466 Mar 29 02:37:54.569366 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2483/5176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:54 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1527 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:54.773422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:54.774618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:54.782511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:54.783165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:54.783932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:54.784361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:55.591896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:55.595119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:55.601474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:55.601933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:55.602945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:55.603561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:55.752471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:55.762360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4d6a7ce-9aff-41f1-b96d-d9cb3a3feb6a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.992427 Mar 29 02:37:55.763481 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2694/5177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:54 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:55.828291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:55.838349 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bae9531f-c4c0-4843-b793-3945505fbeb8 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1527 microversion: 2.1 time: 0.250300 Mar 29 02:37:55.839779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2484/5178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:55 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1527 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:56.283003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b9905ecf-717e-413f-b6ad-ff52ed74f5f4 req-5f6fbc2a-87ac-441e-97b8-fc5d97a60cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd88d3d-288b-4b5a-91ab-baf8c1b31dd8", "name": "network-vif-deleted", "tag": "11bae547-c4b0-4833-ab3a-fb483783a4df"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:37:56.284988 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:37:56.284988 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:37:56.293163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b9905ecf-717e-413f-b6ad-ff52ed74f5f4 req-5f6fbc2a-87ac-441e-97b8-fc5d97a60cb7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.293597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b9905ecf-717e-413f-b6ad-ff52ed74f5f4 req-5f6fbc2a-87ac-441e-97b8-fc5d97a60cb7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.311289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b9905ecf-717e-413f-b6ad-ff52ed74f5f4 req-5f6fbc2a-87ac-441e-97b8-fc5d97a60cb7 service nova] Creating event network-vif-deleted:11bae547-c4b0-4833-ab3a-fb483783a4df for instance acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 on n-h2-828148-1 Mar 29 02:37:56.316950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b9905ecf-717e-413f-b6ad-ff52ed74f5f4 req-5f6fbc2a-87ac-441e-97b8-fc5d97a60cb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038259 Mar 29 02:37:56.317916 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2695/5179] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:37:56.779963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:56.780502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:56.787909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.788358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.789142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.789593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.856599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:56.857324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:56.865878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.866602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.867372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.867805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.940182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:56.940937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:56.941947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lazy-loading 'fault' on Instance uuid acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:37:57.010252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:57.018787 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2de587ec-3c9f-42e2-8139-4280fd38df2e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.242603 Mar 29 02:37:57.019764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2485/5180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:56 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:57.128336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98f1ee32554a4a8b72cc63e66305ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1335f52ebd5a4681aa0070d42cc6375b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:57.137105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acc2188e-cafe-4b9e-8e37-5aa969d0efe7 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 200 len: 1314 microversion: 2.1 time: 0.284547 Mar 29 02:37:57.147506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2696/5181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:56 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:37:58.037097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:58.038343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:58.047333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:58.048759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:58.049838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:58.050509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:58.154143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:58.158048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] [instance: acd88d3d-288b-4b5a-91ab-baf8c1b31dd8] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:58.165801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:58.166534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:58.167671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:58.168302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:58.231560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] HTTP exception thrown: Instance acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 could not be found. Mar 29 02:37:58.232474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] Returning 404 to user: Instance acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:37:58.233556 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7c3571b-0009-4ab6-95ac-d54073408d19 tempest-InstanceActionsNegativeTestJSON-1972805521 tempest-InstanceActionsNegativeTestJSON-1972805521-project] 10.222.0.36 "GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8" status: 404 len: 111 microversion: 2.1 time: 0.083104 Mar 29 02:37:58.234752 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2697/5182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:58 2022] GET /compute/v2.1/servers/acd88d3d-288b-4b5a-91ab-baf8c1b31dd8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:37:58.541562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:58.553174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bee66795-b0ce-4732-a2ff-3648f290ba14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.521404 Mar 29 02:37:58.554455 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2486/5183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:58 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:37:59.572355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:37:59.573083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:37:59.582400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:59.582853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:59.583685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:37:59.584121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:37:59.927426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:37:59.936442 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13769d0f-27dd-4a77-9a93-2aa9b93754f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.368401 Mar 29 02:37:59.937048 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2698/5184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:37:59 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:00.953546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:00.955342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:00.972478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:00.973090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:00.974086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:00.974785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:01.370250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:01.385174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-45b4f556-38c2-41a4-8cfa-5c7bb2fae6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.435493 Mar 29 02:38:01.396764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2487/5185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:00 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:02.402590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:02.403411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:02.417603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:02.418249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:02.418847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:02.419297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:02.770133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:02.784063 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ec4ac353-8a64-402d-97a0-e662e6ad0b72 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.384950 Mar 29 02:38:02.784928 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2699/5186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:02 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:03.802926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:03.803512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:03.810651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:03.811335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:03.812100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:03.812529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:04.166301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:04.175563 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06ef35ea-cbf9-4a21-98aa-6a1f1b845437 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.376312 Mar 29 02:38:04.176155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2488/5187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:03 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:05.194886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:05.197440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:05.206358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:05.207067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:05.208017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:05.208748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:05.615314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:05.631038 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48a99106-2143-4af2-8e02-9a571a322a8c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.439499 Mar 29 02:38:05.632290 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2700/5188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:05 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:06.112526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1745897883", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "4568aacf-5ae8-439a-bb86-5167881a0f75"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:06.224248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] validate_networks() for [('4568aacf-5ae8-439a-bb86-5167881a0f75', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:38:06.654665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:06.655951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:06.681451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:06.687184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:06.691417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:06.692283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:07.129296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:07.144662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-064ddb2e-e759-45b0-b197-98cfeafcdf2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.493689 Mar 29 02:38:07.151857 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2701/5189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:06 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:07.987935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:38:07.989056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:38:07.989943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:38:07.990567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:38:07.991308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:38:08.004955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:08.004955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:08.005933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:08.006810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:08.056672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:08.075821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for user 2d3ff6e0b42d4168b9d9263fd42dc331 and project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:08.104088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:38:08.106994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:38:08.165139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:08.166457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:08.177857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:08.178549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:08.179516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:08.180125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:08.255743 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1b67bc75-9238-4277-90bb-9a6ab0a288b6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.364794 Mar 29 02:38:08.282216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2489/5190] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:38:08.489486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1602747693", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "4568aacf-5ae8-439a-bb86-5167881a0f75"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:08.608569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] validate_networks() for [('4568aacf-5ae8-439a-bb86-5167881a0f75', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:38:09.065211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:09.076802 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f289e20-04b1-44dd-8ca7-83108f5ddaf5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1697 microversion: 2.1 time: 0.915223 Mar 29 02:38:09.079224 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2702/5191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:08 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1697 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:10.095426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:10.096767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:10.105192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:10.105915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:10.106868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:10.107472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:10.745202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:10.757758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24986695-c1b4-415b-8d8a-16ee3aa66e04 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1696 microversion: 2.1 time: 0.666846 Mar 29 02:38:10.758337 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2703/5192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:10 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1696 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:10.921400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:38:10.921400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:38:10.921400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:38:10.921400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:38:10.921400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:38:10.952986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:10.954522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:10.959368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:10.961453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:10.981539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:10.988013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for user 2d3ff6e0b42d4168b9d9263fd42dc331 and project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:11.009197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:38:11.012120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:38:11.149119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "name": "network-vif-unplugged", "status": "completed", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:11.166185 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:11.166185 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:11.187184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:11.190573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:11.239350 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] Creating event network-vif-unplugged:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:38:11.247788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] Instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:38:11.269785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-7e254b50-7a21-4685-8e15-31f07170d6d3 req-d800de5b-2b40-44fc-9601-236a4c864f53 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132085 Mar 29 02:38:11.270742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2704/5193] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:38:11.298054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae12e14b-c6f3-4343-be76-baa5f855a792 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.812845 Mar 29 02:38:11.307976 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2490/5194] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:38:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:38:11.480435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: .version_select at 0x7f8725ec6940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2131989858"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:11.547186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:11.587198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:11.588140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1116422673", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "451", "networks": [{"uuid": "4568aacf-5ae8-439a-bb86-5167881a0f75"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:11.748542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] validate_networks() for [('4568aacf-5ae8-439a-bb86-5167881a0f75', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:38:11.969181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:11.980286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:12.026182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d27c6ee-2b8b-47ee-8251-063c97026ea6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.550514 Mar 29 02:38:12.027443 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2705/5195] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:38:11 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:12.033694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:12.034709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:12.044047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:12.044722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:12.045737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:12.046350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:12.981150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:12.991779 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1be1670a-ff14-4044-a60d-d33bf57ed9b3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1696 microversion: 2.1 time: 0.962654 Mar 29 02:38:12.993487 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2706/5196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:12 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1696 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:14.015523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:14.015523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:14.027889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:14.028646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:14.029736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:14.031051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:14.791599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:14.805378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5abbd555-a7cd-4be5-bb76-f9eeefabfe71 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1696 microversion: 2.1 time: 0.797158 Mar 29 02:38:14.807659 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2707/5197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:14 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1696 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:14.819692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:14.822751 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:14.822751 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:14.835544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:14.836221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:14.873147 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] Creating event network-changed:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:38:14.882143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] Instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:38:14.896128 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6bc6489b-59ec-4215-9be0-ef9117538054 req-431cbfb8-05e2-4f88-b6ef-020d32e5944f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086672 Mar 29 02:38:14.897070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2708/5198] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:15.538354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:38:15.539154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:38:15.539728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:38:15.540657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:38:15.541552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:38:15.564172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:15.567340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:15.572427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:15.573257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:15.630854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:15.645193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Getting quotas for user 2d3ff6e0b42d4168b9d9263fd42dc331 and project ba414e73401845a2af0efb2ce281649c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:15.663958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:38:15.667505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:38:15.823531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:15.824948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:15.833481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:15.834463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:15.835495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:15.836151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:15.947129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa79716a-3079-4f65-893e-20410c75477f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.363197 Mar 29 02:38:15.948545 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2491/5199] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:38:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 4365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:38:15.965474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ead1339b-23c9-460d-b605-39829b142fb5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:15.966489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ead1339b-23c9-460d-b605-39829b142fb5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:16.241102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ead1339b-23c9-460d-b605-39829b142fb5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:16.251992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ead1339b-23c9-460d-b605-39829b142fb5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1221 microversion: 2.1 time: 0.295469 Mar 29 02:38:16.253148 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2492/5200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:15 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1221 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:16.598304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:16.610115 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca13cd25-55b5-4f9c-8eed-e2e42a9489ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1696 microversion: 2.1 time: 0.790632 Mar 29 02:38:16.613686 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2709/5201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:15 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1696 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:16.956499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-eb507ea0-5797-4c8c-b59d-3925b6b7c915 req-23704575-0039-4f02-918c-8507802cac87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2197334c-7676-4865-94c0-fb42f0a92c71", "tag": "c491109f-69d5-4fe4-b385-13f90eed1d48"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:16.958315 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:16.958315 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:16.991096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eb507ea0-5797-4c8c-b59d-3925b6b7c915 req-23704575-0039-4f02-918c-8507802cac87 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:16.991448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eb507ea0-5797-4c8c-b59d-3925b6b7c915 req-23704575-0039-4f02-918c-8507802cac87 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:17.034607 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-eb507ea0-5797-4c8c-b59d-3925b6b7c915 req-23704575-0039-4f02-918c-8507802cac87 service nova] Creating event network-changed:c491109f-69d5-4fe4-b385-13f90eed1d48 for instance 2197334c-7676-4865-94c0-fb42f0a92c71 on n-h2-828148-1 Mar 29 02:38:17.055001 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-eb507ea0-5797-4c8c-b59d-3925b6b7c915 req-23704575-0039-4f02-918c-8507802cac87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102238 Mar 29 02:38:17.065053 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2493/5202] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:38:17.269379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:17.270624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:17.278531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:17.279222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:17.280160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:17.280753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:17.632367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:17.634753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:17.655224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:17.658517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:17.660428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:17.661892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:17.975511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:17.989806 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2e509399-2eec-4f9e-814b-a709f5bc9850 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1225 microversion: 2.1 time: 0.723037 Mar 29 02:38:18.024174 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2710/5203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:17 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1225 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:18.803435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-31731583", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "64a0b495-36fb-48f0-80a4-f5bf0917e65a"}], "key_name": "tempest-TestNetworkBasicOps-2131989858", "security_groups": [{"name": "tempest-secgroup-smoke-1437404027"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:19.261171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] validate_networks() for [('64a0b495-36fb-48f0-80a4-f5bf0917e65a', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:38:19.263272 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:38:20.289210 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56376. Mar 29 02:38:20.289210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:20.314990 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29ffdb82-75d1-4505-a19c-79fe0d279711 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1696 microversion: 2.1 time: 2.685148 Mar 29 02:38:20.326451 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2494/5204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:17 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1696 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:20.332276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:20.333517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:20.343696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:20.345006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:20.347371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:20.348346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:20.808580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:38:20.809323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:38:20.810068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:38:20.810537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:38:20.810967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:38:20.835791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:20.836341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:20.837253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:20.837694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:20.883348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:38:20.895887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:38:20.928516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:38:20.936091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:38:21.133616 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a2a10e1-963f-4d31-a3e4-7e4b910c4cdd tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.333812 Mar 29 02:38:21.135930 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2711/5205] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:38:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:38:21.157384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0641cf79-4347-4726-9cbc-f7fb4b53f5a8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:21.158054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0641cf79-4347-4726-9cbc-f7fb4b53f5a8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:21.314167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0641cf79-4347-4726-9cbc-f7fb4b53f5a8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:21.339045 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0641cf79-4347-4726-9cbc-f7fb4b53f5a8 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1247 microversion: 2.1 time: 0.193473 Mar 29 02:38:21.341348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2712/5206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:21 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1247 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:21.354813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:21.355410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:21.361551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:21.374441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:21.374441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:21.377580 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d695c3d3-a479-41ef-bca1-ce9bb4b0e242 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1279 microversion: 2.1 time: 1.049263 Mar 29 02:38:21.378779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2495/5207] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:20 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1279 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:21.382989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:21.383588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:22.121704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:22.135778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6b75d45-e1a3-4e95-912f-457eb9f4f027 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1694 microversion: 2.1 time: 0.791356 Mar 29 02:38:22.136374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2713/5208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:21 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1694 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:22.365771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:22.367460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:22.383020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:22.384763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:22.387133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:22.390583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:22.394597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:22.395474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:22.411929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:22.412770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:22.414133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:22.414783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:22.916478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:22.929951 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ba01afd-7cd8-4b43-bcdb-73c8946d37b3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1279 microversion: 2.1 time: 0.539545 Mar 29 02:38:22.930944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2714/5209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:22 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1279 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:22.967945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:22.982635 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e8d9a86-2c44-40b1-9e11-d94ae264e665 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1251 microversion: 2.1 time: 0.627532 Mar 29 02:38:22.997992 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2496/5210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:22 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1251 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:23.156106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:23.157279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:23.169154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:23.173228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:23.174363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:23.175157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:23.948036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:23.949428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:23.955052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:23.958080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:23.958828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:23.959713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:23.960408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:23.964705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-672ead96-87b4-4e29-b093-f5ccd739e809 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1694 microversion: 2.1 time: 0.814088 Mar 29 02:38:23.969348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2715/5211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:23 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1694 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:24.007054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:24.007663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:24.016944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:24.017924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:24.020296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:24.021067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:24.210552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:24.222136 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e0a4412-a36f-46ce-847d-b967b4dab996 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1279 microversion: 2.1 time: 0.278017 Mar 29 02:38:24.222724 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2497/5212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:23 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:24.301071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:24.316726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dfc79ac-1787-48a4-b278-8f3ef3ba9b15 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1307 microversion: 2.1 time: 0.312630 Mar 29 02:38:24.317954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2716/5213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:24 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1307 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:24.988636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:24.990747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:25.010844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.016462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:25.016462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.016462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:25.245769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:25.248408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:25.267943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.272419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:25.277909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.279990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:25.906425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:25.923148 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-16c87dc9-0a7a-4071-ac19-3a4d8ad910d2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.680060 Mar 29 02:38:25.924351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2717/5214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:25 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:25.929521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:25.932886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:25.952092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.952955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:25.955312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:25.963043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.292018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:26.312300 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9e4a88b-e35f-4747-8927-b9d116bfd44b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1691 microversion: 2.1 time: 1.330499 Mar 29 02:38:26.313587 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2498/5215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:24 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1691 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:26.323787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c396e5da-0883-4705-9683-5ffcd0926372 req-d49b9576-e42f-47d5-a1d2-0b1e536fc2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2197334c-7676-4865-94c0-fb42f0a92c71", "name": "network-vif-plugged", "status": "completed", "tag": "c491109f-69d5-4fe4-b385-13f90eed1d48"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:26.331216 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:26.331216 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:26.353676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c396e5da-0883-4705-9683-5ffcd0926372 req-d49b9576-e42f-47d5-a1d2-0b1e536fc2a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.354679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c396e5da-0883-4705-9683-5ffcd0926372 req-d49b9576-e42f-47d5-a1d2-0b1e536fc2a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.394158 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c396e5da-0883-4705-9683-5ffcd0926372 req-d49b9576-e42f-47d5-a1d2-0b1e536fc2a8 service nova] Creating event network-vif-plugged:c491109f-69d5-4fe4-b385-13f90eed1d48 for instance 2197334c-7676-4865-94c0-fb42f0a92c71 on n-h2-828148-1 Mar 29 02:38:26.403845 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c396e5da-0883-4705-9683-5ffcd0926372 req-d49b9576-e42f-47d5-a1d2-0b1e536fc2a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087757 Mar 29 02:38:26.405188 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2499/5216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:26.416040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:26.417051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:26.418913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:26.435698 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23600a1f-39c2-49aa-988e-305e23bc9adf tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1305 microversion: 2.1 time: 0.509944 Mar 29 02:38:26.441967 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2718/5217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:25 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1305 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:26.443071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.444665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.445507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.445954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.739509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b02f78a4-3819-409d-a475-17aee00c6482 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action" status: 204 len: 0 microversion: 2.1 time: 0.331086 Mar 29 02:38:26.743536 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2500/5218] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:38:26 2022] POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:38:26.748492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:26.754542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:26.765816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.766332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.767120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.767806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.942153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:26.943383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:26.953488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.956552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:26.956552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:26.956552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:28.034135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:28.057374 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-288bf2a6-e3e6-469e-bbf3-df101e36884e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1691 microversion: 2.1 time: 1.312465 Mar 29 02:38:28.070877 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2719/5219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:26 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1691 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:28.078160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:28.080743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:28.103992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:28.105602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:28.113681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:28.114329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:28.268655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:28.287913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f245bb40-13a8-4eb5-9bbd-584ae395ffdb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 1.349965 Mar 29 02:38:28.291207 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2501/5220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:26 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:28.317854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9fabf1d2-e43e-4f3a-90a3-2491f460d4f7 req-8020f0e8-bec3-425a-957d-03e67328600d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88d3071b-02cf-4e98-9589-28e82375e6c2", "tag": "d99f97a1-4633-431a-abc8-ce30ee2a8f90"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:28.323213 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:28.323213 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:28.331595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9fabf1d2-e43e-4f3a-90a3-2491f460d4f7 req-8020f0e8-bec3-425a-957d-03e67328600d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:28.332035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9fabf1d2-e43e-4f3a-90a3-2491f460d4f7 req-8020f0e8-bec3-425a-957d-03e67328600d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:28.356483 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9fabf1d2-e43e-4f3a-90a3-2491f460d4f7 req-8020f0e8-bec3-425a-957d-03e67328600d service nova] Creating event network-changed:d99f97a1-4633-431a-abc8-ce30ee2a8f90 for instance 88d3071b-02cf-4e98-9589-28e82375e6c2 on n-h1-828148-1 Mar 29 02:38:28.363191 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9fabf1d2-e43e-4f3a-90a3-2491f460d4f7 req-8020f0e8-bec3-425a-957d-03e67328600d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070957 Mar 29 02:38:28.364702 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2502/5221] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:28.523641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "name": "network-vif-plugged", "status": "completed", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:28.525831 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:28.525831 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:28.571899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:28.571899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:28.645394 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] Creating event network-vif-plugged:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:38:28.672597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] Instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:38:28.708260 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8a5d9783-3d91-4833-944e-79f4e552b06b req-c16ab2a1-e561-41b3-a4b4-99a8eccabaed service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193705 Mar 29 02:38:28.709748 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2503/5222] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:28.887607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:28.906026 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7946175-2a84-4420-9c4a-b02f09aad443 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.831095 Mar 29 02:38:28.908932 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2720/5223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:28 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:29.075982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:29.076511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:29.092207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.092661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:29.093746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.094510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:29.307451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:29.308079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:29.320873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.321328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:29.322116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.322548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:29.942533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:29.954419 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39bb0981-60f0-4f00-8d67-22a6a8437487 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.649744 Mar 29 02:38:29.965234 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2721/5224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:29 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:29.975012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:29.975793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:29.995405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.996210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:29.997244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:29.997910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:30.481833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:30.496259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1f231ee7-6377-4850-9880-ae35de729169 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1691 microversion: 2.1 time: 1.424232 Mar 29 02:38:30.497373 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2504/5225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:29 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1691 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:30.512562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-084e2803-7cc9-4e70-88f8-ca47ee6c3347 req-ecb5db7f-80c5-40af-a339-8923bea4002a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f453383e-6ba3-4b90-8c15-fc96a2aeab21", "tag": "d94a53f9-3d03-4034-ab98-c427be9b8509"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:30.514149 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:30.514149 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:30.529874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-084e2803-7cc9-4e70-88f8-ca47ee6c3347 req-ecb5db7f-80c5-40af-a339-8923bea4002a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:30.530311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-084e2803-7cc9-4e70-88f8-ca47ee6c3347 req-ecb5db7f-80c5-40af-a339-8923bea4002a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:30.572954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-084e2803-7cc9-4e70-88f8-ca47ee6c3347 req-ecb5db7f-80c5-40af-a339-8923bea4002a service nova] Creating event network-changed:d94a53f9-3d03-4034-ab98-c427be9b8509 for instance f453383e-6ba3-4b90-8c15-fc96a2aeab21 on n-h2-828148-1 Mar 29 02:38:30.601866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-084e2803-7cc9-4e70-88f8-ca47ee6c3347 req-ecb5db7f-80c5-40af-a339-8923bea4002a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101450 Mar 29 02:38:30.604026 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2505/5226] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:30.612162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1b6130bd-f5a1-45dd-acbf-efaf7b6baddc req-3584482e-da9c-4601-be75-22700c95e57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2661b1-fe93-418e-8f6d-6ab18330e327", "tag": "9283254e-eed0-41a4-a9e5-bea890aa9fbc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:30.614234 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:30.614234 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:30.635465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1b6130bd-f5a1-45dd-acbf-efaf7b6baddc req-3584482e-da9c-4601-be75-22700c95e57c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:30.636670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1b6130bd-f5a1-45dd-acbf-efaf7b6baddc req-3584482e-da9c-4601-be75-22700c95e57c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:30.699886 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1b6130bd-f5a1-45dd-acbf-efaf7b6baddc req-3584482e-da9c-4601-be75-22700c95e57c service nova] Creating event network-changed:9283254e-eed0-41a4-a9e5-bea890aa9fbc for instance 3c2661b1-fe93-418e-8f6d-6ab18330e327 on n-h1-828148-1 Mar 29 02:38:30.728262 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1b6130bd-f5a1-45dd-acbf-efaf7b6baddc req-3584482e-da9c-4601-be75-22700c95e57c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121900 Mar 29 02:38:30.733426 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2506/5227] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:30.733712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:30.756736 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a25104ff-849c-4324-8b05-d983adc1529f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.788887 Mar 29 02:38:30.758631 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2722/5228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:29 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:30.978002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:30.979615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:30.996263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:30.997057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:30.998856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:30.998856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:31.516423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:31.517205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:31.531250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:31.533158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:31.535823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:31.536545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:32.043330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:32.056366 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-067575b6-13da-46d4-9b1f-b28bae42d99e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1683 microversion: 2.1 time: 0.544263 Mar 29 02:38:32.057300 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2723/5229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:31 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:32.062456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:32.063920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:32.072320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:32.073229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:32.074241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:32.075109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:32.243704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:32.258738 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d248e9ce-8f2e-40a1-9b72-e4cac4c0b3c7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 1.291348 Mar 29 02:38:32.261415 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2507/5230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:30 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:32.663795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:32.673392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-490c7e20-e9f0-4df8-b2c1-fc8d0eb72166 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.614449 Mar 29 02:38:32.678146 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2724/5231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:32 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:33.277480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:33.278746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:33.287584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:33.288256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:33.289364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:33.289980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:33.693851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:33.694468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:33.705300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:33.706116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:33.706998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:33.707624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:33.775725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:33.788978 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82fb810f-a8df-4aff-9d6d-cf5cb999825b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.514769 Mar 29 02:38:33.798339 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2508/5232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:33 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:34.082709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:34.093603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15e1a6a5-d113-42bb-a575-708f072acd14 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.403453 Mar 29 02:38:34.103507 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2725/5233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:33 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:34.813375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:34.814853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:34.824292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:34.827848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:34.827848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:34.827848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:35.079990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:35.088514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49b449fc-6d26-4377-bec5-55a7bfc2fca9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.281907 Mar 29 02:38:35.099169 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2509/5234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:34 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:35.112360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:35.113876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:35.123014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:35.123782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:35.124877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:35.125812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:35.593997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:35.603844 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-931b0614-7bc1-4808-b402-477c9ea36d0d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.496571 Mar 29 02:38:35.628203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2726/5235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:35 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:36.105133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:36.105744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:36.113223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:36.113669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:36.114430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:36.114863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:36.336536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:36.345159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31351fe2-4dac-4b7a-b8a6-37151152035c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.243731 Mar 29 02:38:36.345719 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2510/5236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:36 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:36.621518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:36.622783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:36.650463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:36.650463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:36.650463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:36.650463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:37.195188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:37.205426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6b34416-a60d-4031-97c1-16749fe7887d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.586784 Mar 29 02:38:37.206636 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2727/5237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:36 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:37.249400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1070e839-8454-444c-bc86-5ddde20f84f4 req-21433182-f391-4bcc-b5fd-dad4342567ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f453383e-6ba3-4b90-8c15-fc96a2aeab21", "name": "network-vif-plugged", "status": "completed", "tag": "d94a53f9-3d03-4034-ab98-c427be9b8509"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:37.252505 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:37.252505 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:37.264988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1070e839-8454-444c-bc86-5ddde20f84f4 req-21433182-f391-4bcc-b5fd-dad4342567ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:37.266051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1070e839-8454-444c-bc86-5ddde20f84f4 req-21433182-f391-4bcc-b5fd-dad4342567ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:37.289757 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1070e839-8454-444c-bc86-5ddde20f84f4 req-21433182-f391-4bcc-b5fd-dad4342567ae service nova] Creating event network-vif-plugged:d94a53f9-3d03-4034-ab98-c427be9b8509 for instance f453383e-6ba3-4b90-8c15-fc96a2aeab21 on n-h2-828148-1 Mar 29 02:38:37.294690 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1070e839-8454-444c-bc86-5ddde20f84f4 req-21433182-f391-4bcc-b5fd-dad4342567ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050198 Mar 29 02:38:37.295934 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2511/5238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:37.363020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:37.364183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:37.378292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:37.385938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:37.387093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:37.387642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:38.095596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:38.105196 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-273dcc50-411b-4ddd-bf1c-2a45b84d40ba tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.747144 Mar 29 02:38:38.115243 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2728/5239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:37 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:38.223263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:38.223957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:38.240613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:38.240613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:38.240613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:38.240613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:38.657408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:38.671106 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ac1e29d-ae5a-41f5-a7bc-36c353c8017d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1373 microversion: 2.1 time: 0.452337 Mar 29 02:38:38.695696 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2512/5240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:38 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1373 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:39.122278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:39.122973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:39.133805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:39.134258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:39.143248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:39.143248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:39.545920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:39.559690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c47c57b-f0fe-4793-8e50-2fc22332d2e2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.439783 Mar 29 02:38:39.562726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2729/5241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:39 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:39.647260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7474961d-42d7-43c5-9427-e84813ec1fed req-736c1275-133f-4014-9950-4b23d33d9c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d3071b-02cf-4e98-9589-28e82375e6c2", "name": "network-vif-plugged", "status": "completed", "tag": "d99f97a1-4633-431a-abc8-ce30ee2a8f90"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:39.649349 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:39.649349 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:39.670420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7474961d-42d7-43c5-9427-e84813ec1fed req-736c1275-133f-4014-9950-4b23d33d9c8c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:39.671588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7474961d-42d7-43c5-9427-e84813ec1fed req-736c1275-133f-4014-9950-4b23d33d9c8c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:39.697667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:39.698551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:39.712616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:39.713500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:39.716897 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7474961d-42d7-43c5-9427-e84813ec1fed req-736c1275-133f-4014-9950-4b23d33d9c8c service nova] Creating event network-vif-plugged:d99f97a1-4633-431a-abc8-ce30ee2a8f90 for instance 88d3071b-02cf-4e98-9589-28e82375e6c2 on n-h1-828148-1 Mar 29 02:38:39.726247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:39.726247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:39.732408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7474961d-42d7-43c5-9427-e84813ec1fed req-736c1275-133f-4014-9950-4b23d33d9c8c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089879 Mar 29 02:38:39.736228 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2513/5242] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:38:40.012277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:40.032018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54d86774-8ccd-46af-a4d1-d93115bc33a9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1546 microversion: 2.1 time: 0.337909 Mar 29 02:38:40.035860 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2730/5243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:39 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:40.049934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:40.051123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:40.059083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:40.059767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:40.060765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:40.061417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:40.425957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:40.439707 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6af3247-93bd-4482-909b-1bc5749f4e29 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1546 microversion: 2.1 time: 0.393722 Mar 29 02:38:40.452359 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2514/5244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:40 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1546 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:40.582298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:40.583656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:40.592248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:40.593497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:40.595395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:40.596039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:41.290830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:41.301598 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de59f41b-19d4-4843-8198-6c389ced6b09 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.723825 Mar 29 02:38:41.311771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2731/5245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:40 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:41.815293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-81f716e0-ea53-4f43-b453-cdd06d1a4f14 req-eae84ae3-867c-4d2e-8eae-5679c1cf3bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2661b1-fe93-418e-8f6d-6ab18330e327", "name": "network-vif-plugged", "status": "completed", "tag": "9283254e-eed0-41a4-a9e5-bea890aa9fbc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:41.819119 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:41.819119 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:41.831776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-81f716e0-ea53-4f43-b453-cdd06d1a4f14 req-eae84ae3-867c-4d2e-8eae-5679c1cf3bf5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:41.834280 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-81f716e0-ea53-4f43-b453-cdd06d1a4f14 req-eae84ae3-867c-4d2e-8eae-5679c1cf3bf5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:41.859029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-81f716e0-ea53-4f43-b453-cdd06d1a4f14 req-eae84ae3-867c-4d2e-8eae-5679c1cf3bf5 service nova] Creating event network-vif-plugged:9283254e-eed0-41a4-a9e5-bea890aa9fbc for instance 3c2661b1-fe93-418e-8f6d-6ab18330e327 on n-h1-828148-1 Mar 29 02:38:41.867634 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-81f716e0-ea53-4f43-b453-cdd06d1a4f14 req-eae84ae3-867c-4d2e-8eae-5679c1cf3bf5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061215 Mar 29 02:38:41.869024 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2515/5246] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:42.319449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:42.321289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:42.328663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:42.329280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:42.330046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:42.330472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:43.011693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:43.028517 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43bff9c9-4c1c-46d7-9704-4d716d6a2462 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1321 microversion: 2.1 time: 0.713167 Mar 29 02:38:43.029149 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2732/5247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:42 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:44.046496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:44.048273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:44.056320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:44.056775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:44.057577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:44.058017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:44.521582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:44.531789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8200a3c7-7ab3-4174-957f-430f622f7571 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1511 microversion: 2.1 time: 0.489493 Mar 29 02:38:44.539178 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2516/5248] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:44 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:44.573300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:44.573300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:44.573300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:44.574426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:44.575528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:44.576326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:45.329721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:45.346771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be7d6281-51a2-430a-9daa-9653653a15ac tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1512 microversion: 2.1 time: 0.791696 Mar 29 02:38:45.349412 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2733/5249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:44 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:45.363975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:45.365239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:45.373285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:45.374047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:45.375026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:45.375451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:45.923183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:45.931924 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9875922a-c302-4865-84f0-a74f9e1edc0b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1511 microversion: 2.1 time: 0.571493 Mar 29 02:38:45.940533 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2517/5250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:45 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1511 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:45.955838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:45.959589 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:45.959589 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:45.965168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:45.965168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:45.983510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:45.983940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:45.984732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:45.985217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:46.088545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:46.201794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:46.210435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:46.211013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:46.903882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c80ba188-e17f-498a-82d4-73d48fd0933f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.952137 Mar 29 02:38:46.912404 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2734/5251] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Mar 29 02:38:45 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:46.931550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:46.942731 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:46.942731 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:46.945442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:46.949399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1745897883', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:46.963366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:46.964055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:46.965974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:46.966631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:47.097213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:47.210039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:47.217754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:47.218201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:47.501093 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e35f3554-2cc5-400c-8c23-3315493e0cca tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1745897883" status: 200 len: 1515 microversion: 2.1 time: 0.577080 Mar 29 02:38:47.516673 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2518/5252] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 02:38:46 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1745897883 => generated 1515 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:47.518714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:47.522001 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:47.522001 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:47.523001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:47.523910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:47.530554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:47.530994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:47.531795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:47.532700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:47.682631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:47.842714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:47.852544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:47.853477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:48.342121 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1076df74-365c-4aa2-8c3d-9575a8079153 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.823243 Mar 29 02:38:48.342121 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2735/5253] 10.222.0.36 () {58 vars in 1172 bytes} [Tue Mar 29 02:38:47 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:48.358943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:48.364307 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:48.364307 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:48.366126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:48.366957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.servers [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Removing options 'limit' from query {{(pid=103514) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1452}} Mar 29 02:38:48.368037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:48.376214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:48.377437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:48.379200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:48.380019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:48.523719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:48.534901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:48.534901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.289440 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aaac31e4-4900-4ac0-b30b-bfac103d18d5 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.934668 Mar 29 02:38:49.289900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2519/5254] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 02:38:48 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:49.307888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:49.311281 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:49.311281 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:49.312163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:49.315214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:49.325539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.325994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.326802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.334501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.467565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:49.612714 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa5e9cac-1257-452b-b1b4-ff4778fd546b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.305847 Mar 29 02:38:49.613722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2736/5255] 10.222.0.36 () {58 vars in 1151 bytes} [Tue Mar 29 02:38:49 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:49.625242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:49.629929 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:49.629929 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:49.635519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:49.637049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.servers [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Removing options 'limit' from query {{(pid=103514) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1452}} Mar 29 02:38:49.638100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:49.646433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.647430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.649760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.651225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.780190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:49.936260 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e01f5b88-9a61-4ba1-a23c-536204afb909 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.314503 Mar 29 02:38:49.937631 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2520/5256] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Mar 29 02:38:49 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:49.953405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:49.960047 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:49.960047 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:49.963753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:49.964794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:49.972303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.973017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:49.973986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:49.974511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.083480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:50.194855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ccae9da1-ec72-457a-aaf6-854f2cfa8469 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.249995 Mar 29 02:38:50.201636 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2737/5257] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 02:38:49 2022] GET /compute/v2.1/servers => generated 1012 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:50.213905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:50.226924 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:50.226924 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:50.230566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:50.233088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:50.271975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.272323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.273589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.274082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.478194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:50.641080 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7921711-041d-4dad-81a0-fac45b1e1d63 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.437427 Mar 29 02:38:50.656352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:50.661633 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:50.661633 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:50.662928 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2521/5258] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:38:50 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:50.664974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:50.664974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.servers [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Removing options 'limit' from query {{(pid=103513) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1452}} Mar 29 02:38:50.664974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:50.673117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.673929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.675011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.675722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.791563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22dafc70-934b-4f41-9b8e-3b02b365269c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.140427 Mar 29 02:38:50.805037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:50.808461 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:50.808461 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:38:50.810481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:50.811060 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2738/5259] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Mar 29 02:38:50 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:50.812037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1745897883', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:50.818983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.820026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:50.821225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:50.821920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:51.005064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:51.179197 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c7734db-5b19-407c-a2c5-83dc836eef85 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1745897883" status: 200 len: 346 microversion: 2.1 time: 0.378132 Mar 29 02:38:51.180132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2522/5260] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 02:38:50 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1745897883 => generated 346 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:38:51.192976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad0268e0-4976-4bcc-8579-55267e31e509 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:51.207534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad0268e0-4976-4bcc-8579-55267e31e509 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:51.208941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad0268e0-4976-4bcc-8579-55267e31e509 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:51.357780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad0268e0-4976-4bcc-8579-55267e31e509 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 02:38:51.575907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad0268e0-4976-4bcc-8579-55267e31e509 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "POST /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71/action" status: 202 len: 0 microversion: 2.1 time: 0.387764 Mar 29 02:38:51.576600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2739/5261] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:38:51 2022] POST /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:38:51.585552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:51.586165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:51.625419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:51.626767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:51.630760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:51.631514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:52.291514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:52.302111 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74f480a4-1495-4943-8702-164c6f4aa34f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1522 microversion: 2.1 time: 0.720660 Mar 29 02:38:52.311826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2523/5262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:51 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1522 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:53.319648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:53.320342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:53.329301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:53.330068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:53.331738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:53.332174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:53.591194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:53.604829 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-95e41e73-7141-4296-b3ea-856d17caa926 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1522 microversion: 2.1 time: 0.288444 Mar 29 02:38:53.607417 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2524/5263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:53 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:53.711560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:53.712171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:53.724258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:53.725948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:53.730000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:53.730760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:53.796655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f8a3de2-8a9e-4fb0-ab5b-e9619b4d88ff tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/ips" status: 200 len: 152 microversion: 2.20 time: 0.632169 Mar 29 02:38:53.798656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2740/5264] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Mar 29 02:38:53 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/ips => generated 152 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:38:54.623420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:54.624664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:54.636390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:54.636873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:54.645803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:54.648870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:55.028671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:55.037585 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9df7200b-64c9-4d03-a9b9-677629b6a7fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1522 microversion: 2.1 time: 0.417912 Mar 29 02:38:55.038474 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2525/5265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:54 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:56.055546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:56.056276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:56.064725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:56.065338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:56.066101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:56.066616 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:56.462399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:56.474008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f8a426ba-2c3e-4603-a02b-1ac3d84f68fb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1522 microversion: 2.1 time: 0.421717 Mar 29 02:38:56.475274 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2741/5266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:56 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:38:57.450394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:57.451084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:57.459041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.459935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:57.460861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.461305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:57.491968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:57.493372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:57.507693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.510877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:57.511992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.513192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:57.679743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lazy-loading 'flavor' on Instance uuid 311a177a-b334-41c7-bca5-534fabd7aa47 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:38:57.812740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:57.830845 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-112fc649-5004-4ad7-9f2e-ec591a3c03f7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1499 microversion: 2.1 time: 0.342525 Mar 29 02:38:57.833669 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2742/5267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:57 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1499 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:38:57.849196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:57.853472 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:38:57.853472 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:38:57.856428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:57.857650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:38:57.872250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.873407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:57.877553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:57.879654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.017246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:38:58.118867 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30f34384-f92f-4ab4-a1ea-ba846c1d2d35 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.273953 Mar 29 02:38:58.119652 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2743/5268] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Mar 29 02:38:57 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:38:58.132036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d376174-cc15-4e80-9b4c-06e67ca35c84 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:58.139731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d376174-cc15-4e80-9b4c-06e67ca35c84 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.140208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d376174-cc15-4e80-9b4c-06e67ca35c84 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.209792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d376174-cc15-4e80-9b4c-06e67ca35c84 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Going to try to start instance {{(pid=103513) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 02:38:58.550243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d376174-cc15-4e80-9b4c-06e67ca35c84 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "POST /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71/action" status: 202 len: 0 microversion: 2.1 time: 0.421536 Mar 29 02:38:58.553705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2744/5269] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:38:58 2022] POST /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:38:58.574355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:58.595025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:58.603838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e762e45b-71a7-4bb4-9abf-c1e4af1c5323 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/action" status: 202 len: 0 microversion: 2.20 time: 1.156052 Mar 29 02:38:58.606101 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2526/5270] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:38:57 2022] POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/action => generated 0 bytes in 1161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:38:58.621963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:38:58.623252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:58.623710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.624569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.627339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.628097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.640386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.640877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.645603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.646075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.799567 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e6d44b7-7e69-450a-afbd-e09dc18c1208 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action" status: 200 len: 24579 microversion: 2.1 time: 0.191643 Mar 29 02:38:58.809046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2527/5271] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:38:58 2022] POST /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad/action => generated 24579 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:38:58.813949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:38:58.819332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:38:58.839087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.839632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:58.840484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:38:58.845469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:38:59.196360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:59.211002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:59.213002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:59.214666 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-154d9e80-6cc5-4926-a228-5479e6513c20 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.412738 Mar 29 02:38:59.216240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2528/5272] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:38:58 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:38:59.268484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:38:59.279182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acc21411-bb7f-4c5a-8fe0-b6b3e280cb75 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1508 microversion: 2.1 time: 0.719798 Mar 29 02:38:59.279182 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2745/5273] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:38:58 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:00.233606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:00.234779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:00.243390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:00.243852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:00.244631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:00.245115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:00.295242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:00.295847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:00.311262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:00.311666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:00.312455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:00.318139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:00.592610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:00.602172 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e9e0bb6-c00e-4a71-bfb3-642a0cf61546 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1508 microversion: 2.1 time: 0.311290 Mar 29 02:39:00.604466 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2746/5274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:00 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:00.701320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:00.717998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:00.725193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:00.728414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bb65741c-f4ea-485d-b5d5-5099f27a5be5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.498467 Mar 29 02:39:00.733017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2529/5275] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:00 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:01.628004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:01.628632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:01.644180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:01.647065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:01.653730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:01.653730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:01.748732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:01.750048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:01.763354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:01.768742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:01.770981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:01.777471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.122165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.138173 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78de8a02-fbc8-4ed6-a9eb-cf889cba6524 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1512 microversion: 2.1 time: 0.519840 Mar 29 02:39:02.138750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2747/5276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:01 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:02.169833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:02.173852 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:02.173852 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:02.174903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.175348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.servers [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Removing options 'limit' from query {{(pid=103513) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1452}} Mar 29 02:39:02.176090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:02.185210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.185657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.186525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.186955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.188503 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80d8e7d5-bee3-43aa-8c30-67882aca8f19 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.023875 Mar 29 02:39:02.189099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2748/5277] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Mar 29 02:39:02 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 29 02:39:02.202026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:02.202884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:02.218196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.219063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.220608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.221269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.234303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.247550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.250292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.251105 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-289c8f41-3e76-4793-a3f7-980d34ee7bc4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.507164 Mar 29 02:39:02.261538 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2530/5278] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:01 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:02.678664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:02.698465 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d58c2126-af8c-480a-8e2c-939aa6fa98ef tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1512 microversion: 2.1 time: 0.499522 Mar 29 02:39:02.699794 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2749/5279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:02 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:02.715243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:02.716218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:02.724066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.724582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:02.725443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:02.726019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:03.270469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:03.271081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:03.283700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:03.284141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:03.289047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:03.290746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:03.506916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:03.515561 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6310e03a-4c2f-433e-9dd9-03ee5ad14d07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1511 microversion: 2.1 time: 0.803993 Mar 29 02:39:03.528887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2531/5280] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:02 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1511 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:03.534245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:03.534858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:03.557966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:03.558433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:03.562246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:03.562700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:03.950874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:03.963815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:03.966171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:03.967533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02382f82-3e89-4196-9d69-7c507a7f4d17 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.701863 Mar 29 02:39:03.978407 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2750/5281] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:03 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:04.329011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:04.344606 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-669ad53a-4795-4a08-8592-e15f8583bdf7 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1511 microversion: 2.1 time: 0.808177 Mar 29 02:39:04.344606 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2532/5282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:03 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1511 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:04.353929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:04.361980 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:04.361980 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:04.363514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:04.364419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:04.990272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:04.991023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:05.008908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.009861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:05.010775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.011480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:05.379439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:05.392348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:05.395046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:05.404905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfa563b9-8c0f-47c2-9236-b71b005ef661 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.422582 Mar 29 02:39:05.416673 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2533/5283] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:04 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:39:05.539296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.539848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:05.541006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.541542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:05.686430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:05.856450 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-688ee775-3cd7-4ff1-8c6e-afebcb0b365c tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 1.505316 Mar 29 02:39:05.857492 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2751/5284] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Mar 29 02:39:04 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:05.869030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:05.869668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:05.881443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.882228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:05.884164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:05.895064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:06.412445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:06.424036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:06.424596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:06.428182 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bcd2a5ff-adb0-4a7e-b223-d3327d2c6467 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1512 microversion: 2.1 time: 0.562876 Mar 29 02:39:06.433372 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2534/5285] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:05 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1512 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:06.452329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:06.452785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:06.453606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:06.454655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:06.457731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:06.460074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:06.483053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:06.484612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:06.488934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:06.490749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:07.233075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:07.246659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eced557b-3027-4024-a46c-8ae652ab492e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1511 microversion: 2.1 time: 0.798181 Mar 29 02:39:07.251901 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2535/5286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:06 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1511 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:07.269109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:07.270078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:07.286819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:07.290390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:07.291483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:07.292074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:08.395422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.409183 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c2c6c1a0-e37c-4bfc-a12b-4be0c0a3500e tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1511 microversion: 2.1 time: 1.143939 Mar 29 02:39:08.418095 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2536/5287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:07 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1511 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:08.429469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:08.433270 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:08.433270 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:08.434590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.435637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:08.442142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:08.442832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:08.444409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:08.445054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:08.575016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:08.662006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.676808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.678543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.684000 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-af13af0c-cc72-4992-92c8-9e72ce7300a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 2.264289 Mar 29 02:39:08.685619 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2752/5288] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:06 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 2266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:08.724409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:08.742679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:08.743306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:09.447646 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6f81eff7-0c77-4e97-a4e5-bb3136eb6443 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 1.022706 Mar 29 02:39:09.461279 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2537/5289] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 02:39:08 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:09.469177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:09.471537 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:09.471537 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:09.472847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:09.474145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:09.701094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:09.701694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:09.719002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:09.720233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:09.721223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:09.721849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:09.947720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:09.948849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:09.949848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:09.950282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.080083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:10.196190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a730e89f-764c-4491-a18d-1852df29faa1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.731802 Mar 29 02:39:10.197101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2753/5290] 10.222.0.36 () {58 vars in 1149 bytes} [Tue Mar 29 02:39:09 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:10.210966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:10.215256 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:10.215256 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:10.216736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.217700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:10.224699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.225341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.226338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.227029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.262829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.275567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.277095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.278238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f232b000-1fad-4649-a3a5-d2b4940182d0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.580851 Mar 29 02:39:10.278794 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2538/5291] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:09 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:39:10.337935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:10.460768 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9dfc8491-adbe-4bc4-8c25-45fa389d6790 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.254524 Mar 29 02:39:10.463061 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2754/5292] 10.222.0.36 () {58 vars in 1211 bytes} [Tue Mar 29 02:39:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:10.473724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:10.478321 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:10.478321 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:10.480343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.480733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:10.487547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.488177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.489417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.490050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.608961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:10.728416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0316db7-61c4-4648-914f-8e6504bd52eb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.258709 Mar 29 02:39:10.729618 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2539/5293] 10.222.0.36 () {58 vars in 1195 bytes} [Tue Mar 29 02:39:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:10.739618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:10.744087 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:10.744087 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:10.745609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:10.746288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': '1745897883', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:10.754009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.754606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.755602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:10.756048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:10.886054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:10.988730 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f2a6b44c-10c4-4a07-8b06-ae48616de243 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=1745897883" status: 200 len: 346 microversion: 2.1 time: 0.252931 Mar 29 02:39:10.989707 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2755/5294] 10.222.0.36 () {58 vars in 1155 bytes} [Tue Mar 29 02:39:10 2022] GET /compute/v2.1/servers?name=1745897883 => generated 346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:11.000533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:11.008580 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:11.008580 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:11.009979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:11.010855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103514) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:11.016871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.017543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.018770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.019380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.148922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.multi_cell_list [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=103514) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:11.268998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-313edce3-e823-49fc-97aa-72fb9030f016 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.271867 Mar 29 02:39:11.269873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2540/5295] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Mar 29 02:39:10 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:11.281647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:11.286240 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:11.286240 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:11.288426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:11.290005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-174589788', 'deleted': False, 'project_id': 'ba414e73401845a2af0efb2ce281649c'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 02:39:11.296821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.297100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:11.298207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:11.299341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.300565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.301390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.320129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.320665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.321530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.322019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.444046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 02:39:11.596560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4125436-d51e-40ae-a9bc-a8a727f5f3d4 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-174589788" status: 200 len: 346 microversion: 2.1 time: 0.319620 Mar 29 02:39:11.597472 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2756/5296] 10.222.0.36 () {58 vars in 1227 bytes} [Tue Mar 29 02:39:11 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-174589788 => generated 346 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:11.610329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:11.610749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:11.619792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.620333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.621147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:11.621590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:11.738204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:11.765037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:11.775760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:11.783373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:11.787884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39b81b3f-2aa6-442f-8516-e09d6cc862e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.494801 Mar 29 02:39:11.788769 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2541/5297] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:11 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:39:12.350260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2966883a-2848-4c90-b1b7-7aef7a01f76f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 204 len: 0 microversion: 2.1 time: 0.744185 Mar 29 02:39:12.351155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2757/5298] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:11 2022] DELETE /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:12.363590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:12.364559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:12.380803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:12.382757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:12.384281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:12.385094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:12.647243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:12.648029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:12.661579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:12.664230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:12.665252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:12.666877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:12.819446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:13.214243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c2688bd-1e2d-4ea6-a275-9fb05717f964 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 204 len: 0 microversion: 2.1 time: 0.571569 Mar 29 02:39:13.221981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2758/5299] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:12 2022] DELETE /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:13.235939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:13.241912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:13.251406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:13.252096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:13.253141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:13.253747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:13.381990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:13.394175 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad068d35-00aa-485a-bcad-5361f4d5d26f tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1517 microversion: 2.1 time: 1.032789 Mar 29 02:39:13.396716 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2542/5300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:12 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1517 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:13.409214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:13.410062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:13.425807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:13.426657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:13.434320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:13.435181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:14.130568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:14.142388 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8da927ae-5b8b-469e-8fab-2e587ee691f6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1552 microversion: 2.1 time: 0.743718 Mar 29 02:39:14.145984 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2543/5301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:13 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1552 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:14.414972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:14.416709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:14.432225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:14.433170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:14.434165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:14.434935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:14.645883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:14.661757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:14.667388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:14.670741 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48759bfe-04c6-41f1-8162-7b3a0b6dfac9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 1.443451 Mar 29 02:39:14.673600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2759/5302] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:13 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:15.160123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:15.161106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:15.177738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:15.177738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:15.178101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:15.178679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:15.235876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:15.251539 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d052a82d-98c8-4d72-b68e-f31802d15a3b tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1517 microversion: 2.1 time: 0.840086 Mar 29 02:39:15.253915 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2544/5303] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:14 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1517 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:15.691815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:15.692580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:15.708600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:15.709198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:15.710325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:15.710923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:16.208529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:16.220563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:16.223927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:16.225280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7ddebe6-bdad-47bc-8e79-b93996357110 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1744 microversion: 2.20 time: 0.537724 Mar 29 02:39:16.228472 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2545/5304] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:15 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1744 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:16.426869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-eb09e4e6-04ad-47d7-8e7e-9ecdaede58e6 req-29e5914b-c7e7-4eff-9ea8-395bbbf8d812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2661b1-fe93-418e-8f6d-6ab18330e327", "name": "network-vif-deleted", "tag": "9283254e-eed0-41a4-a9e5-bea890aa9fbc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:16.428722 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:16.428722 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:16.441573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eb09e4e6-04ad-47d7-8e7e-9ecdaede58e6 req-29e5914b-c7e7-4eff-9ea8-395bbbf8d812 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:16.442346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-eb09e4e6-04ad-47d7-8e7e-9ecdaede58e6 req-29e5914b-c7e7-4eff-9ea8-395bbbf8d812 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:16.464125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-eb09e4e6-04ad-47d7-8e7e-9ecdaede58e6 req-29e5914b-c7e7-4eff-9ea8-395bbbf8d812 service nova] Creating event network-vif-deleted:9283254e-eed0-41a4-a9e5-bea890aa9fbc for instance 3c2661b1-fe93-418e-8f6d-6ab18330e327 on n-h1-828148-1 Mar 29 02:39:16.471811 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-eb09e4e6-04ad-47d7-8e7e-9ecdaede58e6 req-29e5914b-c7e7-4eff-9ea8-395bbbf8d812 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241743 Mar 29 02:39:16.476566 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2546/5305] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:16.479738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:16.480425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:16.481808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:16.488310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:16.488762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:16.489568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:16.490001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:16.498422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f38ebbbc-b6fc-4733-84bb-567bfede346b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1552 microversion: 2.1 time: 1.342670 Mar 29 02:39:16.508374 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2760/5306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:15 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1552 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:16.571607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:16.573069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:16.573720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lazy-loading 'fault' on Instance uuid 3c2661b1-fe93-418e-8f6d-6ab18330e327 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:39:16.727914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:16.738537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-75614fc2-21b0-4377-9de0-a5421363eb55 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 200 len: 1311 microversion: 2.1 time: 0.264225 Mar 29 02:39:16.748604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2547/5307] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:16 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:17.250315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:17.251472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:17.275790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.278191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.280638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.282913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.517618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:17.519032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:17.536637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.538624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.541275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.541942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.745403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:17.757495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d660705e-1ff5-4cc3-aa62-ccff136cbf62 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1484 microversion: 2.1 time: 0.242803 Mar 29 02:39:17.760670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2548/5308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:17 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1484 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:17.776200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:17.776887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 3c2661b1-fe93-418e-8f6d-6ab18330e327] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:17.798424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.798887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.799773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:17.805649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:17.927541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] HTTP exception thrown: Instance 3c2661b1-fe93-418e-8f6d-6ab18330e327 could not be found. Mar 29 02:39:17.928145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Returning 404 to user: Instance 3c2661b1-fe93-418e-8f6d-6ab18330e327 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:17.929057 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e49a3401-2fc1-4c5a-a66f-4f85c975e816 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327" status: 404 len: 111 microversion: 2.1 time: 0.167250 Mar 29 02:39:17.929650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2549/5309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:17 2022] GET /compute/v2.1/servers/3c2661b1-fe93-418e-8f6d-6ab18330e327 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:39:18.047174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0a3542a5-fd4b-4757-b096-7400d38c1cf7 req-5dd6d335-f855-4f05-8ea5-82b28951f951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f453383e-6ba3-4b90-8c15-fc96a2aeab21", "name": "network-vif-deleted", "tag": "d94a53f9-3d03-4034-ab98-c427be9b8509"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:18.049412 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:18.049412 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:18.067942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0a3542a5-fd4b-4757-b096-7400d38c1cf7 req-5dd6d335-f855-4f05-8ea5-82b28951f951 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.068648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0a3542a5-fd4b-4757-b096-7400d38c1cf7 req-5dd6d335-f855-4f05-8ea5-82b28951f951 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.112217 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0a3542a5-fd4b-4757-b096-7400d38c1cf7 req-5dd6d335-f855-4f05-8ea5-82b28951f951 service nova] Creating event network-vif-deleted:d94a53f9-3d03-4034-ab98-c427be9b8509 for instance f453383e-6ba3-4b90-8c15-fc96a2aeab21 on n-h2-828148-1 Mar 29 02:39:18.117483 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0a3542a5-fd4b-4757-b096-7400d38c1cf7 req-5dd6d335-f855-4f05-8ea5-82b28951f951 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186595 Mar 29 02:39:18.119472 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2550/5310] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:18.126418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:18.127277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:18.139465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.140335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.141725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.142443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.225013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:18.534751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:18.543790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:18.545326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:18.553841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be3613a0-72e3-4e24-ab80-ee52a201b3ef tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1744 microversion: 2.20 time: 1.309378 Mar 29 02:39:18.557419 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2761/5311] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:17 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1744 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:18.709124 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e360f3dc-27d5-435f-bc68-b97586af46a2 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 204 len: 0 microversion: 2.1 time: 0.586982 Mar 29 02:39:18.711466 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2551/5312] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:18 2022] DELETE /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:18.720069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:18.721547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:18.731888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.732430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.737469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.737919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.775816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:18.777229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:18.786686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.788301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.793259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.795087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.905400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:18.906094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:18.908219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lazy-loading 'fault' on Instance uuid f453383e-6ba3-4b90-8c15-fc96a2aeab21 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:39:19.303511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:19.315692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25502847-b275-434a-be49-1fbbae1610f1 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1517 microversion: 2.1 time: 0.599851 Mar 29 02:39:19.325683 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2762/5313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:18 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1517 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:19.388326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:19.448241 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ed236b4-567c-4e53-a789-231688cab2f3 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 200 len: 1337 microversion: 2.1 time: 0.676408 Mar 29 02:39:19.454565 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2552/5314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:18 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 1337 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:19.576339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:19.577009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:19.589554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:19.590395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:19.591409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:19.592012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.112545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:20.135471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:20.139428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:20.140126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8d09b393-3624-4515-9ef6-cd8306f8dff4 req-bb23cebc-4f28-4864-a1b5-cdbd730cef5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "name": "network-vif-plugged", "status": "completed", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:20.142204 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f8002d6-362f-451c-81bc-effbf846161f tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1744 microversion: 2.20 time: 0.569977 Mar 29 02:39:20.144359 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:20.144359 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:20.153698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8d09b393-3624-4515-9ef6-cd8306f8dff4 req-bb23cebc-4f28-4864-a1b5-cdbd730cef5c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:20.154489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8d09b393-3624-4515-9ef6-cd8306f8dff4 req-bb23cebc-4f28-4864-a1b5-cdbd730cef5c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.162364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2763/5315] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:19 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1744 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:20.187519 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8d09b393-3624-4515-9ef6-cd8306f8dff4 req-bb23cebc-4f28-4864-a1b5-cdbd730cef5c service nova] Creating event network-vif-plugged:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h1-828148-1 Mar 29 02:39:20.218238 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8d09b393-3624-4515-9ef6-cd8306f8dff4 req-bb23cebc-4f28-4864-a1b5-cdbd730cef5c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165610 Mar 29 02:39:20.218853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2553/5316] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:39:20.332919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:20.333998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:20.346559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:20.350020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.356711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:20.356711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.474615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:20.475327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: f453383e-6ba3-4b90-8c15-fc96a2aeab21] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:20.505757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:20.506491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.507658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:20.508283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:20.627205 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] HTTP exception thrown: Instance f453383e-6ba3-4b90-8c15-fc96a2aeab21 could not be found. Mar 29 02:39:20.628071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Returning 404 to user: Instance f453383e-6ba3-4b90-8c15-fc96a2aeab21 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:20.630288 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69d9e530-0c71-4669-80d2-730675ff8536 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21" status: 404 len: 111 microversion: 2.1 time: 0.161736 Mar 29 02:39:20.633210 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2554/5317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:20 2022] GET /compute/v2.1/servers/f453383e-6ba3-4b90-8c15-fc96a2aeab21 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:39:21.161161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:21.168954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:21.173309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:21.181925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:21.183023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:21.183636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:21.606994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:21.606994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e702e098-57d7-4f33-9252-dd8bf8c0f4a6 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1517 microversion: 2.1 time: 1.045585 Mar 29 02:39:21.606994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2764/5318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:20 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1517 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:21.611667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:21.625007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:21.645550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:21.645994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:21.648224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:21.648663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:22.496773 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-050ca90f-9f60-4fc8-bbfe-b62576d2aa70 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1834 microversion: 2.1 time: 0.891675 Mar 29 02:39:22.497705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2765/5319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:21 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1834 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:22.502649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2ad3072-ca8a-4d9b-8b08-d0549778be91 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '.version_select at 0x7f87242e84c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:22.611963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2ad3072-ca8a-4d9b-8b08-d0549778be91 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2131989858" status: 202 len: 0 microversion: 2.1 time: 0.113152 Mar 29 02:39:22.616105 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2766/5320] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2131989858 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:39:22.629550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:22.630231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:22.640505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:22.640985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:22.642054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:22.642647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:22.804468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:22.833047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:22.845339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:22.847819 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03c8831e-149b-4ab2-96a9-b49071d8f619 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 1.689902 Mar 29 02:39:22.850843 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2555/5321] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:21 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:39:23.292032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e1a3d840-1890-4837-92a9-638bf778c25e req-8dd56f42-6cf3-4e72-95bc-77b043cc15cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88d3071b-02cf-4e98-9589-28e82375e6c2", "name": "network-vif-deleted", "tag": "d99f97a1-4633-431a-abc8-ce30ee2a8f90"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:23.294087 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:23.294087 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:23.314351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e1a3d840-1890-4837-92a9-638bf778c25e req-8dd56f42-6cf3-4e72-95bc-77b043cc15cf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:23.315046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e1a3d840-1890-4837-92a9-638bf778c25e req-8dd56f42-6cf3-4e72-95bc-77b043cc15cf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:23.351604 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e1a3d840-1890-4837-92a9-638bf778c25e req-8dd56f42-6cf3-4e72-95bc-77b043cc15cf service nova] Creating event network-vif-deleted:d99f97a1-4633-431a-abc8-ce30ee2a8f90 for instance 88d3071b-02cf-4e98-9589-28e82375e6c2 on n-h1-828148-1 Mar 29 02:39:23.358382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e1a3d840-1890-4837-92a9-638bf778c25e req-8dd56f42-6cf3-4e72-95bc-77b043cc15cf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073653 Mar 29 02:39:23.361082 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2556/5322] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:23.567827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:23.577061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1fe80748-aeca-492a-8e40-19d9a497f924 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 200 len: 1475 microversion: 2.1 time: 0.956591 Mar 29 02:39:23.590166 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2767/5323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:22 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 1475 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:23.870914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:23.872020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:23.895406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:23.896241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:23.897808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:23.898465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:24.606292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:24.606920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 88d3071b-02cf-4e98-9589-28e82375e6c2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:24.625275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:24.625760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:24.626554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:24.626991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:24.699178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] HTTP exception thrown: Instance 88d3071b-02cf-4e98-9589-28e82375e6c2 could not be found. Mar 29 02:39:24.699812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Returning 404 to user: Instance 88d3071b-02cf-4e98-9589-28e82375e6c2 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:24.704540 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e1bff1cb-3176-48df-9484-3e883d810e07 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2" status: 404 len: 111 microversion: 2.1 time: 0.101714 Mar 29 02:39:24.707830 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2768/5324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:24 2022] GET /compute/v2.1/servers/88d3071b-02cf-4e98-9589-28e82375e6c2 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:39:24.714783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:24.715467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:24.725379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:24.726820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:24.727886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:24.728725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:24.814520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:24.914213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:24.934484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:24.934484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:24.934484 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-804dde7d-d073-48b2-9ad3-c7bedbaef894 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 1.067487 Mar 29 02:39:24.953909 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2557/5325] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:23 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:25.260078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e2ba178f-2faf-4f0b-a753-ad785ac719e3 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 204 len: 0 microversion: 2.1 time: 0.549137 Mar 29 02:39:25.260656 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2769/5326] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:24 2022] DELETE /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:25.268938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:25.269777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:25.279426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:25.285739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:25.286640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:25.287146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:25.961836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:25.962533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:25.974613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:25.975064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:25.975847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:25.976281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:26.479853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:26.488049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:26.489779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:26.491083 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aca53ca5-7685-4326-b3ee-d7ac89fbef75 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 0.533719 Mar 29 02:39:26.501091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2770/5327] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:25 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:26.506703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:26.507935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:26.524357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:26.525446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:26.529881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:26.530495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:26.667123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:27.138574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d98798d-2213-4bff-b8fc-0049bed2fd94 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 204 len: 0 microversion: 2.1 time: 0.635762 Mar 29 02:39:27.139272 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2771/5328] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:26 2022] DELETE /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:27.149523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c38f61a4-d7e8-4d56-a13d-485313ed1a97 req-e629cd28-ce4b-4e3e-a41c-19e555fe8ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:27.154855 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:27.154855 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:27.177859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c38f61a4-d7e8-4d56-a13d-485313ed1a97 req-e629cd28-ce4b-4e3e-a41c-19e555fe8ece service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:27.178966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c38f61a4-d7e8-4d56-a13d-485313ed1a97 req-e629cd28-ce4b-4e3e-a41c-19e555fe8ece service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:27.222034 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c38f61a4-d7e8-4d56-a13d-485313ed1a97 req-e629cd28-ce4b-4e3e-a41c-19e555fe8ece service nova] Creating event network-changed:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:39:27.237149 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c38f61a4-d7e8-4d56-a13d-485313ed1a97 req-e629cd28-ce4b-4e3e-a41c-19e555fe8ece service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088044 Mar 29 02:39:27.239299 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2772/5329] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:27.268648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:27.270200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:27.282755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:27.283552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:27.284630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:27.285269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:27.789418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:27.805611 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f4b070b-7e94-4d0f-85a6-80192f4693bb tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1518 microversion: 2.1 time: 2.540321 Mar 29 02:39:27.806793 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2558/5330] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:25 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1518 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:27.813157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:27.813969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:27.822438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:27.823154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:27.824828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:27.825788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:27.928100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:27.943998 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-09c4e9c1-b2ee-48cb-a7fc-bbedd6e6ddcd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1689 microversion: 2.1 time: 0.689276 Mar 29 02:39:27.950203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2773/5331] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:27 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1689 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:28.860539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:28.963493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:28.963493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:28.963843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lazy-loading 'fault' on Instance uuid 2197334c-7676-4865-94c0-fb42f0a92c71 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:39:29.258456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3ff6e0b42d4168b9d9263fd42dc331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba414e73401845a2af0efb2ce281649c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:29.269238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5833a232-6f5b-4db1-92e2-1a96a8ff4350 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 200 len: 1311 microversion: 2.1 time: 0.445446 Mar 29 02:39:29.270049 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2774/5332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:28 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 1311 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:29.279105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:29.280065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:29.289846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:29.290439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:29.291632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:29.292288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:29.540309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:29.577788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:29.588198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:29.593581 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9b8d6768-af81-434b-93d9-db5a460da4a0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 1.782126 Mar 29 02:39:29.595411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2559/5333] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:27 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:29.614233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d2e41b99-7678-455e-9110-52a2a032e96e req-552bdf57-4cec-4b06-89cf-324208148489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2197334c-7676-4865-94c0-fb42f0a92c71", "name": "network-vif-deleted", "tag": "c491109f-69d5-4fe4-b385-13f90eed1d48"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:29.617011 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:29.617011 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:39:29.647575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d2e41b99-7678-455e-9110-52a2a032e96e req-552bdf57-4cec-4b06-89cf-324208148489 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:29.649401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d2e41b99-7678-455e-9110-52a2a032e96e req-552bdf57-4cec-4b06-89cf-324208148489 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:29.682098 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d2e41b99-7678-455e-9110-52a2a032e96e req-552bdf57-4cec-4b06-89cf-324208148489 service nova] Creating event network-vif-deleted:c491109f-69d5-4fe4-b385-13f90eed1d48 for instance 2197334c-7676-4865-94c0-fb42f0a92c71 on n-h2-828148-1 Mar 29 02:39:29.689268 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d2e41b99-7678-455e-9110-52a2a032e96e req-552bdf57-4cec-4b06-89cf-324208148489 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091259 Mar 29 02:39:29.693389 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2560/5334] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:29.777766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:29.788476 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6eb70afe-feb6-4ebc-b62f-48b3431396cf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1689 microversion: 2.1 time: 0.515388 Mar 29 02:39:29.804576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2775/5335] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:29 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1689 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:30.287690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:30.288608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] [instance: 2197334c-7676-4865-94c0-fb42f0a92c71] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:30.296937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.298206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:30.299150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.299732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:30.355201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] HTTP exception thrown: Instance 2197334c-7676-4865-94c0-fb42f0a92c71 could not be found. Mar 29 02:39:30.356252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] Returning 404 to user: Instance 2197334c-7676-4865-94c0-fb42f0a92c71 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:30.357364 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9cac8756-c807-4be0-ae75-0c51164576a9 tempest-ListServerFiltersTestJSON-1231726242 tempest-ListServerFiltersTestJSON-1231726242-project] 10.222.0.36 "GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71" status: 404 len: 111 microversion: 2.1 time: 0.074012 Mar 29 02:39:30.358730 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2561/5336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:30 2022] GET /compute/v2.1/servers/2197334c-7676-4865-94c0-fb42f0a92c71 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:39:30.613407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:30.614851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:30.642860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.645159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:30.647661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.648318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:30.815204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:30.815204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:30.828154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.834167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:30.835161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:30.835723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:31.218950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:31.240054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:31.242161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:31.243563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57392e0d-254f-42d7-acfb-b08813f46586 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 0.634121 Mar 29 02:39:31.245943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2776/5337] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:30 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:32.262860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:32.264099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:32.281166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:32.281834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:32.282795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:32.290529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:32.907309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:32.919858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:32.924083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:32.925423 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4de932fb-fb49-449f-9a4c-f2fab4c4a4ea tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 0.666809 Mar 29 02:39:32.938968 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2777/5338] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:32 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:39:32.945176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-11f55a1b-d7cd-439b-baf8-f3f2e3e3f1e5 req-20616faa-e355-4259-80c2-3494e8cbfede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "name": "network-vif-unplugged", "status": "completed", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:32.947019 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:32.947019 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:32.960222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-11f55a1b-d7cd-439b-baf8-f3f2e3e3f1e5 req-20616faa-e355-4259-80c2-3494e8cbfede service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:32.960222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-11f55a1b-d7cd-439b-baf8-f3f2e3e3f1e5 req-20616faa-e355-4259-80c2-3494e8cbfede service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:33.011627 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-11f55a1b-d7cd-439b-baf8-f3f2e3e3f1e5 req-20616faa-e355-4259-80c2-3494e8cbfede service nova] Creating event network-vif-unplugged:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:39:33.026345 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-11f55a1b-d7cd-439b-baf8-f3f2e3e3f1e5 req-20616faa-e355-4259-80c2-3494e8cbfede service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086555 Mar 29 02:39:33.027568 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2778/5339] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:33.635063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:33.646599 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b29eba2a-8f5b-456c-8f1b-6527027bd51c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1689 microversion: 2.1 time: 2.839403 Mar 29 02:39:33.655491 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2562/5340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:30 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1689 bytes in 2847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:33.949477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:33.950833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:33.985260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:33.986205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:33.987201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:33.987830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:34.442126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:34.453163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:34.456250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:34.460531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f687210f-74f5-4681-8689-9098ee48dfd6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 0.515904 Mar 29 02:39:34.461530 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2779/5341] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:33 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:34.663713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:34.664488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:34.672700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:34.677311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:34.678424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:34.678925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:35.482175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:35.482803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:35.502322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:35.502788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:35.503583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:35.504013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:36.186425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:36.204883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:36.206400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:36.207564 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70396f20-8273-465c-bbb7-f7e15ef619f2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 0.729694 Mar 29 02:39:36.210006 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2780/5342] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:35 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:36.405733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:36.414909 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db0c0188-a5c0-42aa-8244-599af8fe6681 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1570 microversion: 2.1 time: 1.755304 Mar 29 02:39:36.418561 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2563/5343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:34 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1570 bytes in 1759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:37.068781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6e7b8bf8-5529-4c80-a892-93045be37871 req-6445202f-d9f8-43db-96b7-792da953866a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd4c3214-ee8e-4183-a7fa-6f6b83e247ad", "name": "network-vif-deleted", "tag": "b17389d2-291c-49c9-8df3-8d29abb1d08a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:37.070441 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:37.070441 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:37.088711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e7b8bf8-5529-4c80-a892-93045be37871 req-6445202f-d9f8-43db-96b7-792da953866a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:37.089417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e7b8bf8-5529-4c80-a892-93045be37871 req-6445202f-d9f8-43db-96b7-792da953866a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:37.123107 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6e7b8bf8-5529-4c80-a892-93045be37871 req-6445202f-d9f8-43db-96b7-792da953866a service nova] Creating event network-vif-deleted:b17389d2-291c-49c9-8df3-8d29abb1d08a for instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad on n-h1-828148-1 Mar 29 02:39:37.147190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6e7b8bf8-5529-4c80-a892-93045be37871 req-6445202f-d9f8-43db-96b7-792da953866a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081840 Mar 29 02:39:37.148390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2781/5344] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:37.229552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:37.230277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:37.241432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:37.244906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:37.251000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:37.251690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:37.432033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:37.432898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:37.449528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:37.450042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:37.451108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:37.453181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:37.811583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:37.820326 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b8548edf-5960-48be-91f2-9d35cf11fd54 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 200 len: 1352 microversion: 2.1 time: 0.392384 Mar 29 02:39:37.821547 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2782/5345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:37 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 1352 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:38.471849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:38.491532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:38.498361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:38.504278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c4b8d8e-4cc1-4d34-adc3-694cdc6f02b1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 1.275892 Mar 29 02:39:38.506446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2564/5346] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:37 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:38.718527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8840dd3-5373-44ae-bda7-30365ebde69c tempest-ComputeTenantNetworksTest-35294230 tempest-ComputeTenantNetworksTest-35294230-project] Calling method '.version_select at 0x7f8724bf9430>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:38.838842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:38.839553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: fd4c3214-ee8e-4183-a7fa-6f6b83e247ad] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:38.859188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:38.859858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:38.862023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:38.862957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:38.932749 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] HTTP exception thrown: Instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad could not be found. Mar 29 02:39:38.933591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Returning 404 to user: Instance fd4c3214-ee8e-4183-a7fa-6f6b83e247ad could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:38.934672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34cc31a0-ead8-456e-9075-d809953672e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad" status: 404 len: 111 microversion: 2.1 time: 0.100106 Mar 29 02:39:38.936077 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2565/5347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:38 2022] GET /compute/v2.1/servers/fd4c3214-ee8e-4183-a7fa-6f6b83e247ad => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:39:39.273332 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8840dd3-5373-44ae-bda7-30365ebde69c tempest-ComputeTenantNetworksTest-35294230 tempest-ComputeTenantNetworksTest-35294230-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.870939 Mar 29 02:39:39.278446 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2783/5348] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 02:39:38 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:39:39.279030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:39.279030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:39.283326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-274cc361-2d3c-4f2f-8c55-2ea69fade0fe tempest-ComputeTenantNetworksTest-35294230 tempest-ComputeTenantNetworksTest-35294230-project] Calling method '.version_select at 0x7f8717fc01f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:39.290886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.292656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.293580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.295784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.455781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:39:39.908746 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-274cc361-2d3c-4f2f-8c55-2ea69fade0fe tempest-ComputeTenantNetworksTest-35294230 tempest-ComputeTenantNetworksTest-35294230-project] 10.222.0.36 "GET /compute/v2.1/os-tenant-networks/c0005e35-ca90-4400-9b46-4d6e4f000219" status: 200 len: 139 microversion: 2.1 time: 0.628944 Mar 29 02:39:39.909351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2784/5349] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:39:39 2022] GET /compute/v2.1/os-tenant-networks/c0005e35-ca90-4400-9b46-4d6e4f000219 => generated 139 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:39:39.920645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c3c4ba0b-6a4f-444e-8f5c-fd83dc4d7685 req-b9b1a8ab-354d-4a75-b024-2a10ff74334b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d2fdcee-f948-4e39-8f07-3c6bed071962", "tag": "bc652a6a-82a0-447f-a76d-389e43a16911"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:39.922632 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:39.922632 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:39.943869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c3c4ba0b-6a4f-444e-8f5c-fd83dc4d7685 req-b9b1a8ab-354d-4a75-b024-2a10ff74334b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.944497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c3c4ba0b-6a4f-444e-8f5c-fd83dc4d7685 req-b9b1a8ab-354d-4a75-b024-2a10ff74334b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.956481 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98605793-9ce0-41ff-b54a-5b30b0fd628f tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 204 len: 0 microversion: 2.1 time: 0.683904 Mar 29 02:39:39.960411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2566/5350] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:39:39 2022] DELETE /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:39:39.964875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:39.965689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:39.970199 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c3c4ba0b-6a4f-444e-8f5c-fd83dc4d7685 req-b9b1a8ab-354d-4a75-b024-2a10ff74334b service nova] Creating event network-changed:bc652a6a-82a0-447f-a76d-389e43a16911 for instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 on n-h1-828148-1 Mar 29 02:39:39.975883 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c3c4ba0b-6a4f-444e-8f5c-fd83dc4d7685 req-b9b1a8ab-354d-4a75-b024-2a10ff74334b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059014 Mar 29 02:39:39.976679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2785/5351] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:39.982155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.982647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:39.983620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:39.984775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.986468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.988612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.992542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.993352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:39.994272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:39.994841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:41.076633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:41.092662 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0db566eb-f668-4c9f-a8c4-0e046644d250 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1668 microversion: 2.1 time: 1.114595 Mar 29 02:39:41.094018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2786/5352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:39 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1668 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:42.084711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:42.101323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:42.103953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:42.115612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:42.117128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:42.127109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9cef747-119b-4312-8a14-4407ed0af63d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 2.167102 Mar 29 02:39:42.136043 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2567/5353] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:39 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:42.139076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:42.139707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:42.140857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:42.141717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:43.154793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:43.155462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:43.180323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:43.183464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:43.184542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:43.185136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:44.242150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:44.251600 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27da998f-a671-4be8-8ace-d5a3d5199d8d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1668 microversion: 2.1 time: 2.143678 Mar 29 02:39:44.261994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2787/5354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:42 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1668 bytes in 2155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:44.717272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:44.752366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:44.757920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:44.760483 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f35058a-e3b2-4cb6-8762-8d27bba3897b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1739 microversion: 2.20 time: 1.609462 Mar 29 02:39:44.762916 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2568/5355] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:43 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1739 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:45.269956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:45.270844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:45.279575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:45.280138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:45.281082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:45.281782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:45.783753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:45.784964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:45.796596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:45.797266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:45.799497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:45.800062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:46.079811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:46.089991 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f5dffc9-e4b9-47e7-acc3-59233653882a tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1550 microversion: 2.1 time: 0.825008 Mar 29 02:39:46.091249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2788/5356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:45 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1550 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:46.158821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f7268b5a-7521-441a-9d0e-d2b9ebbdeaef req-541c9530-f218-4af0-ba9f-e7d47b0f3b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d2fdcee-f948-4e39-8f07-3c6bed071962", "name": "network-vif-deleted", "tag": "bc652a6a-82a0-447f-a76d-389e43a16911"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:46.161935 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:46.161935 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:46.175019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f7268b5a-7521-441a-9d0e-d2b9ebbdeaef req-541c9530-f218-4af0-ba9f-e7d47b0f3b8b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:46.175886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f7268b5a-7521-441a-9d0e-d2b9ebbdeaef req-541c9530-f218-4af0-ba9f-e7d47b0f3b8b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:46.203177 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f7268b5a-7521-441a-9d0e-d2b9ebbdeaef req-541c9530-f218-4af0-ba9f-e7d47b0f3b8b service nova] Creating event network-vif-deleted:bc652a6a-82a0-447f-a76d-389e43a16911 for instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 on n-h1-828148-1 Mar 29 02:39:46.209802 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f7268b5a-7521-441a-9d0e-d2b9ebbdeaef req-541c9530-f218-4af0-ba9f-e7d47b0f3b8b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057679 Mar 29 02:39:46.210977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2789/5357] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:39:46.577673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:46.588655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:46.597469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:46.605416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74dca31c-c2cc-4ad6-aa3f-79e015cd707e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1721 microversion: 2.20 time: 0.826790 Mar 29 02:39:46.608932 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2569/5358] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:45 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1721 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:47.109092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:47.110491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:47.123353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:47.124268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:47.125293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:47.147040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:47.256261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:47.256725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:47.257225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lazy-loading 'fault' on Instance uuid 5d2fdcee-f948-4e39-8f07-3c6bed071962 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:39:47.496798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:47.506119 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13865ad9-d03a-4fea-b633-d90525c39c50 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 200 len: 1338 microversion: 2.1 time: 0.401443 Mar 29 02:39:47.506722 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2790/5359] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:47 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 1338 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:39:47.657417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:47.658946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:47.694165 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:47.695126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:47.696317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:47.697154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:48.528680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:48.529330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: 5d2fdcee-f948-4e39-8f07-3c6bed071962] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:48.540019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:48.540484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:48.541274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:48.541702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:48.630832 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] HTTP exception thrown: Instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 could not be found. Mar 29 02:39:48.631479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Returning 404 to user: Instance 5d2fdcee-f948-4e39-8f07-3c6bed071962 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:39:48.632315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-628f3b91-5c8e-4be9-b190-ecccad3c9879 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962" status: 404 len: 111 microversion: 2.1 time: 0.107325 Mar 29 02:39:48.637151 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2791/5360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:39:48 2022] GET /compute/v2.1/servers/5d2fdcee-f948-4e39-8f07-3c6bed071962 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:39:48.685808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:48.695681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:48.706088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:48.707894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ecb1148-f685-4369-af39-1c7b6ff56844 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1721 microversion: 2.20 time: 1.080251 Mar 29 02:39:48.710056 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2570/5361] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:47 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1721 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:49.559497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95058b5d-2304-4fe8-8c19-1f04cc5d96e4 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '.version_select at 0x7f8724bf9b80>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:49.672003 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95058b5d-2304-4fe8-8c19-1f04cc5d96e4 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1428311122" status: 202 len: 0 microversion: 2.1 time: 0.116384 Mar 29 02:39:49.676925 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2792/5362] 10.222.0.36 () {58 vars in 1256 bytes} [Tue Mar 29 02:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1428311122 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:39:49.726769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:49.727436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:49.736115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:49.736562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:49.737370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:49.737796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:49.879577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ac9ba9cc-abe5-4fd2-8729-d7cfac05663d req-5c2781d4-83b3-41a6-8a55-170ee3ccaa8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "name": "network-vif-unplugged", "status": "completed", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:49.881191 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:39:49.881191 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:39:49.890911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ac9ba9cc-abe5-4fd2-8729-d7cfac05663d req-5c2781d4-83b3-41a6-8a55-170ee3ccaa8b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:49.891974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ac9ba9cc-abe5-4fd2-8729-d7cfac05663d req-5c2781d4-83b3-41a6-8a55-170ee3ccaa8b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:49.910006 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ac9ba9cc-abe5-4fd2-8729-d7cfac05663d req-5c2781d4-83b3-41a6-8a55-170ee3ccaa8b service nova] Creating event network-vif-unplugged:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h1-828148-1 Mar 29 02:39:49.915518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ac9ba9cc-abe5-4fd2-8729-d7cfac05663d req-5c2781d4-83b3-41a6-8a55-170ee3ccaa8b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040308 Mar 29 02:39:49.917837 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2793/5363] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:39:50.753797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:50.773884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:50.790098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:50.792576 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e615f279-b244-42e4-ad5c-5976476879c4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1721 microversion: 2.20 time: 1.069346 Mar 29 02:39:50.793720 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2571/5364] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:49 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1721 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:51.813702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:51.814459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:51.830955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:51.831405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:51.834362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:51.834804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:52.128768 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:39:52.129373 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:39:52.547181 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:39:52.576916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:52.595055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:52.597863 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:52.598859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6ddb70d-0d37-4a64-8584-ca27b203aea1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '.version_select at 0x7f8717f5c700>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:52.600409 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ab69d59-1cdf-4658-97e9-361fb38e44bd tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1664 microversion: 2.20 time: 0.791969 Mar 29 02:39:52.602936 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2794/5365] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:51 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1664 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:52.631292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e8185b-af85-49d4-91f3-37d558754c4d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:52.632352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:52.643071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:52.644090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:52.645169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:52.657915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:52.707287 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6ddb70d-0d37-4a64-8584-ca27b203aea1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1841528173" status: 202 len: 0 microversion: 2.1 time: 0.112614 Mar 29 02:39:52.708068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2572/5366] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 02:39:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1841528173 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:39:52.745831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: .version_select at 0x7f87241dc430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-122193079"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:52.800907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:39:52.815862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:39:53.205408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:39:53.215799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:39:53.233094 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19070ba8-8be6-4bab-8c16-4327b2807541 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.496388 Mar 29 02:39:53.234219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2573/5367] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:39:52 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:39:53.556482 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57866. Mar 29 02:39:54.053869 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-547b8476-edea-4cc0-8c49-4b2455f0278b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.426333 Mar 29 02:39:54.064191 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2795/5368] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Mar 29 02:39:52 2022] POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments => generated 188 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:39:54.274704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:54.275993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:54.286649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:54.287267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:54.288187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:54.288942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:55.241297 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cbf8461d-2349-4cf9-bd61-15064f6108e5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments/97e8185b-af85-49d4-91f3-37d558754c4d" status: 202 len: 0 microversion: 2.20 time: 0.971263 Mar 29 02:39:55.242530 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2574/5369] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Mar 29 02:39:54 2022] DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments/97e8185b-af85-49d4-91f3-37d558754c4d => generated 0 bytes in 973 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:39:55.364742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:39:55.365819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:55.379952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:55.380582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:55.383130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:55.383763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:55.891045 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c04f7c2-9d23-4548-94e4-0b7d371b808e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/action" status: 202 len: 0 microversion: 2.20 time: 0.523086 Mar 29 02:39:55.891045 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2796/5370] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Mar 29 02:39:55 2022] POST /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:39:55.894813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:55.896140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:55.910033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:55.915059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:55.915059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:55.915059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:56.525816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:56.537789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:56.542413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:56.544071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f5433515-4eac-4ae9-968f-a2e30eb653a5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1672 microversion: 2.20 time: 0.653396 Mar 29 02:39:56.565852 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2575/5371] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:55 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1672 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:57.563823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:57.565272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:57.577958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:57.584648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:57.585869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:57.588910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:58.204503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:58.226053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:58.226053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:58.226053 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4deb476-ce2e-4d6d-bfc1-a91363449772 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1672 microversion: 2.20 time: 0.663685 Mar 29 02:39:58.226053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2797/5372] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:57 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1672 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:39:59.243759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:39:59.244371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:39:59.252652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:59.253152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:59.253930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:39:59.254405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:39:59.679065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:59.689936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:59.694941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:39:59.694941 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-68761dab-0922-460b-b549-6008d5899d52 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.453508 Mar 29 02:39:59.694941 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2576/5373] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:39:59 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:00.712606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:00.713268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:00.728542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:00.729530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:00.732351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:00.733356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:01.535669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:01.545703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:01.547454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:01.548721 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-516209af-5601-48a7-9973-07f3f050c2c0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.840669 Mar 29 02:40:01.561131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2798/5374] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:00 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:02.081359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1ea2c704-7df6-482c-b57e-514644131fbe req-81eddf06-75ba-4001-982f-595380e6d161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:02.082915 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:02.082915 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:02.098368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ea2c704-7df6-482c-b57e-514644131fbe req-81eddf06-75ba-4001-982f-595380e6d161 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:02.098800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ea2c704-7df6-482c-b57e-514644131fbe req-81eddf06-75ba-4001-982f-595380e6d161 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:02.121377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1ea2c704-7df6-482c-b57e-514644131fbe req-81eddf06-75ba-4001-982f-595380e6d161 service nova] Creating event network-changed:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h2-828148-1 Mar 29 02:40:02.128947 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1ea2c704-7df6-482c-b57e-514644131fbe req-81eddf06-75ba-4001-982f-595380e6d161 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051666 Mar 29 02:40:02.129550 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2577/5375] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:40:02.566647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:02.568203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:02.577146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:02.578394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:02.579161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:02.579978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:03.794495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:03.810165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:03.811675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:03.812816 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db5353a9-13da-49fa-b280-55bea23d2f2e tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 1.250140 Mar 29 02:40:03.826597 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2799/5376] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:02 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:04.837499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:04.838871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:04.856805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:04.860379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:04.860379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:04.862249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:05.285578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:05.307517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:05.309355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:05.310521 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b05df21-e24c-4438-8948-ac1a16728ab8 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.479282 Mar 29 02:40:05.311079 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2578/5377] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:04 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:06.330458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:06.331845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:06.343576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:06.348947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:06.350650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:06.352941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:07.589205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:07.600288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:07.613207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:07.619810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-84412674-41e6-4856-a192-60f9eb8faeca tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 1.293743 Mar 29 02:40:07.624886 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2800/5378] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:06 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:08.649472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:08.652571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:08.674274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:08.678176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:08.713093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:08.714271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:10.383691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:10.414334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:10.416942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:10.422153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-767072c7-d06e-469f-ad64-0bf66163a503 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 1.781748 Mar 29 02:40:10.424534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2579/5379] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:08 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:11.442588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:11.444282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:11.463185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:11.463999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:11.469083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:11.469083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:12.395871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:12.410561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:12.413596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:12.418432 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f1ce53a8-f18a-41d6-9769-96edc50f1048 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.981182 Mar 29 02:40:12.430199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2801/5380] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:11 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:13.441251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:13.442920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:13.464580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:13.467213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:13.468181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:13.472901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:13.918766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:13.935209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:13.941600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:13.946596 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fceb06ae-52c5-419d-8730-130c6d86d625 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.511324 Mar 29 02:40:13.947201 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2580/5381] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:13 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:14.964569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:14.965206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:14.992694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:14.993448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:15.002290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:15.004813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:16.714698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:16.724798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:16.730646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:16.745209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39a12ea3-acf5-439a-90a6-43e62974e9fc tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 1.777530 Mar 29 02:40:16.753577 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2802/5382] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:14 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:17.761640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:17.762292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:17.799415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:17.801174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:17.814542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:17.815267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:18.989583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:18.998820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:19.001562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:19.003037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0fd0b5b7-e5d0-4ba5-b6d6-88d90e8f53c5 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 1.246008 Mar 29 02:40:19.004190 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2581/5383] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:17 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:19.624011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: .version_select at 0x7f8717ed60d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-369388537"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:19.732336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:40:19.755709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:40:19.888370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-963864485", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "37863c18-9725-4d2b-acca-c69a80e50289"}], "key_name": "tempest-TestNetworkAdvancedServerOps-122193079", "security_groups": [{"name": "tempest-secgroup-smoke-137200719"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:20.233476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] validate_networks() for [('37863c18-9725-4d2b-acca-c69a80e50289', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:40:20.302804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:40:20.322675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:40:20.364435 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-096dcd37-5eaa-4257-bdb1-9d7b768fbdec tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.744965 Mar 29 02:40:20.368312 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2803/5384] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:40:19 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:20.383600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:20.385312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:20.403787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:20.408279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:20.409379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:20.412341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:21.297075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:21.311102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:21.312656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:21.314068 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b347b513-c6a0-49d9-a89c-3f786105d267 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.941690 Mar 29 02:40:21.314758 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2804/5385] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:20 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:22.337802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:22.340127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:22.382586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:22.386779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:22.386779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:22.386779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:22.897818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:22.909891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:22.911380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:22.912510 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f12a105e-b6b4-48e7-92a6-a3f641e981f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.582171 Mar 29 02:40:22.925259 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2805/5386] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:22 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:22.944583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:40:22.945092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:40:22.945660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:40:22.945936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:40:22.946485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:40:22.957585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:22.958360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:22.959696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:22.960349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:22.984059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:40:22.991701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:40:23.009461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:40:23.011206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:40:23.137098 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-740a269b-10e7-4dca-9234-7d809e8e42a5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.252432 Mar 29 02:40:23.158110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6abd7d48-2a86-4601-ba42-b094840bcac2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:23.158110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6abd7d48-2a86-4601-ba42-b094840bcac2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:23.158424 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2582/5387] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:40:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 3269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:40:23.398800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6abd7d48-2a86-4601-ba42-b094840bcac2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:23.417856 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6abd7d48-2a86-4601-ba42-b094840bcac2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1265 microversion: 2.1 time: 0.273225 Mar 29 02:40:23.418517 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2806/5388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:23 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:23.931186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:23.932259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:23.942328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:23.948023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:23.948023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:23.948023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:24.437628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:24.439340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:24.451310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:24.452290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:24.453992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:24.454617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:24.456701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:24.505534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:24.510097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:24.512428 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb3ae0c7-e979-45eb-a728-a8b3bd8f3655 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.585583 Mar 29 02:40:24.532703 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2583/5389] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:23 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:24.538802 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:40:24.649567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:24.668729 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fce69a73-851e-46ec-a1f1-0086642a3fb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1269 microversion: 2.1 time: 0.230895 Mar 29 02:40:24.670201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2807/5390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:24 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1269 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:25.535632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:25.536193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:25.544225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:25.544675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:25.545483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:25.545914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:25.686410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:25.687115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:25.709309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:25.709753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:25.718481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:25.721063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:25.809628 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58612. Mar 29 02:40:26.146522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:26.159123 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1b483f2-6ad5-4a2e-a50b-44188e5ee386 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1325 microversion: 2.1 time: 0.476139 Mar 29 02:40:26.162213 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2808/5391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:25 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:40:26.435722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:26.449265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:26.456776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:26.458410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40e18419-0315-45a9-bec6-bf06dd8b32f4 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.927961 Mar 29 02:40:26.459012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2584/5392] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:25 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:27.175578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:27.176306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:27.184917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:27.185680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:27.186628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:27.187424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:27.199614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-571653417", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a2541ded-0e71-47c4-bad7-e917e9ce87e1"}], "key_name": "tempest-TestNetworkBasicOps-369388537", "security_groups": [{"name": "tempest-secgroup-smoke-357600724"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:27.413646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:27.428770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42777669-f4cf-4c48-803d-a692cb7382c4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1323 microversion: 2.1 time: 0.256541 Mar 29 02:40:27.429549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2809/5393] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:27 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:40:27.480083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:27.481110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:27.490847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:27.491577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:27.492536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:27.493166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:27.658222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] validate_networks() for [('a2541ded-0e71-47c4-bad7-e917e9ce87e1', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:40:28.148276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:28.164137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:28.192132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:28.195352 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81c84a20-c743-4b10-ae07-5e84f9419f0c tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.722984 Mar 29 02:40:28.196221 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2810/5394] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:27 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:28.446977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:28.447600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:28.458411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:28.462530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:28.463393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:28.463846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.027220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:29.041570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-74256e20-3a71-4aae-afeb-4252cf9cb168 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.597508 Mar 29 02:40:29.044911 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2811/5395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:28 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:29.215143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:29.216620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:29.226465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:29.226908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.227890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:29.228417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.459553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:29.469691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:29.471480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:29.472664 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3ce03532-d786-4cd2-a1e0-36ed29fa47e6 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.262509 Mar 29 02:40:29.473251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2812/5396] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:29 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:29.485713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9df1cefb-0c8d-4b51-990d-5975f2c4cf83 req-1205b726-22ca-4945-aa5e-6b1b5b86b862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "name": "network-vif-plugged", "status": "completed", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:29.487338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:40:29.487802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:40:29.488278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:40:29.489575 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:29.489575 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:40:29.501969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9df1cefb-0c8d-4b51-990d-5975f2c4cf83 req-1205b726-22ca-4945-aa5e-6b1b5b86b862 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:29.502311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9df1cefb-0c8d-4b51-990d-5975f2c4cf83 req-1205b726-22ca-4945-aa5e-6b1b5b86b862 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.502801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:40:29.503389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:40:29.522074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:29.522758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.523784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:29.524557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:29.528384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9df1cefb-0c8d-4b51-990d-5975f2c4cf83 req-1205b726-22ca-4945-aa5e-6b1b5b86b862 service nova] Creating event network-vif-plugged:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h2-828148-1 Mar 29 02:40:29.533575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9df1cefb-0c8d-4b51-990d-5975f2c4cf83 req-1205b726-22ca-4945-aa5e-6b1b5b86b862 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053859 Mar 29 02:40:29.536579 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2813/5397] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:40:29.543990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:40:29.554976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Getting quotas for user 27ab6cafcaba40f98aef667e23602ed4 and project 7dbd80d7c1654dd0b3bfe22e02d3e571. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:40:29.568068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:40:29.570586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:40:29.748227 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0ebc7e2-b6f6-440b-a3f1-9ec484147cc9 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.541225 Mar 29 02:40:29.748977 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2585/5398] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:40:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 02:40:29.761705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bfa50fc9-49fd-4808-8e6e-8b3e4bc56e7e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:29.765316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bfa50fc9-49fd-4808-8e6e-8b3e4bc56e7e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:29.868189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bfa50fc9-49fd-4808-8e6e-8b3e4bc56e7e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:29.877642 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bfa50fc9-49fd-4808-8e6e-8b3e4bc56e7e tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1247 microversion: 2.1 time: 0.121494 Mar 29 02:40:29.887313 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2814/5399] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:29 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1247 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:30.062458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:30.063263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:30.088928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.089387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.090316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.093251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.492622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:30.493903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:30.503532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.504261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.507405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.507405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.674670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:30.691929 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88a51e58-0dd8-40e6-9a0b-a6eed474941a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.631626 Mar 29 02:40:30.692670 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2586/5400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:30 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:30.775606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:30.788674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:30.792448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:30.793879 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00d4a6c2-7d65-4b4a-9476-5e62d6645241 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.305485 Mar 29 02:40:30.794751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2815/5401] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:30 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:30.797353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-451ccb99-4fc1-410e-b0fa-41f6f20c4b7e req-eff421a5-db1d-4c8a-8b08-b9c2f9bf5f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:30.798926 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:30.798926 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:30.820271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-451ccb99-4fc1-410e-b0fa-41f6f20c4b7e req-eff421a5-db1d-4c8a-8b08-b9c2f9bf5f2a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.822109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-451ccb99-4fc1-410e-b0fa-41f6f20c4b7e req-eff421a5-db1d-4c8a-8b08-b9c2f9bf5f2a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.840683 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-451ccb99-4fc1-410e-b0fa-41f6f20c4b7e req-eff421a5-db1d-4c8a-8b08-b9c2f9bf5f2a service nova] Creating event network-changed:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:40:30.846294 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-451ccb99-4fc1-410e-b0fa-41f6f20c4b7e req-eff421a5-db1d-4c8a-8b08-b9c2f9bf5f2a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052683 Mar 29 02:40:30.846938 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2587/5402] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:40:30.896110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:30.897376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:30.905576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.906281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:30.907276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:30.907721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:31.074036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:31.082577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7201e283-9873-4b82-8802-56a19343d3cb tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1251 microversion: 2.1 time: 0.191544 Mar 29 02:40:31.083726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2816/5403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:30 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1251 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:31.708598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:31.709941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:31.718157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:31.719039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:31.720681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:31.721338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:31.812275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:31.813146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:31.820926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:31.821566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:31.822454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:31.822992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:32.196385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:32.208096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:32.210315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:32.236202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:32.239600 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dad31f03-b9d1-4f1c-87c7-5b9a5ad17e5b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.431133 Mar 29 02:40:32.240602 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2817/5404] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:31 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:32.245549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:32.253167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:32.260644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:32.268943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:32.271647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:32.272191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:32.272418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dfbc702a-14b1-48d5-b506-298e0b9d1c26 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.568484 Mar 29 02:40:32.282605 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2588/5405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:31 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:32.505912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:32.525089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02ace559-f349-4fca-900d-8b845b65c367 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1307 microversion: 2.1 time: 0.282949 Mar 29 02:40:32.525681 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2818/5406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:32 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:33.259094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:33.259706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:33.273527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.274041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.275001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.275584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.290793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:33.293741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:33.304289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.304882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.305865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.306501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.560079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:33.570634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:33.572198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:33.573505 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-641143b1-272a-4a99-9636-7c81153955e0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1730 microversion: 2.20 time: 0.318119 Mar 29 02:40:33.574335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2589/5407] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:33 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:40:33.579669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:33.580263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:33.588526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.589011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.589780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:33.590206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:33.765244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:33.774372 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ae9e94fb-6066-4fe5-971b-9eddf8639396 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.488205 Mar 29 02:40:33.774956 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2819/5408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:33 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:33.980034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:33.993544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b84774af-c7e5-4fa7-bb8c-a9a796784678 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.417971 Mar 29 02:40:33.996890 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2590/5409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:33 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:34.592361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:34.593602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:34.602483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:34.606763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:34.606763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:34.606763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:34.794547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:34.795213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:34.810972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:34.811791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:34.815757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:34.816444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:35.162988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:35.178511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:35.179941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:35.181118 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e25e3ae-2c7c-4931-847f-d7c32e73f041 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1717 microversion: 2.20 time: 0.592835 Mar 29 02:40:35.181667 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2820/5410] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:40:34 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1717 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:40:35.201481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:35.202383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:35.225033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:35.234882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:35.234882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:35.237230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:35.307964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:35.319212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c1c6cf1-8cf7-4488-8564-c39acfe8a3dc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.528679 Mar 29 02:40:35.320570 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2591/5411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:34 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:40:35.470850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-229d7d7e-b62a-4577-bbcf-5db4d94d5e89 req-e8b0a223-d2fc-4ee9-8b02-9ce33754e5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0afca1d-98ce-48e7-bb7c-135f072174ea", "tag": "0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:35.472731 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:35.472731 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:35.487506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-229d7d7e-b62a-4577-bbcf-5db4d94d5e89 req-e8b0a223-d2fc-4ee9-8b02-9ce33754e5cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:35.488028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-229d7d7e-b62a-4577-bbcf-5db4d94d5e89 req-e8b0a223-d2fc-4ee9-8b02-9ce33754e5cb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:35.509586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-229d7d7e-b62a-4577-bbcf-5db4d94d5e89 req-e8b0a223-d2fc-4ee9-8b02-9ce33754e5cb service nova] Creating event network-changed:0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c for instance d0afca1d-98ce-48e7-bb7c-135f072174ea on n-h2-828148-1 Mar 29 02:40:35.517152 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-229d7d7e-b62a-4577-bbcf-5db4d94d5e89 req-e8b0a223-d2fc-4ee9-8b02-9ce33754e5cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057081 Mar 29 02:40:35.521132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2592/5412] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:40:35.851723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:35.867066 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d59901c0-bb7f-41d2-8aab-045ccd0864ad tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.676372 Mar 29 02:40:35.867649 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2821/5413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:35 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:36.341526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:36.342573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:36.359348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:36.365468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:36.366723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:36.367308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:36.826077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:36.837663 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c18b443-4d1a-4d03-b0e8-76a0b0993ae2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.501604 Mar 29 02:40:36.849859 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2593/5414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:36 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:36.886265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:36.888517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:36.898871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:36.899918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:36.901395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:36.902382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:37.193661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:37.202180 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1d2a735c-4423-49d9-a39e-5e3b0461d934 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.320997 Mar 29 02:40:37.216451 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2822/5415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:36 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:37.855543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:37.856145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:37.864551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:37.864914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:37.865891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:37.866324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:38.117718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:38.127865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44c19ad5-04d0-4640-a878-66a087b48191 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.276045 Mar 29 02:40:38.139106 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2594/5416] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:37 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:38.204923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f6e58a67-80b1-4138-b14a-b563f0e47175 req-e987021a-138e-45b8-becd-627e723fa3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-plugged", "status": "completed", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:38.214161 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:38.214161 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:40:38.221972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6e58a67-80b1-4138-b14a-b563f0e47175 req-e987021a-138e-45b8-becd-627e723fa3a9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:38.222900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f6e58a67-80b1-4138-b14a-b563f0e47175 req-e987021a-138e-45b8-becd-627e723fa3a9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:38.223261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:38.223841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:38.231269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:38.237206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:38.237206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:38.237206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:38.260307 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f6e58a67-80b1-4138-b14a-b563f0e47175 req-e987021a-138e-45b8-becd-627e723fa3a9 service nova] Creating event network-vif-plugged:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:40:38.266030 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f6e58a67-80b1-4138-b14a-b563f0e47175 req-e987021a-138e-45b8-becd-627e723fa3a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068721 Mar 29 02:40:38.267059 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2823/5417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:40:38.561323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:38.570502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d60a7f1f-1465-4ed2-b19b-daa2372e5eef tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.351028 Mar 29 02:40:38.571104 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2595/5418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:38 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:39.146656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:39.148058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:39.158481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:39.159143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:39.160050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:39.160474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:39.439980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:39.448509 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-69a3de49-2934-41fc-a52c-30c341253fef tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1390 microversion: 2.1 time: 0.306532 Mar 29 02:40:39.449116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2824/5419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:39 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1390 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:40:39.587527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:39.588625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:39.596822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:39.597299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:39.598213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:39.598652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:39.929132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:39.938108 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d16d223-7f1d-4a41-b854-4345b642b0e6 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.354335 Mar 29 02:40:39.941363 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2596/5420] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:39 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:40.465845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:40.467112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:40.496170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.496679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:40.497619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.498115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:40.850301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:40.858443 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4109a69-367a-43ec-ac97-0af84ec84d70 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1562 microversion: 2.1 time: 0.397286 Mar 29 02:40:40.859006 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2825/5421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:40 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1562 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:40.877678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:40.878284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:40.887216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.888678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:40.889599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.890039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:40.961668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:40.962550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:40.972755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.973422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:40.974292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:40.974819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:41.196952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:41.206744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ead34bd7-6c99-4f0f-b8f3-cd4ad5414013 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1562 microversion: 2.1 time: 0.333083 Mar 29 02:40:41.215155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2597/5422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:40 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1562 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:41.338069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-77e9cca0-a40a-46d5-80d9-69f3431ee3be req-e8e104a9-b10f-42ec-a813-29e5fc94468c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0afca1d-98ce-48e7-bb7c-135f072174ea", "name": "network-vif-plugged", "status": "completed", "tag": "0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:41.345628 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:41.345628 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:41.350351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-77e9cca0-a40a-46d5-80d9-69f3431ee3be req-e8e104a9-b10f-42ec-a813-29e5fc94468c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:41.351313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-77e9cca0-a40a-46d5-80d9-69f3431ee3be req-e8e104a9-b10f-42ec-a813-29e5fc94468c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:41.369212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-77e9cca0-a40a-46d5-80d9-69f3431ee3be req-e8e104a9-b10f-42ec-a813-29e5fc94468c service nova] Creating event network-vif-plugged:0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c for instance d0afca1d-98ce-48e7-bb7c-135f072174ea on n-h2-828148-1 Mar 29 02:40:41.375001 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-77e9cca0-a40a-46d5-80d9-69f3431ee3be req-e8e104a9-b10f-42ec-a813-29e5fc94468c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040457 Mar 29 02:40:41.376227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2598/5423] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:40:41.437962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:41.447452 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5be0dd3e-cedb-4634-b3a1-d254e5e0d82d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.493493 Mar 29 02:40:41.448015 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2826/5424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:40 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:42.465149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:42.466252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:42.474453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:42.475019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:42.475877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:42.476464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:42.937562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:42.946565 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c8488fd6-e0e4-483d-b7a8-3ee62fc0a66b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1372 microversion: 2.1 time: 0.485663 Mar 29 02:40:42.947222 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2599/5425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:42 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1372 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:43.964489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:43.965234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:43.983022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:43.983562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:43.984443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:43.985700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:44.300947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:44.309592 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-df3ffcd1-a346-400c-8ef1-a849f35f4c04 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1543 microversion: 2.1 time: 0.349938 Mar 29 02:40:44.321067 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2827/5426] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:43 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1543 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:44.327087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:44.327753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:44.335251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:44.335498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:44.336217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:44.336666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:44.830930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:44.839644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-77c94d39-8ddb-4db5-9d15-db7ec69bb567 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1543 microversion: 2.1 time: 0.516503 Mar 29 02:40:44.840464 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2600/5427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:44 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1543 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:40:45.067113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:40:45.067784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:40:45.072498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4dfa9323-cef5-4784-8508-11231b0e75bb req-ee1b8ca4-430c-4702-b2d8-7cecb44f4fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:45.074710 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:45.074710 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:45.088630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:45.090796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4dfa9323-cef5-4784-8508-11231b0e75bb req-ee1b8ca4-430c-4702-b2d8-7cecb44f4fc5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:45.091268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:45.092134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:45.092623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4dfa9323-cef5-4784-8508-11231b0e75bb req-ee1b8ca4-430c-4702-b2d8-7cecb44f4fc5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:45.093182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:45.131802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4dfa9323-cef5-4784-8508-11231b0e75bb req-ee1b8ca4-430c-4702-b2d8-7cecb44f4fc5 service nova] Creating event network-changed:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:40:45.144554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4dfa9323-cef5-4784-8508-11231b0e75bb req-ee1b8ca4-430c-4702-b2d8-7cecb44f4fc5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075819 Mar 29 02:40:45.145614 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2601/5428] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:40:45.587752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:40:45.596875 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e48f92b8-438e-4ed2-a041-e24e5cd76614 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1562 microversion: 2.1 time: 0.533356 Mar 29 02:40:45.600275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2828/5429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:40:45 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1562 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:40:49.127476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6aef9fb4-8acb-48be-821c-d313cd71079d req-3d13123d-f57d-41cd-9e7f-aa3fd8036cbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0afca1d-98ce-48e7-bb7c-135f072174ea", "tag": "0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:40:49.129159 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:40:49.129159 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:40:49.139059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6aef9fb4-8acb-48be-821c-d313cd71079d req-3d13123d-f57d-41cd-9e7f-aa3fd8036cbb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:40:49.139732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6aef9fb4-8acb-48be-821c-d313cd71079d req-3d13123d-f57d-41cd-9e7f-aa3fd8036cbb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:40:49.159497 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6aef9fb4-8acb-48be-821c-d313cd71079d req-3d13123d-f57d-41cd-9e7f-aa3fd8036cbb service nova] Creating event network-changed:0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c for instance d0afca1d-98ce-48e7-bb7c-135f072174ea on n-h2-828148-1 Mar 29 02:40:49.165330 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6aef9fb4-8acb-48be-821c-d313cd71079d req-3d13123d-f57d-41cd-9e7f-aa3fd8036cbb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041919 Mar 29 02:40:49.166108 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2602/5430] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:05.138792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:05.139896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:05.147889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.148338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:05.149158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.149807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:05.213849 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43a7cad6-db94-49a8-81bd-87ca84f257d1 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079376 Mar 29 02:41:05.214411 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2829/5431] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Mar 29 02:41:05 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:05.307837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:05.308495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:05.316900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.317556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:05.318486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.319272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:05.382257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:41:05.723517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b341375-4e28-4db1-a348-61349268228b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 204 len: 0 microversion: 2.20 time: 0.419655 Mar 29 02:41:05.723517 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2603/5432] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:41:05 2022] DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:41:05.731746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:05.732356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:05.740346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.740791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:05.741581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:05.742014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:06.010688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:06.012488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:06.014210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:06.015577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a77d2f5a-20c5-42eb-a18f-1d86a1cc1af0 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.287481 Mar 29 02:41:06.016208 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2830/5433] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:05 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:41:07.036284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:07.036949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:07.044433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:07.045294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:07.046749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:07.047387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:07.297056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:07.309679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:07.316051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:07.329776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d150a1f-80bd-4521-b3a1-41f560e2061d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1723 microversion: 2.20 time: 0.298043 Mar 29 02:41:07.331202 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2604/5434] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:07 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 29 02:41:08.348542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:08.349684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:08.357685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:08.358343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:08.359296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:08.360971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:08.577144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:08.586703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:08.588212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:08.589560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56f8e356-5f73-4084-8944-74701a6ce02b tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1655 microversion: 2.20 time: 0.245356 Mar 29 02:41:08.590119 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2831/5435] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:08 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1655 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:41:09.187289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f1b98508-5f49-4df8-95ce-8dbb8b1bfcf8 req-5b49d1cd-91e5-477a-8de9-19359ad18320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311a177a-b334-41c7-bca5-534fabd7aa47", "name": "network-vif-deleted", "tag": "d5af460e-d636-4d2c-b689-5f601e29e409"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:09.190166 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:41:09.190166 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:41:09.200796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f1b98508-5f49-4df8-95ce-8dbb8b1bfcf8 req-5b49d1cd-91e5-477a-8de9-19359ad18320 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.201333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f1b98508-5f49-4df8-95ce-8dbb8b1bfcf8 req-5b49d1cd-91e5-477a-8de9-19359ad18320 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.222070 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f1b98508-5f49-4df8-95ce-8dbb8b1bfcf8 req-5b49d1cd-91e5-477a-8de9-19359ad18320 service nova] Creating event network-vif-deleted:d5af460e-d636-4d2c-b689-5f601e29e409 for instance 311a177a-b334-41c7-bca5-534fabd7aa47 on n-h2-828148-1 Mar 29 02:41:09.226989 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f1b98508-5f49-4df8-95ce-8dbb8b1bfcf8 req-5b49d1cd-91e5-477a-8de9-19359ad18320 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044888 Mar 29 02:41:09.227660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2605/5436] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:09.609196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:09.619497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:09.638099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.642603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.642603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.642603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.790725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.791166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.791617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lazy-loading 'fault' on Instance uuid 311a177a-b334-41c7-bca5-534fabd7aa47 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:41:09.941489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:09.941489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:09.948955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.949390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.950156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:09.950583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:09.967946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:09.982963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:09.987491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ea660a07e13b40f8ae133f954d109917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a977261edd7f406ba26b8f21c81bf451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:09.989924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a090809d-1c72-4ee4-a1d4-83b160b38664 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 200 len: 1370 microversion: 2.20 time: 0.385572 Mar 29 02:41:09.993870 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2832/5437] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:09 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 1370 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 29 02:41:10.068956 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-43b13222-0ab7-4733-a18a-29c517d71468 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea/action" status: 200 len: 24569 microversion: 2.1 time: 0.414900 Mar 29 02:41:10.070292 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2606/5438] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:41:09 2022] POST /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea/action => generated 24569 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 02:41:11.033639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:11.039537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:11.046350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:11.046948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:11.048520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:11.049091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:11.102773 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. Mar 29 02:41:11.103608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:11.104618 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-390a66ae-66ba-4052-b64d-dd9c53104576 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 404 len: 111 microversion: 2.20 time: 0.087914 Mar 29 02:41:11.109615 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2833/5439] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:11 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:41:11.119330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-079937d8-7611-4fdf-a7dc-4c18f3bda512 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '.version_select at 0x7f872436db80>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:11.209714 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-079937d8-7611-4fdf-a7dc-4c18f3bda512 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-464650738" status: 204 len: 0 microversion: 2.20 time: 0.097811 Mar 29 02:41:11.216125 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2607/5440] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Mar 29 02:41:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-464650738 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 29 02:41:15.139937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:15.142258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:15.150538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:15.151144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:15.152145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:15.152791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:15.267275 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea333108-ba1a-4593-a460-da91a3ef723f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action" status: 200 len: 24565 microversion: 2.1 time: 0.131618 Mar 29 02:41:15.286465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2834/5441] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:41:15 2022] POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action => generated 24565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:41:16.611497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:16.613225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:16.623369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:16.623814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:16.624595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:16.625058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:16.854461 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-11435075-b621-4fcc-8296-9338e43b822b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "POST /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea/action" status: 200 len: 32640 microversion: 2.1 time: 0.247336 Mar 29 02:41:16.862434 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2608/5442] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:41:16 2022] POST /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea/action => generated 32640 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:41:16.915409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:16.921738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:16.934371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:16.935101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:16.936124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:16.936763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:16.997152 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. Mar 29 02:41:16.997934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:17.000605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5276b940-364e-45c9-946d-bd06d3a58cb2 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 404 len: 111 microversion: 2.20 time: 0.099743 Mar 29 02:41:17.000605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2835/5443] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:41:16 2022] DELETE /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:41:17.008504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:17.009789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 311a177a-b334-41c7-bca5-534fabd7aa47] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:17.029481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:17.029481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:17.029481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:17.029481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:17.130267 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. Mar 29 02:41:17.130267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 311a177a-b334-41c7-bca5-534fabd7aa47 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:17.130267 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c80eb919-281b-4b93-a10a-9f8b15cc0e49 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47" status: 404 len: 111 microversion: 2.20 time: 0.126012 Mar 29 02:41:17.130850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2609/5444] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:17 2022] GET /compute/v2.1/servers/311a177a-b334-41c7-bca5-534fabd7aa47 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:41:19.886901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:19.887371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:19.892964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-6ea60e90-4421-4eac-bb18-805797547e20 req-fc7842a1-4b32-4f8b-98e0-c8e8e690a411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0afca1d-98ce-48e7-bb7c-135f072174ea", "tag": "0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:19.895302 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:41:19.895302 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:41:19.906752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:19.908488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:19.912064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6ea60e90-4421-4eac-bb18-805797547e20 req-fc7842a1-4b32-4f8b-98e0-c8e8e690a411 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:19.913169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:19.914602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:19.914897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-6ea60e90-4421-4eac-bb18-805797547e20 req-fc7842a1-4b32-4f8b-98e0-c8e8e690a411 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:19.998359 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-6ea60e90-4421-4eac-bb18-805797547e20 req-fc7842a1-4b32-4f8b-98e0-c8e8e690a411 service nova] Creating event network-changed:0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c for instance d0afca1d-98ce-48e7-bb7c-135f072174ea on n-h2-828148-1 Mar 29 02:41:20.006450 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-6ea60e90-4421-4eac-bb18-805797547e20 req-fc7842a1-4b32-4f8b-98e0-c8e8e690a411 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123657 Mar 29 02:41:20.013886 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2610/5445] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:20.068795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:41:20.073452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:20.074046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:20.090022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.090479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:20.091278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.091712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:20.210896 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. Mar 29 02:41:20.212009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:20.213711 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-34cd1053-9144-4698-b5ed-7305e73c38a9 tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 404 len: 111 microversion: 2.20 time: 0.144026 Mar 29 02:41:20.225824 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2611/5446] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Mar 29 02:41:20 2022] DELETE /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:41:20.232482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:20.233357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] [instance: 8ff3d3b6-e435-4b4b-ae28-1b549576c943] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:20.244095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.244775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:20.246160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.246791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:20.366638 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:41:20.367589 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] HTTP exception thrown: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. Mar 29 02:41:20.368350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] Returning 404 to user: Instance 8ff3d3b6-e435-4b4b-ae28-1b549576c943 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:20.369276 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5bcca863-3a99-4134-8217-1f8668a4460d tempest-AttachVolumeShelveTestJSON-700691960 tempest-AttachVolumeShelveTestJSON-700691960-project] 10.222.0.36 "GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943" status: 404 len: 111 microversion: 2.20 time: 0.141452 Mar 29 02:41:20.369924 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2612/5447] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Mar 29 02:41:20 2022] GET /compute/v2.1/servers/8ff3d3b6-e435-4b4b-ae28-1b549576c943 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 29 02:41:20.528625 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1002c4f6-02e1-4e44-8337-ffc7cedd74d1 tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 204 len: 0 microversion: 2.1 time: 0.657501 Mar 29 02:41:20.533203 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2836/5448] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:41:19 2022] DELETE /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:41:20.538679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:20.539751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:20.563198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.565673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:20.574916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:20.576386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:21.375530 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60486. Mar 29 02:41:21.626864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:21.635984 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58b5b463-ac1b-4967-b310-c4906a5ba5ba tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1668 microversion: 2.1 time: 1.101465 Mar 29 02:41:21.640068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2613/5449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:20 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1668 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:22.658822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:22.660331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:22.674676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:22.677501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:22.680020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:22.680687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:23.155252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:23.169557 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f33f74b-54ad-44db-ae77-f72c3a443ada tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1549 microversion: 2.1 time: 0.514290 Mar 29 02:41:23.184694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2837/5450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:22 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1549 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:23.552248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ff784cf6-ecfb-4c5e-aeeb-4e1a6bb7d903 req-199b099d-5b03-4f18-a82e-c5a49efe203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0afca1d-98ce-48e7-bb7c-135f072174ea", "name": "network-vif-deleted", "tag": "0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:23.555316 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:41:23.555316 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:41:23.564049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ff784cf6-ecfb-4c5e-aeeb-4e1a6bb7d903 req-199b099d-5b03-4f18-a82e-c5a49efe203d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:23.564493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ff784cf6-ecfb-4c5e-aeeb-4e1a6bb7d903 req-199b099d-5b03-4f18-a82e-c5a49efe203d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:23.580648 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ff784cf6-ecfb-4c5e-aeeb-4e1a6bb7d903 req-199b099d-5b03-4f18-a82e-c5a49efe203d service nova] Creating event network-vif-deleted:0fdb2d0e-21d5-4683-90b4-2b10d5c7e43c for instance d0afca1d-98ce-48e7-bb7c-135f072174ea on n-h2-828148-1 Mar 29 02:41:23.585417 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ff784cf6-ecfb-4c5e-aeeb-4e1a6bb7d903 req-199b099d-5b03-4f18-a82e-c5a49efe203d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037899 Mar 29 02:41:23.586002 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2614/5451] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:24.190637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:24.191809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:24.200010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:24.200874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:24.201804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:24.202391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:24.310472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:24.310955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:24.311420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lazy-loading 'fault' on Instance uuid d0afca1d-98ce-48e7-bb7c-135f072174ea {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:41:24.565013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27ab6cafcaba40f98aef667e23602ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbd80d7c1654dd0b3bfe22e02d3e571', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:24.575876 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6bf60607-c501-4871-a3d7-b023856a2c2b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 200 len: 1337 microversion: 2.1 time: 0.385735 Mar 29 02:41:24.576694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2838/5452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:24 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 1337 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:25.594211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:25.595511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] [instance: d0afca1d-98ce-48e7-bb7c-135f072174ea] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:25.607868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:25.608619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:25.609507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:25.609999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:25.728454 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] HTTP exception thrown: Instance d0afca1d-98ce-48e7-bb7c-135f072174ea could not be found. Mar 29 02:41:25.729084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Returning 404 to user: Instance d0afca1d-98ce-48e7-bb7c-135f072174ea could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:25.729918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fc0cbd5d-8998-4390-8518-d08d438f1c3b tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea" status: 404 len: 111 microversion: 2.1 time: 0.139824 Mar 29 02:41:25.730781 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2615/5453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:25 2022] GET /compute/v2.1/servers/d0afca1d-98ce-48e7-bb7c-135f072174ea => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:41:26.245640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66ade52d-cc42-4b75-88d1-7a875f2f874d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] Calling method '.version_select at 0x7f8717fc0790>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:26.385205 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66ade52d-cc42-4b75-88d1-7a875f2f874d tempest-TestNetworkBasicOps-676814463 tempest-TestNetworkBasicOps-676814463-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-369388537" status: 202 len: 0 microversion: 2.1 time: 0.136797 Mar 29 02:41:26.387504 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2839/5454] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Mar 29 02:41:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-369388537 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:41:33.660389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-517d17b9-821d-45ef-aec8-011c2a6e1024 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Action: 'create', calling method: .version_select at 0x7f8724d6d9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-616991", "metadata": {"Type": "work"}}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:34.772966 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-517d17b9-821d-45ef-aec8-011c2a6e1024 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 349 microversion: 2.1 time: 1.317551 Mar 29 02:41:34.772966 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2616/5455] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Mar 29 02:41:33 2022] POST /compute/v2.1/os-volumes => generated 349 bytes in 1319 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 29 02:41:34.779234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f706de75-f42b-4b28-a80d-216304f61ffa tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8717e790d0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:34.917376 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f706de75-f42b-4b28-a80d-216304f61ffa tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 349 microversion: 2.1 time: 0.142058 Mar 29 02:41:34.917941 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2840/5456] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:34 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 349 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:35.933926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a31df777-435f-4e4d-95f4-9a49e4ecb6fe tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8717f06c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:36.035453 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a31df777-435f-4e4d-95f4-9a49e4ecb6fe tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 349 microversion: 2.1 time: 0.109067 Mar 29 02:41:36.036023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2617/5457] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:35 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:37.048919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c133cfc-fa6d-4364-a1f5-69b64186838c tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8717ed6ca0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:37.167712 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c133cfc-fa6d-4364-a1f5-69b64186838c tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 350 microversion: 2.1 time: 0.122838 Mar 29 02:41:37.168494 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2841/5458] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:37 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 350 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:37.183227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c32f4cd9-573c-45b5-b810-d83d9d669070 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8717f06d30>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:37.273598 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c32f4cd9-573c-45b5-b810-d83d9d669070 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 350 microversion: 2.1 time: 0.097041 Mar 29 02:41:37.274165 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2618/5459] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:37 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:37.286754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31b8f04f-9722-490d-adf8-7a2719561185 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8724299a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:37.542606 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31b8f04f-9722-490d-adf8-7a2719561185 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 202 len: 0 microversion: 2.1 time: 0.259404 Mar 29 02:41:37.547217 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2842/5460] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Mar 29 02:41:37 2022] DELETE /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:41:37.553206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09dc7377-12fb-4bf5-98c2-6f02c95df1d0 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f872436e3a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:37.644949 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09dc7377-12fb-4bf5-98c2-6f02c95df1d0 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 349 microversion: 2.1 time: 0.093923 Mar 29 02:41:37.644949 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2619/5461] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:37 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:41:38.654008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fbcac59d-7ebf-47e1-905d-1be29e588c98 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8724299160>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:38.822109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fbcac59d-7ebf-47e1-905d-1be29e588c98 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 349 microversion: 2.1 time: 0.171893 Mar 29 02:41:38.822898 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2843/5462] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:38 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 349 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:39.834708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6908c57-c941-4326-8dcd-585ad8f8a474 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f87241dc790>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:39.917767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6908c57-c941-4326-8dcd-585ad8f8a474 tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 200 len: 349 microversion: 2.1 time: 0.086709 Mar 29 02:41:39.918438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2620/5463] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:39 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 349 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:41:40.931841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ab75535-7812-4175-bac2-aa793c987b0d tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Calling method '.version_select at 0x7f8717e794c0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:41.052681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4ab75535-7812-4175-bac2-aa793c987b0d tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] HTTP exception thrown: Volume 2263173a-e181-4cbd-b266-4044ceeb7727 could not be found. Mar 29 02:41:41.053404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ab75535-7812-4175-bac2-aa793c987b0d tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] Returning 404 to user: Volume 2263173a-e181-4cbd-b266-4044ceeb7727 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:41:41.054616 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ab75535-7812-4175-bac2-aa793c987b0d tempest-VolumesGetTestJSON-210165619 tempest-VolumesGetTestJSON-210165619-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727" status: 404 len: 109 microversion: 2.1 time: 0.127245 Mar 29 02:41:41.055237 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2844/5464] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Mar 29 02:41:40 2022] GET /compute/v2.1/os-volumes/2263173a-e181-4cbd-b266-4044ceeb7727 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:41:45.817461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:45.818093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:45.842680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:45.843004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:45.843831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:45.844770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:46.321136 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-70f2cc1a-0517-4e92-b371-f51795cd0ae4 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1832 microversion: 2.1 time: 0.827682 Mar 29 02:41:46.321776 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2621/5465] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:45 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1832 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:46.688772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:46.689615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:46.715096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:46.715096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:46.715096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:46.716394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:47.244604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:47.254280 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f69991c5-8c81-4a35-8371-a7eea48945e9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1681 microversion: 2.1 time: 0.920408 Mar 29 02:41:47.256384 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2845/5466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:46 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1681 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:47.467354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:47.467354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:47.497112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:47.502298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:47.504717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:47.505450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:47.762387 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-489c23d0-b794-4070-96f0-7532adf24ca5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action" status: 200 len: 32642 microversion: 2.1 time: 0.306585 Mar 29 02:41:47.763481 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2622/5467] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:41:47 2022] POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action => generated 32642 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:41:47.939064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:41:47.939064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:47.959059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:47.968346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:47.968346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:47.968346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:48.152509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '390351ec7bf84366970cb7d9cd47a22a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ce70c945994035942ff3ffd69cb99a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:48.157931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] flavor_id is None. Assuming migration. {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4011}} Mar 29 02:41:48.158543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 02:41:48.588067 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de84a917-70bb-4612-806a-f031b75d966b tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action" status: 202 len: 0 microversion: 2.1 time: 0.661858 Mar 29 02:41:48.588897 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2846/5468] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:41:47 2022] POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:41:48.598667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:48.599749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:48.616606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:48.616606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:48.616606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:48.616606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:50.011613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:50.025701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38b02578-0d5b-49bc-a213-dd645f2cbdf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1690 microversion: 2.1 time: 1.423204 Mar 29 02:41:50.026353 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2623/5469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:48 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1690 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:51.050060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:51.051015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:51.071782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:51.071782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:51.077219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:51.077894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:51.878757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:51.888118 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd290271-0876-4c2d-9c0f-3185b18df79e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1690 microversion: 2.1 time: 0.842695 Mar 29 02:41:51.890172 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2847/5470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:51 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1690 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:52.908052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:52.909383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:52.923804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:52.926636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:52.928983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:52.931836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:54.283544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:54.302922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-17969ace-af22-445d-9857-2dd657083dbe tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1690 microversion: 2.1 time: 1.399133 Mar 29 02:41:54.304629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2624/5471] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:52 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1690 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:55.321723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:55.322549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:55.334656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:55.335104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:55.341357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:55.342026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:56.513015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:56.524001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-666ec26c-d778-4a25-a0b2-b6688890efbb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1690 microversion: 2.1 time: 1.206194 Mar 29 02:41:56.524729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2848/5472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:55 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1690 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:57.541290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:57.541909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:57.552936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:57.553380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:57.554159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:57.554587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:58.352919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:58.361973 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f1d5dd6b-91e6-431f-93b6-97bbb56558d0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.825248 Mar 29 02:41:58.362540 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2625/5473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:57 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:41:59.379392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:41:59.380277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:41:59.388136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:59.388587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:59.389410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:41:59.390000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:41:59.827117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:41:59.835574 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-96f42b79-fb4e-45f3-b86b-80921bda239e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.459856 Mar 29 02:41:59.836158 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2849/5474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:41:59 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:00.852192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:00.856361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:00.869054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:00.869760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:00.871032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:00.871690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:01.787484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:01.793699 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e848ecb-5c63-4837-a164-90ab5ca62a2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.945164 Mar 29 02:42:01.794807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2626/5475] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:00 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:02.811090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:02.812504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:02.836522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:02.838474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:02.842278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:02.845372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:03.551769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:03.560965 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bd172fb5-cd85-4c4f-bfec-a859f6963dde tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.753636 Mar 29 02:42:03.568417 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2850/5476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:02 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:04.577440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:04.586561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:04.591954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:04.593112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:04.598016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:04.598763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:05.621391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:05.634101 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-42f87089-6ae8-4751-a936-2d23041fd651 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 1.060360 Mar 29 02:42:05.635180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2627/5477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:04 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:06.651764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:06.654516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:06.662985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:06.663788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:06.665120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:06.665712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:07.537537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:07.547850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6783fd4-167a-48aa-9da2-81d1979bdb23 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.898864 Mar 29 02:42:07.548917 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2851/5478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:06 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:08.565983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:08.567214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:08.581500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:08.584025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:08.586611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:08.589479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:08.932380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:08.954448 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d4653d74-6bc1-48e0-959d-1c0db240d54f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.392825 Mar 29 02:42:08.955104 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2628/5479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:08 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:09.972570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:09.973402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:09.987659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:09.990030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:09.992222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:09.993871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:11.029720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:11.040461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-339574e3-4048-44f8-8a72-ed98b073e43b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 1.072640 Mar 29 02:42:11.041367 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2852/5480] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:09 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:12.068698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:12.072051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:12.086522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:12.087398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:12.088415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:12.088890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:12.482771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:12.495893 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6999a61f-a15f-4a91-b97a-5c8010460d5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.441200 Mar 29 02:42:12.497301 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2629/5481] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:12 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:13.514273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:13.514897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:13.536674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:13.537176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:13.539912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:13.539912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:13.904001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:13.914179 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-def36299-4abe-4e36-875f-40cc96cb66f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.403438 Mar 29 02:42:13.915114 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2853/5482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:13 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:14.932015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:14.932714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:14.941964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:14.943282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:14.945001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:14.945617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:15.680648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:15.697115 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d90ccd2-9f93-42ef-bc44-934d4b69d62c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.769334 Mar 29 02:42:15.697700 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2630/5483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:14 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:16.724804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:16.728017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:16.753533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:16.754608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:16.755501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:16.761248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:17.326223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:17.338726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b893eb44-3001-4b43-afe8-78d9c6cc29c8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.626820 Mar 29 02:42:17.341356 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2854/5484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:16 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:18.357640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:18.358254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:18.366791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:18.367243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:18.368018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:18.368449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:18.900438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:18.911174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9f04d9b-8893-4e19-ad03-ffa70d17797e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1695 microversion: 2.1 time: 0.557185 Mar 29 02:42:18.912533 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2631/5485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:18 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1695 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:19.942110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:19.942110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:19.951931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:19.952385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:19.953232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:19.953680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:20.699951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:20.710271 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3a0439e-46a5-4580-bd94-27d3e2c4b19a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1694 microversion: 2.1 time: 0.783890 Mar 29 02:42:20.720553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2855/5486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:19 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1694 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:20.816539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-unplugged", "status": "completed", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:20.825033 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:20.825033 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:42:20.837295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:20.840337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:20.898667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] Creating event network-vif-unplugged:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h2-828148-1 Mar 29 02:42:20.911929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] Instance b24aef54-4f40-4548-8381-b73fa6f3553c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:42:20.928665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-277bfaa7-c7df-4310-b22f-dd3bd401cd24 req-6b051517-dc0d-4520-9d4a-133e07fea9a8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116226 Mar 29 02:42:20.932132 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2632/5487] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:42:21.729397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:21.730797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:21.741444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:21.742026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:21.743360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:21.744224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:22.428118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:22.442739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c431f85-05e2-4aee-b880-5b712e743081 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1694 microversion: 2.1 time: 0.716899 Mar 29 02:42:22.443959 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2856/5488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:21 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1694 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:23.016556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:23.027258 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:23.027258 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:42:23.065734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:23.069220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:23.101822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] Creating event network-changed:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h2-828148-1 Mar 29 02:42:23.120660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] Instance b24aef54-4f40-4548-8381-b73fa6f3553c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:42:23.153086 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-60c1a087-32f9-412d-b231-e9a9b341b159 req-5be13b21-4b0e-45e2-8a73-bed4580f21bd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145177 Mar 29 02:42:23.154198 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2633/5489] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:23.568965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:24.114006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:24.128151 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-331d0e18-9bf9-4914-8f86-62036e4b7499 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1694 microversion: 2.1 time: 0.664114 Mar 29 02:42:24.129154 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2857/5490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:23 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1694 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:25.162930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:25.162930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:25.220489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:25.220489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:25.229473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:25.229473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:26.155613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:26.167158 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7604c08e-18a2-40fd-a250-fecdc45dfd4d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1692 microversion: 2.1 time: 1.020545 Mar 29 02:42:26.168340 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2634/5491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:25 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1692 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:27.209702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:27.209702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:27.231045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:27.231045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:27.231045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:27.231045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:27.877349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:27.892998 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dd64e0a4-6006-4a82-a069-c811c8b81df4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1689 microversion: 2.1 time: 0.684398 Mar 29 02:42:27.903304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2858/5492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:27 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1689 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:27.908147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:27.908147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:27.927089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:27.927089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:27.927089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:27.927089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:28.519106 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-805dd7b8-9175-41ba-92f5-8ea095c7e528 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action" status: 202 len: 0 microversion: 2.1 time: 0.616948 Mar 29 02:42:28.520198 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2635/5493] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:42:27 2022] POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:42:28.536250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:28.537802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:28.565138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:28.567082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:28.567082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:28.568566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:29.440466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:29.440466 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-00c073d4-271b-470b-8f7c-499b73008ced tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.896560 Mar 29 02:42:29.440466 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2859/5494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:28 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:30.448142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:30.448142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:30.458430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-plugged", "status": "completed", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:30.458430 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:30.458430 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:42:30.460470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:30.460470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:30.468519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:30.470564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:30.472061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:30.478518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:30.506934 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] Creating event network-vif-plugged:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h2-828148-1 Mar 29 02:42:30.548726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] Instance b24aef54-4f40-4548-8381-b73fa6f3553c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:42:30.564138 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3d41d972-b3ef-428d-ba48-345624d51922 req-89288614-a5df-4695-9347-53c3b09dbdc4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114281 Mar 29 02:42:30.564138 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2860/5495] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:42:30.875540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:30.929495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6fa3694a-8e66-4a2f-9c26-562888cf442e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.494196 Mar 29 02:42:30.930646 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2636/5496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:30 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:31.948202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:31.948941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:31.966102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:31.966102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:31.966102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:31.966102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:32.416106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:32.425516 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-746fa991-dc7e-4ea7-af23-b5abaf57bad7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.481362 Mar 29 02:42:32.426251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2861/5497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:31 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:42:33.443573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:33.444196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:33.457041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:33.457509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:33.458323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:33.458761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:34.335369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:34.343701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-61dd5b63-2dbd-4cc1-bc0d-795c5de2e8fc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.904037 Mar 29 02:42:34.345141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2637/5498] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:33 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:34.789446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-unplugged", "status": "completed", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:34.789446 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:34.789446 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:42:34.803310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:34.803310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:34.831333 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] Creating event network-vif-unplugged:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:42:34.831333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] Instance b24aef54-4f40-4548-8381-b73fa6f3553c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:42:34.844471 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b6344610-861e-4b26-9f13-e4d0516f7c2c req-a69cf9cf-79d6-4910-b5af-be1c4dd8aa40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072485 Mar 29 02:42:34.844471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2862/5499] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:42:35.368603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:35.368603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:35.389959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:35.389959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:35.389959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:35.405388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:36.143872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:36.167404 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-15312622-8807-4902-a1e5-6a5763ebe802 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.795937 Mar 29 02:42:36.167404 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2638/5500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:35 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:36.865301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:36.865301 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:36.865301 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:42:36.886383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:36.886383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:36.909886 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] Creating event network-changed:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:42:36.927851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] Instance b24aef54-4f40-4548-8381-b73fa6f3553c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 02:42:36.927851 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a1da59a6-df8f-4a5a-a1e3-d97e246ef7f5 req-8a901036-7490-4b3a-870a-228fb9149418 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069621 Mar 29 02:42:36.927851 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2863/5501] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:42:37.184437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:37.194791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:37.215581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:37.215581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:37.215581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:37.215581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:37.836700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:37.846188 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e64b8767-3bf3-4139-9134-581abd394f6f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.678843 Mar 29 02:42:37.846722 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2639/5502] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:37 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:38.878962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:38.878962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:38.904107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:38.904107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:38.904107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:38.904107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:39.495883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:39.513650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7fec7678-22ba-4fd5-b0e0-0757f84e9bf0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.648814 Mar 29 02:42:39.513650 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2864/5503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:38 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:40.540909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:40.540909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:40.576279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:40.576279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:40.576279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:40.576279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:41.088182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:41.088182 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-460d05d5-b4f1-46e2-b5da-39f1a8cb6285 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1688 microversion: 2.1 time: 0.561548 Mar 29 02:42:41.106226 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2640/5504] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:40 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1688 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:42.105351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:42:42.106198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:42:42.113540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:42.114064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:42.114900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:42.115360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:42.314361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:42:42.322626 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-714f8719-c2a8-46bc-8bd3-3fc58badf6c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1681 microversion: 2.1 time: 0.220922 Mar 29 02:42:42.323186 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2865/5505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:42:42 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:42:42.932001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-edca5a8d-b1b8-41dd-b629-3eadbabd88e4 req-32e5af84-e3e8-4f9c-afd7-56c1bc0de93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-plugged", "status": "completed", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:42:42.932001 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:42:42.932001 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:42:42.943015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-edca5a8d-b1b8-41dd-b629-3eadbabd88e4 req-32e5af84-e3e8-4f9c-afd7-56c1bc0de93d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:42:42.943015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-edca5a8d-b1b8-41dd-b629-3eadbabd88e4 req-32e5af84-e3e8-4f9c-afd7-56c1bc0de93d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:42:42.980422 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-edca5a8d-b1b8-41dd-b629-3eadbabd88e4 req-32e5af84-e3e8-4f9c-afd7-56c1bc0de93d service nova] Creating event network-vif-plugged:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:42:42.987779 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-edca5a8d-b1b8-41dd-b629-3eadbabd88e4 req-32e5af84-e3e8-4f9c-afd7-56c1bc0de93d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066017 Mar 29 02:42:42.987779 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2641/5506] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:43:11.990964 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:43:11.991683 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:43:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:43:12.613989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:43:12.615039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:12.629623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:12.631345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:12.641079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:12.641678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:12.753745 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6637ba7e-07ca-4b46-a397-d57eb228c3f1 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action" status: 200 len: 63141 microversion: 2.1 time: 0.143132 Mar 29 02:43:12.759157 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2866/5507] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:43:12 2022] POST /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c/action => generated 63141 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:43:28.960879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:28.962550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:28.973696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:28.974368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:28.975697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:28.976325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:30.074435 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5cab016-261e-42eb-a181-1dfcc0f14479 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1832 microversion: 2.1 time: 1.117878 Mar 29 02:43:30.075022 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2642/5508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:43:28 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1832 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:43:33.697937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-dc513103-e1b1-40e2-b9d2-2efa3684d0ec req-32ce021a-39e3-4193-9432-0fe07b12012f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:43:33.699904 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:43:33.699904 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:43:33.700358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:33.701385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:33.719505 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:43:33.722203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dc513103-e1b1-40e2-b9d2-2efa3684d0ec req-32ce021a-39e3-4193-9432-0fe07b12012f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:33.722670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dc513103-e1b1-40e2-b9d2-2efa3684d0ec req-32ce021a-39e3-4193-9432-0fe07b12012f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:33.729950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:33.730395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:33.731383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:33.734360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:33.774828 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-dc513103-e1b1-40e2-b9d2-2efa3684d0ec req-32ce021a-39e3-4193-9432-0fe07b12012f service nova] Creating event network-changed:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:43:33.785031 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-dc513103-e1b1-40e2-b9d2-2efa3684d0ec req-32ce021a-39e3-4193-9432-0fe07b12012f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090841 Mar 29 02:43:33.789155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2643/5509] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:43:33.856197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:43:34.306897 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1a1808ab-2ae7-4f2b-b1ad-8cbab6473697 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 204 len: 0 microversion: 2.1 time: 0.617289 Mar 29 02:43:34.307506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2867/5510] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:43:33 2022] DELETE /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:43:34.316575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:34.317596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:34.335729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:34.336432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:34.337424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:34.339867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:35.000584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:43:35.011487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9311e37b-af49-4daf-a6b2-a38800e76438 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1687 microversion: 2.1 time: 0.699050 Mar 29 02:43:35.013426 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2644/5511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:43:34 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1687 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:43:36.031258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:36.031956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:36.064085 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 36490. Mar 29 02:43:36.069865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:36.070992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:36.072086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:36.072740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:37.570376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7df66eac-ca25-402d-9c12-522847811ac4 req-8c496ec7-33bf-4481-bc08-32b001741dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b24aef54-4f40-4548-8381-b73fa6f3553c", "name": "network-vif-deleted", "tag": "b5855f6f-3585-4807-b649-520d44a9b6e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:43:37.571794 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:43:37.571794 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:43:37.595973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7df66eac-ca25-402d-9c12-522847811ac4 req-8c496ec7-33bf-4481-bc08-32b001741dd7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:37.596410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7df66eac-ca25-402d-9c12-522847811ac4 req-8c496ec7-33bf-4481-bc08-32b001741dd7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:37.612913 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7df66eac-ca25-402d-9c12-522847811ac4 req-8c496ec7-33bf-4481-bc08-32b001741dd7 service nova] Creating event network-vif-deleted:b5855f6f-3585-4807-b649-520d44a9b6e5 for instance b24aef54-4f40-4548-8381-b73fa6f3553c on n-h1-828148-1 Mar 29 02:43:37.619906 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7df66eac-ca25-402d-9c12-522847811ac4 req-8c496ec7-33bf-4481-bc08-32b001741dd7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053120 Mar 29 02:43:37.622863 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2645/5512] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:43:37.689308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:43:37.704211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-39ba0efb-2538-4dd2-8e3d-f9ea8fac708e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1568 microversion: 2.1 time: 1.677401 Mar 29 02:43:37.705472 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2868/5513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:43:36 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1568 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:43:38.722208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:38.723082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:38.744434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:38.744901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:38.745689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:38.746116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:38.951248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:38.951773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:38.952233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lazy-loading 'fault' on Instance uuid b24aef54-4f40-4548-8381-b73fa6f3553c {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:43:39.229925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:43:39.239921 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4970be2-58e3-4561-913c-5781a069408d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 200 len: 1355 microversion: 2.1 time: 0.521712 Mar 29 02:43:39.243496 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2646/5514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:43:38 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 1355 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:43:40.270423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:40.271258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: b24aef54-4f40-4548-8381-b73fa6f3553c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:43:40.289419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:40.291136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:40.292302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:43:40.296296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:43:40.422554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] HTTP exception thrown: Instance b24aef54-4f40-4548-8381-b73fa6f3553c could not be found. Mar 29 02:43:40.423348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Returning 404 to user: Instance b24aef54-4f40-4548-8381-b73fa6f3553c could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:43:40.426370 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-71c5f2bb-2ad6-47a7-945e-47be4f8095a7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c" status: 404 len: 111 microversion: 2.1 time: 0.169422 Mar 29 02:43:40.428112 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2869/5515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:43:40 2022] GET /compute/v2.1/servers/b24aef54-4f40-4548-8381-b73fa6f3553c => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:43:52.717060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3627c2a4-17b1-4cb1-b999-8013a1f085d5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '.version_select at 0x7f87241dc3a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:43:52.836190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3627c2a4-17b1-4cb1-b999-8013a1f085d5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-122193079" status: 202 len: 0 microversion: 2.1 time: 0.123222 Mar 29 02:43:52.840581 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2647/5516] 10.222.0.36 () {58 vars in 1280 bytes} [Tue Mar 29 02:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-122193079 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:43:52.895253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: .version_select at 0x7f8725ec6ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1092991445"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:43:52.960232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:43:52.970297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:43:53.294776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:43:53.330000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:43:53.369316 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e550c82a-790e-43a6-9eb0-51864aaf8d5e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.480797 Mar 29 02:43:53.374619 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2870/5517] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:43:52 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:19.048223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1047304100", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "fe917043-23b1-4e5f-b5fd-eeaa935840b9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1092991445", "security_groups": [{"name": "tempest-secgroup-smoke-1614118241"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:44:19.754194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] validate_networks() for [('fe917043-23b1-4e5f-b5fd-eeaa935840b9', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:44:21.377191 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:44:21.712512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:44:21.713676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:44:21.713676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:44:21.713956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:44:21.714448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:44:21.743756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:21.745179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:21.746265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:21.749786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:21.790651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:44:21.812518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:44:21.841365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:44:21.844519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:44:21.996402 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05670b51-14c8-4bf6-ad85-b174f0e061f8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.951153 Mar 29 02:44:21.997295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2648/5518] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:44:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:44:22.008612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9c908301-f279-430a-bce9-7930b80a7f92 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:22.010519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9c908301-f279-430a-bce9-7930b80a7f92 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:22.148414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9c908301-f279-430a-bce9-7930b80a7f92 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:22.159021 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9c908301-f279-430a-bce9-7930b80a7f92 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1267 microversion: 2.1 time: 0.154938 Mar 29 02:44:22.160171 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2871/5519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:22 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:23.185944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a446f0a-b80f-4de2-a478-ff688cfc7af2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:23.185944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a446f0a-b80f-4de2-a478-ff688cfc7af2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:23.270942 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 38026. Mar 29 02:44:23.460918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2a446f0a-b80f-4de2-a478-ff688cfc7af2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:23.483370 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a446f0a-b80f-4de2-a478-ff688cfc7af2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1267 microversion: 2.1 time: 0.311489 Mar 29 02:44:23.485412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2649/5520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:23 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1267 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:24.503567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9249375-7263-4cce-b43b-0c80840269c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:24.504265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b9249375-7263-4cce-b43b-0c80840269c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:24.703635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9249375-7263-4cce-b43b-0c80840269c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:24.719179 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9249375-7263-4cce-b43b-0c80840269c9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1267 microversion: 2.1 time: 0.221138 Mar 29 02:44:24.724732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2872/5521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:24 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:25.742130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:25.742906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:25.758082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:25.761146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:25.761991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:25.765541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:26.162941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:26.175821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1ed7a6fc-6bcf-4902-b9ee-00c16dc87971 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1263 microversion: 2.1 time: 0.437896 Mar 29 02:44:26.177459 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2650/5522] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:25 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1263 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:27.194163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:27.195347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:27.213342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:27.215454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:27.216325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:27.219384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:27.901060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:27.914753 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-362f3f4f-3f83-43e0-b8b8-792622957bd7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1337 microversion: 2.1 time: 0.724597 Mar 29 02:44:27.915658 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2873/5523] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:27 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1337 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:28.933306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:28.934119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:28.953286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:28.957003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:28.959485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:28.960768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:29.455450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:29.473298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72bb5348-24cc-4ff7-b975-77751dfccc3c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1325 microversion: 2.1 time: 0.543610 Mar 29 02:44:29.488922 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2651/5524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:28 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:30.494315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:30.495775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:30.507771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:30.511064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:30.512140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:30.514927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:31.236049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:31.249467 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e62089e-901c-44b1-a523-c3c002c3f5a2 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.759325 Mar 29 02:44:31.261369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2874/5525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:30 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:32.269145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:32.270536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:32.282701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:32.283468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:32.284563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:32.285227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:33.032563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:33.044900 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b067d23e-fb12-42ae-9520-55e7dad5e7c3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.779874 Mar 29 02:44:33.045496 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2652/5526] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:32 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:33.368408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-49a83ff0-1b16-4f21-855c-7efb266c7697 req-018fedca-3648-4305-8e83-68df1c28ae07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:44:33.369998 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:44:33.369998 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:44:33.392395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-49a83ff0-1b16-4f21-855c-7efb266c7697 req-018fedca-3648-4305-8e83-68df1c28ae07 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:33.392751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-49a83ff0-1b16-4f21-855c-7efb266c7697 req-018fedca-3648-4305-8e83-68df1c28ae07 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:33.445392 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-49a83ff0-1b16-4f21-855c-7efb266c7697 req-018fedca-3648-4305-8e83-68df1c28ae07 service nova] Creating event network-changed:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:44:33.459743 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-49a83ff0-1b16-4f21-855c-7efb266c7697 req-018fedca-3648-4305-8e83-68df1c28ae07 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407682 Mar 29 02:44:33.461192 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2875/5527] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:44:34.062664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:34.063871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:34.078498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:34.092545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:34.092545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:34.092545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:34.778089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:34.797874 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff491289-afad-4a6d-abaf-8ad9a1146ecc tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.739448 Mar 29 02:44:34.798484 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2653/5528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:34 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:35.815126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:35.815814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:35.834830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:35.836998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:35.848488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:35.848488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:37.095776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:37.119893 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-475f0a96-b4f4-4caf-b7c3-054095ef0553 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 1.307873 Mar 29 02:44:37.129767 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2876/5529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:35 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:38.143335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:38.144664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:38.169937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:38.171116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:38.172012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:38.172481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:38.847635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:38.859168 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efd915f7-702c-4045-953f-bedfb0ad129b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.723405 Mar 29 02:44:38.869950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2654/5530] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:38 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:39.884053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:39.884780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:39.901152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:39.903077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:39.907408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:39.909531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:40.461671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:40.471258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6abd9354-e6ef-49ce-95af-c3179adf267c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.591562 Mar 29 02:44:40.472346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2877/5531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:39 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:41.488560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:41.489732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:41.507427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:41.509729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:41.511352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:41.518919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:43.108092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:43.112413 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03fef30d-4967-4b83-9144-e0e0013687c6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 1.627976 Mar 29 02:44:43.115925 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2655/5532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:41 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:44.132085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:44.133302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:44.147451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:44.149378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:44.151494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:44.156282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:44.745813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:44.763996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-20a016f0-1b23-4321-9570-8fa8aa62f906 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.633118 Mar 29 02:44:44.764130 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2878/5533] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:44 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:45.780256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:45.780720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:45.796313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:45.796732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:45.797541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:45.801544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:46.257127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:46.283290 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-702daa98-b6cc-4356-8b99-4f249fd17d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 0.507277 Mar 29 02:44:46.284185 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2656/5534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:45 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:46.603087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b724927d-753b-48bb-9ad0-87d8fe5fd1de req-3c5d2cb1-ebed-436a-9252-65f04e020fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "name": "network-vif-plugged", "status": "completed", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:44:46.604523 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:44:46.604523 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:44:46.613378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b724927d-753b-48bb-9ad0-87d8fe5fd1de req-3c5d2cb1-ebed-436a-9252-65f04e020fb8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:46.614001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b724927d-753b-48bb-9ad0-87d8fe5fd1de req-3c5d2cb1-ebed-436a-9252-65f04e020fb8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:46.642882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b724927d-753b-48bb-9ad0-87d8fe5fd1de req-3c5d2cb1-ebed-436a-9252-65f04e020fb8 service nova] Creating event network-vif-plugged:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:44:46.647867 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b724927d-753b-48bb-9ad0-87d8fe5fd1de req-3c5d2cb1-ebed-436a-9252-65f04e020fb8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193574 Mar 29 02:44:46.649757 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2879/5535] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:44:47.303029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:47.303639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:47.311315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:47.312012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:47.313101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:47.313767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:48.766095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:48.779320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ef2c72b-e1de-4426-a680-b290ba68799a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1393 microversion: 2.1 time: 1.479729 Mar 29 02:44:48.779890 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2657/5536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:47 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1393 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:49.667417 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:44:49.667904 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:44:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:44:49.796222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:49.797124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:49.810766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:49.812496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:49.814344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:49.814848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:51.111647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:51.130243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23b892f7-f218-4ec1-a69d-b143a316eb2a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1566 microversion: 2.1 time: 1.331560 Mar 29 02:44:51.130243 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2880/5537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:49 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1566 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:44:51.140236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:51.140865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:51.152518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:51.152518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:51.152925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:51.153803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:51.676607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:51.690844 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23e2f151-fd3e-49f5-8975-1027af4f182e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1566 microversion: 2.1 time: 0.554125 Mar 29 02:44:51.693583 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2658/5538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:51 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1566 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:44:57.829857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:44:57.831071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:44:57.838438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4b9a75c6-f6d1-4b47-b869-085020e1063e req-64852c98-5490-48da-b8db-32fc5ace449f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:44:57.841987 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:44:57.841987 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:44:57.845177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:57.845628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:57.846413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:57.854197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4b9a75c6-f6d1-4b47-b869-085020e1063e req-64852c98-5490-48da-b8db-32fc5ace449f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:44:57.854459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:57.855532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4b9a75c6-f6d1-4b47-b869-085020e1063e req-64852c98-5490-48da-b8db-32fc5ace449f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:44:57.889887 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4b9a75c6-f6d1-4b47-b869-085020e1063e req-64852c98-5490-48da-b8db-32fc5ace449f service nova] Creating event network-changed:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:44:57.901704 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4b9a75c6-f6d1-4b47-b869-085020e1063e req-64852c98-5490-48da-b8db-32fc5ace449f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067159 Mar 29 02:44:57.906284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2659/5539] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:44:59.761014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:44:59.774245 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a475dc36-1c8c-449c-8028-71c040731b91 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1566 microversion: 2.1 time: 1.948406 Mar 29 02:44:59.781744 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2881/5540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:44:57 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1566 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:00.969129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1912460361", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:01.045621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:45:01.461551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:45:01.462486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:45:01.463190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:45:01.463834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:45:01.464476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:45:01.483548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:01.484370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:01.485435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:01.486303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:01.534181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Getting quotas for project 3228cb76f273418ea96b93693aa3f4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:45:01.550295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Getting quotas for user b2b731e780ae4f0b87c198469e9e49b0 and project 3228cb76f273418ea96b93693aa3f4c0. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:45:01.577197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:45:01.586360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:45:01.974424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37d5c72b-7b44-4a22-a376-50883fa7f0df tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009332 Mar 29 02:45:01.982060 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2660/5541] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:45:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:45:01.987084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7bc8f6b9-dc29-4aa2-ae7d-f313a67df06a tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:01.989046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7bc8f6b9-dc29-4aa2-ae7d-f313a67df06a tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:02.153810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7bc8f6b9-dc29-4aa2-ae7d-f313a67df06a tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:02.166919 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7bc8f6b9-dc29-4aa2-ae7d-f313a67df06a tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1214 microversion: 2.1 time: 0.184254 Mar 29 02:45:02.167465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2882/5542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:01 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:45:03.196805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5819c62f-0430-4b8b-99f2-6002279780ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:03.196805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5819c62f-0430-4b8b-99f2-6002279780ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:03.371219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5819c62f-0430-4b8b-99f2-6002279780ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:03.378687 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5819c62f-0430-4b8b-99f2-6002279780ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1214 microversion: 2.1 time: 0.196281 Mar 29 02:45:03.393802 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2661/5543] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:03 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:04.408199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:04.408199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:04.415921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:04.415921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:04.415921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:04.415921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:04.575268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:04.591777 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa78a16b-a5ba-4329-b319-c40bf94f671d tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1210 microversion: 2.1 time: 0.191937 Mar 29 02:45:04.606139 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2883/5544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:04 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1210 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:05.620266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:05.620266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:05.648740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:05.659672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:05.659672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:05.659672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:05.995259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:06.002259 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2160f688-621a-40fc-804e-9686ecdb27b8 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1284 microversion: 2.1 time: 0.387614 Mar 29 02:45:06.009660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2662/5545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:05 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:07.021929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:07.021929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:07.028983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:07.028983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:07.028983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:07.028983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:07.289882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:07.314491 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3183987-9a7c-4b12-a5eb-d1d8b345a9c0 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1272 microversion: 2.1 time: 0.288104 Mar 29 02:45:07.314491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2884/5546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:07 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:08.334537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:08.629176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:08.636511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7fe01c07-0063-4eaf-a1bb-22c8c778c600 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.316647 Mar 29 02:45:08.636511 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2663/5547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:08 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:09.657648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:09.657648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:09.706879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:09.706879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:09.706879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:09.706879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:10.898755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:10.909452 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-feab7f68-6f1c-4961-bdac-e889f3f95049 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 1.262239 Mar 29 02:45:10.924294 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2885/5548] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:09 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:11.224147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2422bfdd-48ff-4650-8c9a-04df6ca6f7e9 req-8639ecad-6b83-4d39-affc-95896bb116e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281f005-a176-4cfd-91a8-4292815dff29", "tag": "e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:11.224147 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:45:11.224147 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:45:11.244085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2422bfdd-48ff-4650-8c9a-04df6ca6f7e9 req-8639ecad-6b83-4d39-affc-95896bb116e3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:11.244085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2422bfdd-48ff-4650-8c9a-04df6ca6f7e9 req-8639ecad-6b83-4d39-affc-95896bb116e3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:11.298426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2422bfdd-48ff-4650-8c9a-04df6ca6f7e9 req-8639ecad-6b83-4d39-affc-95896bb116e3 service nova] Creating event network-changed:e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5 for instance 2281f005-a176-4cfd-91a8-4292815dff29 on n-h2-828148-1 Mar 29 02:45:11.325950 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2422bfdd-48ff-4650-8c9a-04df6ca6f7e9 req-8639ecad-6b83-4d39-affc-95896bb116e3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.495126 Mar 29 02:45:11.325950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2664/5549] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:45:11.931220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:11.933284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:11.946486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:11.947995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:11.950646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:11.955080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:12.620523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:12.642610 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4db42fa3-7b8e-42d1-88e0-18e2855bef02 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.714996 Mar 29 02:45:12.649807 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2886/5550] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:11 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:13.667504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:13.672591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:13.695271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:13.698217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:13.709712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:13.710287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:14.486454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:14.497908 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-daab8aec-b635-4b81-b1a1-4b3169b422c2 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.835578 Mar 29 02:45:14.498507 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2665/5551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:13 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:15.549121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:15.549121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:15.578922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:15.578922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:15.578922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:15.578922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:15.885073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:15.902646 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03f58a03-fdf8-4ed7-9173-85f4bf787a17 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.379534 Mar 29 02:45:15.912461 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2887/5552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:15 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:16.920949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:16.921568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:16.931726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:16.932201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:16.933052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:16.934459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:17.271005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:17.283641 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-68519945-5981-4f01-ad83-b9b4570eeeb4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.362564 Mar 29 02:45:17.283641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2666/5553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:16 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:18.302451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:18.303526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:18.317798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:18.318456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:18.322028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:18.322603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:18.955397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:18.959260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0f962b53-c0c0-4770-8196-b0042cc55ec4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.657885 Mar 29 02:45:18.959260 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2888/5554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:18 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:19.119817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8ae2cc7f-a1c6-4108-b92c-95fa97fed5fb req-eb30387e-6158-4a25-b4a1-ed03b604790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281f005-a176-4cfd-91a8-4292815dff29", "name": "network-vif-plugged", "status": "completed", "tag": "e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:19.119817 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:45:19.119817 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:45:19.165677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8ae2cc7f-a1c6-4108-b92c-95fa97fed5fb req-eb30387e-6158-4a25-b4a1-ed03b604790b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:19.165677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8ae2cc7f-a1c6-4108-b92c-95fa97fed5fb req-eb30387e-6158-4a25-b4a1-ed03b604790b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:19.192165 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8ae2cc7f-a1c6-4108-b92c-95fa97fed5fb req-eb30387e-6158-4a25-b4a1-ed03b604790b service nova] Creating event network-vif-plugged:e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5 for instance 2281f005-a176-4cfd-91a8-4292815dff29 on n-h2-828148-1 Mar 29 02:45:19.194089 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8ae2cc7f-a1c6-4108-b92c-95fa97fed5fb req-eb30387e-6158-4a25-b4a1-ed03b604790b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093206 Mar 29 02:45:19.197951 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2667/5555] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:45:19.984633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:19.984633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:20.001084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:20.001084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:20.001084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:20.001084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:20.390689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:20.402777 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f0e4041e-4899-4097-8b01-389962fb3ed4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1314 microversion: 2.1 time: 0.433285 Mar 29 02:45:20.403771 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2889/5556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:19 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:21.426327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:21.426327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:21.436943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:21.436943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:21.436943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:21.439800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:21.726039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:21.737206 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-81c83986-95c0-4ae5-a725-d0b0932051fc tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1463 microversion: 2.1 time: 0.320736 Mar 29 02:45:21.749887 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2668/5557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:21 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:21.757134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8f40d4-55d9-4363-b775-215993b3a285", "device": "/dev/sdb"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:21.759075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:21.769515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:21.770611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:21.771769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:21.772604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:22.907690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f2b7ec8-d644-4cd5-b929-b12b4c691d99 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "POST /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.155217 Mar 29 02:45:22.909944 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2890/5558] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:45:21 2022] POST /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29/os-volume_attachments => generated 194 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:45:23.692694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:23.721317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:23.754574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:23.754574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:23.754574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:23.754574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:23.896031 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7095d04b-5d84-45f2-b691-9b0bcb0d665b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action" status: 200 len: 24564 microversion: 2.1 time: 0.229934 Mar 29 02:45:23.898347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2669/5559] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:45:23 2022] POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action => generated 24564 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:45:38.075164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1666892279", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:38.209733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] validate_networks() for None {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:45:39.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:45:39.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:45:39.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:45:39.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:45:39.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:45:39.115597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:39.115597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:39.115597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:39.115597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:39.162353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Getting quotas for project 354982f2d803470f9ab59001dcf5776f. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:45:39.183490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Getting quotas for user 7c9749d5711e486f92a97d1818a20cb8 and project 354982f2d803470f9ab59001dcf5776f. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:45:39.208865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:45:39.211283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:45:39.392512 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d2373af-2d89-4b8f-9b08-df76264c2848 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315488 Mar 29 02:45:39.402930 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2891/5560] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:45:39.406752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7641c9d6-ef3c-4767-91cf-226b4ce5e5dc tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:39.406752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7641c9d6-ef3c-4767-91cf-226b4ce5e5dc tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:39.541949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7641c9d6-ef3c-4767-91cf-226b4ce5e5dc tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:39.562737 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7641c9d6-ef3c-4767-91cf-226b4ce5e5dc tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1215 microversion: 2.1 time: 0.155464 Mar 29 02:45:39.562737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2670/5561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:39 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:40.570858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d1571ee-ca7c-4181-9391-db1b1df57504 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:40.570858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d1571ee-ca7c-4181-9391-db1b1df57504 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:40.809274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d1571ee-ca7c-4181-9391-db1b1df57504 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:40.817132 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d1571ee-ca7c-4181-9391-db1b1df57504 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1215 microversion: 2.1 time: 0.253497 Mar 29 02:45:40.818058 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2892/5562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:40 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1215 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:41.835417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:41.838016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:41.856171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:41.857193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:41.858274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:41.860521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:42.150129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:42.150129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0e57a94-6248-4da4-8cd2-4c7d58759721 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1267 microversion: 2.1 time: 0.304653 Mar 29 02:45:42.150129 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2671/5563] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:41 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:45:43.167930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:43.167930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:43.184404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:43.184404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:43.184404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:43.190327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:43.711944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:43.728966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7cd8579d-54e7-4d7c-b07b-8ca05f29ab66 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1285 microversion: 2.1 time: 0.571465 Mar 29 02:45:43.734639 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2893/5564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:43 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1285 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:44.763880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:44.763880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:44.793013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:44.793013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:44.793013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:44.793013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:44.937161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:44.945728 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37fe350e-d1e9-487a-99d2-64787b155df3 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1273 microversion: 2.1 time: 0.193740 Mar 29 02:45:44.946299 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2672/5565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:44 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:45.974945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:45.974945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:45.981974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:45.981974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:45.997297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:45.997297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:46.588811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:46.588811 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-896e8be6-a79e-4a75-865f-f10cdf1349e9 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.625012 Mar 29 02:45:46.588811 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2894/5566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:45 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:47.609683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:47.609683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:47.626643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:47.626643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:47.626643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:47.626643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:47.906894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3eb43c20-daef-473d-9c36-92168390bf63 req-374cd627-27aa-4a87-afbe-d8a7434d6d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304381c7-b00a-471c-b19b-d35fa73be18a", "tag": "542f06b0-7655-4f3f-9212-b8faf8f282c7"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:47.909580 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:45:47.909580 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:45:47.932177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3eb43c20-daef-473d-9c36-92168390bf63 req-374cd627-27aa-4a87-afbe-d8a7434d6d18 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:47.932177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3eb43c20-daef-473d-9c36-92168390bf63 req-374cd627-27aa-4a87-afbe-d8a7434d6d18 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:47.997242 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3eb43c20-daef-473d-9c36-92168390bf63 req-374cd627-27aa-4a87-afbe-d8a7434d6d18 service nova] Creating event network-changed:542f06b0-7655-4f3f-9212-b8faf8f282c7 for instance 304381c7-b00a-471c-b19b-d35fa73be18a on n-h1-828148-1 Mar 29 02:45:47.997242 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3eb43c20-daef-473d-9c36-92168390bf63 req-374cd627-27aa-4a87-afbe-d8a7434d6d18 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093772 Mar 29 02:45:48.001135 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2895/5567] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:45:48.688507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:48.714780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a6f31b3-3c00-40ec-af28-4244834d8b14 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 1.101182 Mar 29 02:45:48.726535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2673/5568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:47 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:49.740498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:49.741189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:49.757083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:49.757537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:49.758338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:49.758760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:50.153702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:50.164038 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a483dbe5-75aa-43f2-b9ea-f168ac79906d tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.428000 Mar 29 02:45:50.164890 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2896/5569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:49 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:51.186005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:51.186641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:51.196369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:51.196823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:51.197958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:51.198616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:51.457585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:51.466923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9ed4709-f740-4748-88a9-5743732442d2 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.287756 Mar 29 02:45:51.467495 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2674/5570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:51 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:52.484182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:52.484762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:52.491985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:52.492426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:52.493209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:52.493651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:52.858284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:52.866455 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b7c2a3db-3207-4e82-8a28-15bb53573602 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.386120 Mar 29 02:45:52.867533 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2897/5571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:52 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:53.199855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Action: 'create', calling method: .version_select at 0x7f872408c940>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1199507416"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:53.222342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for project df639ac1a85d475e96fba9d9bd50548b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:45:53.229185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for user dafdab8b25ce4546a5e04436ffd6c8b3 and project df639ac1a85d475e96fba9d9bd50548b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:45:53.501337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for project df639ac1a85d475e96fba9d9bd50548b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:45:53.507016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for user dafdab8b25ce4546a5e04436ffd6c8b3 and project df639ac1a85d475e96fba9d9bd50548b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:45:53.522480 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-934365f1-76a5-4bc4-9d5a-3ab6daa18d9e tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.326360 Mar 29 02:45:53.528433 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2675/5572] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:45:53 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:53.888689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:53.890154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:53.901715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:53.902480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:53.903819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:53.905000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:54.109776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:54.110486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:54.117897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:54.118373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:54.119129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:54.119563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:54.283318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:54.300080 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc5a4b2a-92e3-4738-86da-6f1847de45d6 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.416155 Mar 29 02:45:54.317926 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2898/5573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:53 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:54.389004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:54.397817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8553209e-56f9-4030-b12f-bc60f3d73832 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1684 microversion: 2.1 time: 0.292577 Mar 29 02:45:54.398381 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2676/5574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:54 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1684 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:54.768904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:54.770152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:54.778831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:54.779743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:54.781054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:54.781811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:54.881035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a854e7f-f01c-407e-996a-65f156bc34f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action" status: 200 len: 32636 microversion: 2.1 time: 0.115897 Mar 29 02:45:54.888011 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2899/5575] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:45:54 2022] POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action => generated 32636 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:45:55.073772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:55.074571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:55.095888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.096636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.097646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.098401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.318161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:55.318873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:55.332602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.333406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.339930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.339930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.482190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20b54b6d-d80d-4992-b429-f1e9936f9101 tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1835 microversion: 2.1 time: 0.412090 Mar 29 02:45:55.483689 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2677/5576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:55 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1835 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:55.504338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:55.504338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:55.511840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.512829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.513938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:55.514661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:55.602855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lazy-loading 'flavor' on Instance uuid 587939cd-edd2-4515-b35e-ae6d705206d2 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:45:55.682212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Going to try to live migrate instance to another host {{(pid=103514) live_migrate /opt/stack/nova/nova/compute/api.py:5151}} Mar 29 02:45:56.025224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:56.036820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95164d3f-8423-4f53-9525-0207339ee02b tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.722847 Mar 29 02:45:56.041289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2900/5577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:55 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:57.057680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:45:57.058422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:45:57.066134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:57.066604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:57.067388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:57.067831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:57.712272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:45:57.728613 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e021dd61-9604-4944-b464-c6f1b3e86d2e tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1315 microversion: 2.1 time: 0.674369 Mar 29 02:45:57.729035 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2901/5578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:45:57 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:45:58.288978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-52e99eb7-cf22-48ac-9588-2421a9580dfb req-54fa3492-3c64-4fad-92ba-cd1c51701d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304381c7-b00a-471c-b19b-d35fa73be18a", "name": "network-vif-plugged", "status": "completed", "tag": "542f06b0-7655-4f3f-9212-b8faf8f282c7"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:58.291715 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:45:58.291715 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:45:58.326450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-52e99eb7-cf22-48ac-9588-2421a9580dfb req-54fa3492-3c64-4fad-92ba-cd1c51701d32 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:45:58.327122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-52e99eb7-cf22-48ac-9588-2421a9580dfb req-54fa3492-3c64-4fad-92ba-cd1c51701d32 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:45:58.350335 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-52e99eb7-cf22-48ac-9588-2421a9580dfb req-54fa3492-3c64-4fad-92ba-cd1c51701d32 service nova] Creating event network-vif-plugged:542f06b0-7655-4f3f-9212-b8faf8f282c7 for instance 304381c7-b00a-471c-b19b-d35fa73be18a on n-h1-828148-1 Mar 29 02:45:58.357285 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-52e99eb7-cf22-48ac-9588-2421a9580dfb req-54fa3492-3c64-4fad-92ba-cd1c51701d32 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072489 Mar 29 02:45:58.358382 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2902/5579] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:45:58.474431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1343261654", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8ee85082-d887-4048-b2e6-bef9961665a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1199507416", "security_groups": [{"name": "tempest-secgroup-smoke-933203446"}], "networks": [{"uuid": "6e001805-e679-4f78-bb14-0a05ba06063b"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:45:59.049990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] validate_networks() for [('6e001805-e679-4f78-bb14-0a05ba06063b', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:46:00.360051 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ded4e7a-d308-4e8b-955b-f55ec4afe37a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action" status: 202 len: 0 microversion: 2.1 time: 4.862999 Mar 29 02:46:00.360977 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2678/5580] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:45:55 2022] POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action => generated 0 bytes in 4865 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:46:00.365860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:00.366661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:00.388975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.388975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.388975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.388975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.679353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:00.691010 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-214e7c9b-f24c-435f-9378-cb8c960c8551 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1464 microversion: 2.1 time: 0.328806 Mar 29 02:46:00.692078 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2679/5581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:00 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1464 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:00.696959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:00.697830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:00.707717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.707842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.708517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.709053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.754005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:46:00.755335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:46:00.756105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:46:00.756821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:46:00.757554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:46:00.774354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.778813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.781908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:00.781908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:00.828555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for project df639ac1a85d475e96fba9d9bd50548b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:00.840698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Getting quotas for user dafdab8b25ce4546a5e04436ffd6c8b3 and project df639ac1a85d475e96fba9d9bd50548b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:00.987770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:46:00.991524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ee85082-d887-4048-b2e6-bef9961665a5',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:46:01.082841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:01.095054 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51968a72-6328-47e0-8792-c95707f01c5c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.401481 Mar 29 02:46:01.108925 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2680/5582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:00 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:01.116477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:01.117259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:01.130765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:01.131474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:01.132351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:01.132980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:01.206096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:46:01.583710 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86d15e75-dcea-4d54-b641-777071a3968b tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.114652 Mar 29 02:46:01.585173 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2903/5583] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:45:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 3117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:46:01.596176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-94715624-cee4-499d-91b2-65350c00cb2c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:01.597936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-94715624-cee4-499d-91b2-65350c00cb2c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:01.654630 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c35f95cd-4ed2-41ce-aa58-bc6d612fe6cd tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "DELETE /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 204 len: 0 microversion: 2.1 time: 0.543266 Mar 29 02:46:01.656046 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2681/5584] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:46:01 2022] DELETE /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:46:01.664859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:01.666125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:01.684086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:01.684768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:01.686702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:01.687314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:01.973197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:01.987155 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-85d86387-04e8-472e-b956-6e558d0cb873 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1470 microversion: 2.1 time: 0.326708 Mar 29 02:46:01.988025 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2682/5585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:01 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:02.113941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:02.119958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:02.142467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:02.142923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:02.143715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:02.144149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:02.300487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-94715624-cee4-499d-91b2-65350c00cb2c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:02.316670 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-94715624-cee4-499d-91b2-65350c00cb2c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1099 microversion: 2.1 time: 0.717352 Mar 29 02:46:02.316670 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2904/5586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:01 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1099 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:02.630774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:02.656149 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6a272b7-02dd-4cdb-900c-c624a80a70de tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.529904 Mar 29 02:46:02.656149 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2683/5587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:02 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:03.008789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:03.009443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:03.034148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.034618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:03.035585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.036024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:03.331000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:03.331803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:03.353342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.355636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:03.358876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.362939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:03.484391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:03.499759 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe35f239-214a-4dc4-a8a3-68abcf946627 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1470 microversion: 2.1 time: 0.495912 Mar 29 02:46:03.500356 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2905/5588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:02 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1470 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:03.662001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:03.662664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:03.673952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.686148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:03.690281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:03.692174 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:04.060983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:04.069910 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab8e7bc8-1e19-4526-aac7-5d4af3a15139 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1141 microversion: 2.1 time: 0.742550 Mar 29 02:46:04.086349 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2684/5589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:03 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1141 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:04.517810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:04.519129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:04.529373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:04.531608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:04.533575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:04.535742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:04.630870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:04.649580 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6550eded-7e48-4c13-8e67-7784dac90a59 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.991491 Mar 29 02:46:04.650770 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2906/5590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:03 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:04.656428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ee0c16d2-3365-483b-b15b-ac51fd859342 req-7707c774-9bfe-4bb6-9e15-c6d1bd9dfdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "name": "network-vif-unplugged", "status": "completed", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:04.664969 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:04.664969 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:04.675192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ee0c16d2-3365-483b-b15b-ac51fd859342 req-7707c774-9bfe-4bb6-9e15-c6d1bd9dfdf6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:04.675761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ee0c16d2-3365-483b-b15b-ac51fd859342 req-7707c774-9bfe-4bb6-9e15-c6d1bd9dfdf6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:04.703266 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ee0c16d2-3365-483b-b15b-ac51fd859342 req-7707c774-9bfe-4bb6-9e15-c6d1bd9dfdf6 service nova] Creating event network-vif-unplugged:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:46:04.710395 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ee0c16d2-3365-483b-b15b-ac51fd859342 req-7707c774-9bfe-4bb6-9e15-c6d1bd9dfdf6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057488 Mar 29 02:46:04.715772 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2907/5591] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:05.104058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:05.105459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:05.129250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:05.129707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:05.130497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:05.130929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:05.181858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:05.198872 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cda22da1-414f-4f10-aae9-a7a0857d54d4 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1470 microversion: 2.1 time: 0.684508 Mar 29 02:46:05.208947 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2685/5592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:04 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1470 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:05.634122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a057dae8-1a8a-4f9f-9722-f72b1cfa1f4d req-f0b56a61-513d-4442-8cab-d02ce608a95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304381c7-b00a-471c-b19b-d35fa73be18a", "name": "network-vif-deleted", "tag": "542f06b0-7655-4f3f-9212-b8faf8f282c7"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:05.637589 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:05.637589 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:46:05.661727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a057dae8-1a8a-4f9f-9722-f72b1cfa1f4d req-f0b56a61-513d-4442-8cab-d02ce608a95b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:05.661727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a057dae8-1a8a-4f9f-9722-f72b1cfa1f4d req-f0b56a61-513d-4442-8cab-d02ce608a95b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:05.697263 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a057dae8-1a8a-4f9f-9722-f72b1cfa1f4d req-f0b56a61-513d-4442-8cab-d02ce608a95b service nova] Creating event network-vif-deleted:542f06b0-7655-4f3f-9212-b8faf8f282c7 for instance 304381c7-b00a-471c-b19b-d35fa73be18a on n-h1-828148-1 Mar 29 02:46:05.705919 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a057dae8-1a8a-4f9f-9722-f72b1cfa1f4d req-f0b56a61-513d-4442-8cab-d02ce608a95b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079159 Mar 29 02:46:05.706848 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2686/5593] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:05.712494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:05.713427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:05.724471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:05.725203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:05.731735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:05.732408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:05.828548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:05.860692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d4ba8907-8fdb-4e05-b251-ba6adfe08c39 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1215 microversion: 2.1 time: 0.761346 Mar 29 02:46:05.874743 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2908/5594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:05 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1215 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:06.216259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:06.217556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:06.225511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:06.225965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:06.227048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:06.227486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:06.304858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:06.305539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:06.305987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lazy-loading 'fault' on Instance uuid 304381c7-b00a-471c-b19b-d35fa73be18a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:46:06.538335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:06.555059 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1fa8c99-3b2a-44ae-916c-20ba23b52230 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.846851 Mar 29 02:46:06.558625 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2687/5595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:05 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:06.658297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c9749d5711e486f92a97d1818a20cb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '354982f2d803470f9ab59001dcf5776f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:06.680890 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8793528b-eb32-4324-8df8-5fdebe9147cb tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 200 len: 1305 microversion: 2.1 time: 0.469021 Mar 29 02:46:06.683783 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2909/5596] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:06 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 1305 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:06.882596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:06.883595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:06.893942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:06.894854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:06.895816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:06.896593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.013298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-812c3a0b-d8c5-4d12-b30a-498e4bbe344f req-ac24c883-3b5d-4c3b-8e30-3e392b33973d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:07.015652 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:07.015652 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:07.071419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-812c3a0b-d8c5-4d12-b30a-498e4bbe344f req-ac24c883-3b5d-4c3b-8e30-3e392b33973d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.071578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-812c3a0b-d8c5-4d12-b30a-498e4bbe344f req-ac24c883-3b5d-4c3b-8e30-3e392b33973d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.127559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-812c3a0b-d8c5-4d12-b30a-498e4bbe344f req-ac24c883-3b5d-4c3b-8e30-3e392b33973d service nova] Creating event network-changed:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:46:07.147281 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-812c3a0b-d8c5-4d12-b30a-498e4bbe344f req-ac24c883-3b5d-4c3b-8e30-3e392b33973d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139832 Mar 29 02:46:07.154054 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2910/5597] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:07.295704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:07.309955 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-acc62d9e-5f42-48c6-8692-22d8ea3946e3 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1215 microversion: 2.1 time: 0.431132 Mar 29 02:46:07.313169 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2688/5598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:06 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1215 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:07.465696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-551eb60a-9d57-4086-8983-dc8692edfc5e req-af923fd8-7f23-4910-ad37-894b5d42431f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "name": "network-vif-plugged", "status": "completed", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:07.467855 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:07.467855 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:07.483927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-551eb60a-9d57-4086-8983-dc8692edfc5e req-af923fd8-7f23-4910-ad37-894b5d42431f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.484417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-551eb60a-9d57-4086-8983-dc8692edfc5e req-af923fd8-7f23-4910-ad37-894b5d42431f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.528904 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-551eb60a-9d57-4086-8983-dc8692edfc5e req-af923fd8-7f23-4910-ad37-894b5d42431f service nova] Creating event network-vif-plugged:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:46:07.535982 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-551eb60a-9d57-4086-8983-dc8692edfc5e req-af923fd8-7f23-4910-ad37-894b5d42431f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074950 Mar 29 02:46:07.538302 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2911/5599] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:07.575605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:07.576206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:07.607530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.608206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.609173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.609753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.717030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:07.717030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] [instance: 304381c7-b00a-471c-b19b-d35fa73be18a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:07.734360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.735070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.735998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:07.738535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:07.833429 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] HTTP exception thrown: Instance 304381c7-b00a-471c-b19b-d35fa73be18a could not be found. Mar 29 02:46:07.834915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] Returning 404 to user: Instance 304381c7-b00a-471c-b19b-d35fa73be18a could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:46:07.836601 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b389bf89-2ad2-4094-b564-1c37f200fcc0 tempest-VolumesNegativeTest-179284480 tempest-VolumesNegativeTest-179284480-project] 10.222.0.36 "GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a" status: 404 len: 111 microversion: 2.1 time: 0.140593 Mar 29 02:46:07.838246 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2912/5600] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:07 2022] GET /compute/v2.1/servers/304381c7-b00a-471c-b19b-d35fa73be18a => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:46:08.329943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:08.330617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:08.345158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:08.345609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:08.346557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:08.347002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:08.598229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:08.609753 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a3d08a5d-b304-4fa6-8c75-bcb5c6710542 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 1.038593 Mar 29 02:46:08.641450 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2689/5601] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:07 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:09.597656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:09.614334 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e2c71c7-c5d8-48c0-a3a6-da56591e0de4 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1282 microversion: 2.1 time: 1.288291 Mar 29 02:46:09.614859 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2913/5602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:08 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1282 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:09.638653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:09.639547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:09.660596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:09.661500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:09.661857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:09.662295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:10.307185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:10.321988 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0562021a-97e9-4dc8-a33c-49f5f597ea33 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.687401 Mar 29 02:46:10.326214 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2690/5603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:09 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:10.597119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8a08ce7b-3fc6-450b-ad4a-0accc79a7d5d req-642fc796-c65c-4d6e-81a3-32457bf81acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:10.598739 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:10.598739 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:10.624794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a08ce7b-3fc6-450b-ad4a-0accc79a7d5d req-642fc796-c65c-4d6e-81a3-32457bf81acb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:10.631162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:10.632128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:10.639253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8a08ce7b-3fc6-450b-ad4a-0accc79a7d5d req-642fc796-c65c-4d6e-81a3-32457bf81acb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:10.663044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:10.663557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:10.664281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:10.664714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:10.690771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8a08ce7b-3fc6-450b-ad4a-0accc79a7d5d req-642fc796-c65c-4d6e-81a3-32457bf81acb service nova] Creating event network-changed:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:46:10.708004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8a08ce7b-3fc6-450b-ad4a-0accc79a7d5d req-642fc796-c65c-4d6e-81a3-32457bf81acb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112617 Mar 29 02:46:10.710342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2914/5604] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:11.343957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:11.344955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:11.357390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:11.357995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:11.358142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:11.359946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:11.360602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:11.374738 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5add2a2e-a87e-4572-b7cc-ee7dde313d21 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.747094 Mar 29 02:46:11.375336 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2691/5605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:10 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:11.934945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:11.958429 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13068713-0203-4c85-b0aa-a54067db1267 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.620428 Mar 29 02:46:11.982336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2915/5606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:11 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:12.391953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:12.393257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:12.423997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:12.424756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:12.425960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:12.426601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:12.984359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:12.984359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:12.993258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:12.993701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:12.994605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:12.995073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:13.570087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:13.580624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e6a0a77-9d8b-4a98-86c2-ef5109a01abb tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.604764 Mar 29 02:46:13.591082 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2916/5607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:12 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:13.769395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:13.782944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-314b53e4-fb73-434e-9ed3-24e03a1d0412 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 1.395060 Mar 29 02:46:13.784679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2692/5608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:12 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:14.352558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-17fe63b9-ec9e-4d2c-9105-6422cb08bc0c req-cee4b2d3-86a1-4d56-a1d3-d424d2e9bf4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "name": "network-vif-unplugged", "status": "completed", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:14.354111 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:14.354111 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:14.363418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-17fe63b9-ec9e-4d2c-9105-6422cb08bc0c req-cee4b2d3-86a1-4d56-a1d3-d424d2e9bf4e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:14.363859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-17fe63b9-ec9e-4d2c-9105-6422cb08bc0c req-cee4b2d3-86a1-4d56-a1d3-d424d2e9bf4e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:14.381039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-17fe63b9-ec9e-4d2c-9105-6422cb08bc0c req-cee4b2d3-86a1-4d56-a1d3-d424d2e9bf4e service nova] Creating event network-vif-unplugged:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h1-828148-1 Mar 29 02:46:14.386064 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-17fe63b9-ec9e-4d2c-9105-6422cb08bc0c req-cee4b2d3-86a1-4d56-a1d3-d424d2e9bf4e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037307 Mar 29 02:46:14.386889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2917/5609] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:14.599043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:14.599761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:14.622559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:14.623949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:14.629537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:14.630006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:14.801411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:14.802327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:14.813005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:14.819030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:14.819854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:14.820446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:15.138600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:15.150460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb8148ae-e787-4603-89a1-5d1b3d167234 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.353291 Mar 29 02:46:15.151813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2918/5610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:14 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:15.231099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:15.243572 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71c54627-87c5-4228-b5a5-cad2d0b9071d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.648880 Mar 29 02:46:15.244738 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2693/5611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:14 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:16.176189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:16.180724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:16.191324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:16.192633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:16.194708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:16.194708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:16.262151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:16.262756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:16.290707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:16.291616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:16.298887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:16.299396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:17.028013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:17.040102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f9a8281-82a4-4edd-8bf4-a934461f44f9 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.782356 Mar 29 02:46:17.054012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2694/5612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:16 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:17.085124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:17.090010 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70ca0c4d-4466-47e8-a017-4659891150b6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.923921 Mar 29 02:46:17.090565 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2919/5613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:16 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:18.067212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:18.067840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:18.086575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:18.087425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:18.088326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:18.091027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:18.107718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:18.108570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:18.123771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:18.124332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:18.127533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:18.128052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:18.501176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:18.538451 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-449afc96-27b0-47b0-81de-9b726c29b635 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.481688 Mar 29 02:46:18.540505 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2695/5614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:18 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:19.162038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:19.177889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-347c10bf-f776-417b-8fde-1badf1f597a6 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 1.074552 Mar 29 02:46:19.179155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2920/5615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:18 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:19.554996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:19.555551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:19.586117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:19.586572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:19.587379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:19.596501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:20.194075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:20.194688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:20.210643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:20.211094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:20.216239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:20.216731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:20.240047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:20.250373 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9a71a8b-1f7c-40be-a5e9-9d569b418330 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1694 microversion: 2.1 time: 0.699480 Mar 29 02:46:20.250967 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2696/5616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:19 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1694 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:20.857007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:20.869499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-efe22235-db78-45a9-98c5-926ed4217e7c tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.676153 Mar 29 02:46:20.873051 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2921/5617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:20 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:21.268719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:21.269366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:21.284730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.288041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:21.289971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.290614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:21.747308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:21.769750 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adcd376d-c893-414e-9e7d-0a02ee4ff3b5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1684 microversion: 2.1 time: 0.506109 Mar 29 02:46:21.772315 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2697/5618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:21 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1684 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:21.791178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:21.792041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:21.801065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.808897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:21.808897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.808897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:21.891660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:21.892317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:21.901598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.902383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:21.902903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:21.903655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:22.256153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:22.264573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21ce624b-3b91-4754-8dd2-28cdcc8f86de tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.378008 Mar 29 02:46:22.265515 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2698/5619] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:21 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:22.450997 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38b84039-5880-49f4-b359-9370797ec80a tempest-TestNetworkAdvancedServerOps-1920182219 tempest-TestNetworkAdvancedServerOps-1920182219-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1835 microversion: 2.1 time: 0.664016 Mar 29 02:46:22.451997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2922/5620] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:21 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1835 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:22.467534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:22.468143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:22.483292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:22.483991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:22.484949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:22.485624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:22.793998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:22.816763 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7723385c-8fa1-48fd-91aa-1787101467f3 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1684 microversion: 2.1 time: 0.352810 Mar 29 02:46:22.822219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2699/5621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:22 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1684 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:23.042845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:23.043838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:23.059117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:23.059778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:23.060791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:23.062407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:23.213603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b5072c6-03e1-4173-b958-a7fac19e46f0 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action" status: 200 len: 38648 microversion: 2.1 time: 0.175714 Mar 29 02:46:23.214262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2923/5622] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:46:23 2022] POST /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2/action => generated 38648 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:46:23.283124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:23.283744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:23.298628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:23.298808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:23.299631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:23.305381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:23.332063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d22607c2-2891-41cb-bd9e-44b5fb4fe116 req-b7e090f2-141c-4b7d-bb53-cc6ff6aa7c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "name": "network-vif-plugged", "status": "completed", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:23.333862 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:23.333862 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:23.372566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d22607c2-2891-41cb-bd9e-44b5fb4fe116 req-b7e090f2-141c-4b7d-bb53-cc6ff6aa7c8a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:23.372566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d22607c2-2891-41cb-bd9e-44b5fb4fe116 req-b7e090f2-141c-4b7d-bb53-cc6ff6aa7c8a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:23.410422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d22607c2-2891-41cb-bd9e-44b5fb4fe116 req-b7e090f2-141c-4b7d-bb53-cc6ff6aa7c8a service nova] Creating event network-vif-plugged:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:46:23.420210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d22607c2-2891-41cb-bd9e-44b5fb4fe116 req-b7e090f2-141c-4b7d-bb53-cc6ff6aa7c8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092887 Mar 29 02:46:23.422048 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2924/5623] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:46:24.203359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:24.217677 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c36b116b-d7ea-42ab-99d3-2a6b28eff5e1 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.936590 Mar 29 02:46:24.219317 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2700/5624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:23 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:25.238118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:25.238810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:25.262374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:25.263887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:25.265521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:25.265957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:25.839070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:25.848751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-346f686a-df3b-49d0-b2c5-5e6c9607c1b0 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1270 microversion: 2.1 time: 0.616453 Mar 29 02:46:25.851867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2925/5625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:25 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1270 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:26.694592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:26.695843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:26.715270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:26.715436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Action: 'create', calling method: .version_select at 0x7f872405d4c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1980655370"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:26.716393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:26.717369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:26.718937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:26.768656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for project f031b238b1394bd5b24083b052fcae8b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:26.774062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for user da0f401200204f8ebcfd7faa6919b2fc and project f031b238b1394bd5b24083b052fcae8b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:26.855321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:46:27.311287 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f2faa3d-b8c4-4e9c-9fa5-5bac3eac3f7e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 204 len: 0 microversion: 2.1 time: 0.622075 Mar 29 02:46:27.311876 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2926/5626] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:46:26 2022] DELETE /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 02:46:27.332454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-57dc1541-7c91-4281-b55a-7be5952eb8ae req-b2360f8e-b855-46aa-84ee-38f5af40aea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:27.337862 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:27.337862 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:27.352763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-57dc1541-7c91-4281-b55a-7be5952eb8ae req-b2360f8e-b855-46aa-84ee-38f5af40aea2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:27.353300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-57dc1541-7c91-4281-b55a-7be5952eb8ae req-b2360f8e-b855-46aa-84ee-38f5af40aea2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:27.379273 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-57dc1541-7c91-4281-b55a-7be5952eb8ae req-b2360f8e-b855-46aa-84ee-38f5af40aea2 service nova] Creating event network-changed:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h2-828148-1 Mar 29 02:46:27.387396 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-57dc1541-7c91-4281-b55a-7be5952eb8ae req-b2360f8e-b855-46aa-84ee-38f5af40aea2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072489 Mar 29 02:46:27.388295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2927/5627] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:27.394757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:27.395651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:27.405104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:27.405903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:27.406842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:27.408057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:27.450102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for project f031b238b1394bd5b24083b052fcae8b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:27.465201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for user da0f401200204f8ebcfd7faa6919b2fc and project f031b238b1394bd5b24083b052fcae8b. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:27.497423 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1aa7e6d9-1345-4246-9956-70d9a361810c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 1.164628 Mar 29 02:46:27.498064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2701/5628] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:46:26 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:27.558091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:27.559647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:27.599201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:27.600829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:27.601725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:27.602206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:28.317438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:28.328713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a58187a-3e3a-4adb-9db9-8280634d2eca tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1460 microversion: 2.1 time: 0.938970 Mar 29 02:46:28.329351 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2928/5629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:27 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1460 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:28.347210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:28.347210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:28.377523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:28.377523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:28.377523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:28.377523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:28.392321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:28.404402 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40e147ae-e35b-4f22-a175-0157534eabbd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1690 microversion: 2.1 time: 0.900915 Mar 29 02:46:28.405442 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2702/5630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:27 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1690 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:29.158889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:29.173558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f0bc52c-721a-461f-b04e-c05f36bd8476 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1460 microversion: 2.1 time: 0.831454 Mar 29 02:46:29.186345 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2929/5631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:28 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1460 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:29.428879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:29.429497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:29.439826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:29.447209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:29.448095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:29.448540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:29.639525 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:46:29.640339 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:46:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:46:30.333827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:30.359427 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37b57371-e619-4762-9f45-720d867eeb2f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 200 len: 1690 microversion: 2.1 time: 0.936464 Mar 29 02:46:30.359427 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2703/5632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:29 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 1690 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:30.419872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1b75a59a-f4ec-46e3-9347-b4f256bc9231 req-90dc6881-1064-42c0-a873-6100ffb3a901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587939cd-edd2-4515-b35e-ae6d705206d2", "name": "network-vif-deleted", "tag": "1eabac73-1e37-4b91-a356-a29a3b1ec638"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:30.422092 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:30.422092 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:30.441455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1b75a59a-f4ec-46e3-9347-b4f256bc9231 req-90dc6881-1064-42c0-a873-6100ffb3a901 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:30.442063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1b75a59a-f4ec-46e3-9347-b4f256bc9231 req-90dc6881-1064-42c0-a873-6100ffb3a901 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:30.480349 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1b75a59a-f4ec-46e3-9347-b4f256bc9231 req-90dc6881-1064-42c0-a873-6100ffb3a901 service nova] Creating event network-vif-deleted:1eabac73-1e37-4b91-a356-a29a3b1ec638 for instance 587939cd-edd2-4515-b35e-ae6d705206d2 on n-h2-828148-1 Mar 29 02:46:30.493354 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1b75a59a-f4ec-46e3-9347-b4f256bc9231 req-90dc6881-1064-42c0-a873-6100ffb3a901 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077842 Mar 29 02:46:30.493956 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2930/5633] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:31.378573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:31.379187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: 587939cd-edd2-4515-b35e-ae6d705206d2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:31.393378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:31.393622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:31.394918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:31.395504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:31.461381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] HTTP exception thrown: Instance 587939cd-edd2-4515-b35e-ae6d705206d2 could not be found. Mar 29 02:46:31.462350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Returning 404 to user: Instance 587939cd-edd2-4515-b35e-ae6d705206d2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:46:31.463367 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96edca55-4a8b-47c1-82f4-ffed700885b7 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2" status: 404 len: 111 microversion: 2.1 time: 0.091197 Mar 29 02:46:31.464497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2704/5634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:31 2022] GET /compute/v2.1/servers/587939cd-edd2-4515-b35e-ae6d705206d2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:46:37.587069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c43fe71f-4329-4344-b4af-6a7492e4297a req-47063e24-ab2b-48cf-8fbb-4b68c8c44363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:37.589700 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:37.589700 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:37.619757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c43fe71f-4329-4344-b4af-6a7492e4297a req-47063e24-ab2b-48cf-8fbb-4b68c8c44363 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:37.620532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c43fe71f-4329-4344-b4af-6a7492e4297a req-47063e24-ab2b-48cf-8fbb-4b68c8c44363 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:37.664058 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:46:37.692176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c43fe71f-4329-4344-b4af-6a7492e4297a req-47063e24-ab2b-48cf-8fbb-4b68c8c44363 service nova] Creating event network-changed:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:46:37.711336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c43fe71f-4329-4344-b4af-6a7492e4297a req-47063e24-ab2b-48cf-8fbb-4b68c8c44363 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126788 Mar 29 02:46:37.712899 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2931/5635] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:46:44.133462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2b889f57-192f-4afa-9f75-627f6e42382e req-4cc3ec0d-3436-490b-8d82-97c2b32349f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:44.133462 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:44.133462 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:46:44.162888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b889f57-192f-4afa-9f75-627f6e42382e req-4cc3ec0d-3436-490b-8d82-97c2b32349f7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:44.162888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2b889f57-192f-4afa-9f75-627f6e42382e req-4cc3ec0d-3436-490b-8d82-97c2b32349f7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:44.224767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2b889f57-192f-4afa-9f75-627f6e42382e req-4cc3ec0d-3436-490b-8d82-97c2b32349f7 service nova] Creating event network-changed:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:46:44.230861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2b889f57-192f-4afa-9f75-627f6e42382e req-4cc3ec0d-3436-490b-8d82-97c2b32349f7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104098 Mar 29 02:46:44.232101 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2705/5636] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:46:46.436488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-728457ab-3af0-4228-aae8-28aa3a257da4 req-d3be5470-d2d1-4995-8907-5f0651b7d1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:46.438339 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:46:46.438339 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:46:46.457293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-728457ab-3af0-4228-aae8-28aa3a257da4 req-d3be5470-d2d1-4995-8907-5f0651b7d1a6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:46.457741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-728457ab-3af0-4228-aae8-28aa3a257da4 req-d3be5470-d2d1-4995-8907-5f0651b7d1a6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:46.481178 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 42324. Mar 29 02:46:46.498348 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-728457ab-3af0-4228-aae8-28aa3a257da4 req-d3be5470-d2d1-4995-8907-5f0651b7d1a6 service nova] Creating event network-changed:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:46:46.510726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-728457ab-3af0-4228-aae8-28aa3a257da4 req-d3be5470-d2d1-4995-8907-5f0651b7d1a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080862 Mar 29 02:46:46.516249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2932/5637] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:46:49.160796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1546307664-access_point-277917247", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "43ca17dd-41d8-494f-adbb-d282b13c1b61"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1980655370", "security_groups": [{"name": "tempest-secgroup_access--1569448252"}, {"name": "tempest-secgroup_general--2025936447"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:50.307806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] validate_networks() for [('43ca17dd-41d8-494f-adbb-d282b13c1b61', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:46:52.017919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02073c05-dbc5-41ce-83e2-59fc4a59118d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '.version_select at 0x7f8724b2a310>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:52.143287 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02073c05-dbc5-41ce-83e2-59fc4a59118d tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092991445" status: 202 len: 0 microversion: 2.1 time: 0.130704 Mar 29 02:46:52.148069 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2933/5638] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 02:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092991445 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:46:52.170939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: .version_select at 0x7f8724172430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1996457110"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:46:52.202916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:52.209604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:52.562480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:52.571122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:52.599033 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-32934491-b082-40b8-aa6c-a8fcb6514412 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.435471 Mar 29 02:46:52.599708 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2934/5639] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:46:52 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:46:52.698911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:46:52.699385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:46:52.699811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:46:52.700230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:46:52.700649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:46:52.722627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:52.723009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:52.723820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:52.724258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:52.779232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for project f031b238b1394bd5b24083b052fcae8b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:46:52.793834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for user da0f401200204f8ebcfd7faa6919b2fc and project f031b238b1394bd5b24083b052fcae8b. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:46:52.836565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:46:52.838466 n-d-828148-1 devstack@n-api.service[103514]: WARNING nova.utils [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1546307664-access_point-277917247 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1546307664-ac Mar 29 02:46:52.850441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:46:53.054251 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7534e41-93c7-4b26-8c0d-9f2e6b1ba40e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 3.898556 Mar 29 02:46:53.061375 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2706/5640] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:46:49 2022] POST /compute/v2.1/servers => generated 458 bytes in 3907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:46:53.067797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0363aec2-7861-4444-82fa-45f1e7e6d067 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:53.067797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0363aec2-7861-4444-82fa-45f1e7e6d067 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:53.165210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0363aec2-7861-4444-82fa-45f1e7e6d067 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:53.170233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0363aec2-7861-4444-82fa-45f1e7e6d067 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1294 microversion: 2.1 time: 0.105997 Mar 29 02:46:53.170233 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2935/5641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:53 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:54.186849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc8319fd-183c-48c7-98be-ffa2a75b3fa7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:54.187483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fc8319fd-183c-48c7-98be-ffa2a75b3fa7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:54.366939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fc8319fd-183c-48c7-98be-ffa2a75b3fa7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:54.397253 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fc8319fd-183c-48c7-98be-ffa2a75b3fa7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1294 microversion: 2.1 time: 0.213733 Mar 29 02:46:54.408245 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2707/5642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:54 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1294 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:55.427191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:55.427810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:55.444422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:55.444887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:55.445778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:55.448799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:55.649944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:55.664263 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f75c3bc-f9a6-486e-8aba-c3cbb6883bee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1346 microversion: 2.1 time: 0.242811 Mar 29 02:46:55.676779 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2936/5643] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:55 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1346 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:56.682408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:56.682954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:56.696153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:56.696415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:56.697663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:56.697856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:56.924716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:56.951724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e15f21a2-e62c-4d93-9b82-e33ee87d7601 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1352 microversion: 2.1 time: 0.273211 Mar 29 02:46:56.952814 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2708/5644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:56 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1352 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:57.970427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:57.972408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:57.983593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:57.986955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:57.988049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:57.989006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:58.712645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:46:58.728324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b960dfe-7b41-4985-bf39-b8ae3ff129f4 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.762749 Mar 29 02:46:58.734162 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2937/5645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:57 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:46:59.750763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:46:59.752277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:46:59.765113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:59.769891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:46:59.770728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:46:59.771167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:00.126621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-066af3b6-789f-4944-8b77-25e3a86db5a0 req-c33b7fdf-ebf7-47c8-855a-a95423046136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aedb383-d1ff-4a40-97c6-8b28f1fa928b", "tag": "2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:00.126621 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:00.126621 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:00.126621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-066af3b6-789f-4944-8b77-25e3a86db5a0 req-c33b7fdf-ebf7-47c8-855a-a95423046136 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:00.126621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-066af3b6-789f-4944-8b77-25e3a86db5a0 req-c33b7fdf-ebf7-47c8-855a-a95423046136 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:00.167997 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-066af3b6-789f-4944-8b77-25e3a86db5a0 req-c33b7fdf-ebf7-47c8-855a-a95423046136 service nova] Creating event network-changed:2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6 for instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b on n-h1-828148-1 Mar 29 02:47:00.173705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-066af3b6-789f-4944-8b77-25e3a86db5a0 req-c33b7fdf-ebf7-47c8-855a-a95423046136 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099248 Mar 29 02:47:00.174849 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2938/5646] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:47:00.188156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:00.203654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fdab5908-44a1-4ef5-ae22-34c0620f07c7 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.455423 Mar 29 02:47:00.204635 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2709/5647] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:46:59 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:01.225117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:01.225117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:01.237372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:01.237817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:01.238603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:01.239033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:01.675458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:01.685892 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5634ed5-7d25-4370-a3ac-9da145899a39 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.466158 Mar 29 02:47:01.686476 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2939/5648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:01 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:02.704258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:02.704905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:02.720654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:02.729404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:02.729404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:02.729404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:03.152374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:03.163852 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8260727-be1d-4f09-85c7-d0da46d94fdd tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.464303 Mar 29 02:47:03.165407 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2710/5649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:02 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:04.182824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:04.184158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:04.197700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:04.202742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:04.205323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:04.206901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:04.514351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:04.526734 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-205b71fa-d2da-421b-9a81-df864ef46e18 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.349346 Mar 29 02:47:04.530254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2940/5650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:04 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:05.547138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:05.547758 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:05.568637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:05.569386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:05.570201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:05.570608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:06.801095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:06.812781 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f37a5001-c98a-4cbf-8f8a-b0725d712a9f tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 1.273018 Mar 29 02:47:06.813956 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2711/5651] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:05 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:07.814084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-875431481", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "d0cb133c-a791-4059-b6e6-b5fe3488dbbc"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:07.832761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:07.833665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:07.861845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:07.862647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:07.863620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:07.864337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:07.953376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] validate_networks() for [('d0cb133c-a791-4059-b6e6-b5fe3488dbbc', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:47:08.371317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:08.378435 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f132cba4-e822-4cce-a682-fc2c48747734 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.551524 Mar 29 02:47:08.379867 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2712/5652] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:07 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:09.396339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:09.397892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:09.405934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:09.406682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:09.407977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:09.408487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:09.715124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:09.724792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b680ee4-e13e-416f-8220-cbb0fa9bb03d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.332679 Mar 29 02:47:09.734236 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2713/5653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:09 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:09.764216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:47:09.765628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:47:09.766328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:47:09.766879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:47:09.767964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:47:09.779354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:09.784926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:09.784926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:09.785729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:09.807416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Getting quotas for project 2652d9d7214845cf9fc4c57a5b0983a9. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:47:09.814414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Getting quotas for user 57dcae98f962474ca31fa42461ad8366 and project 2652d9d7214845cf9fc4c57a5b0983a9. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:47:09.830750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:47:09.834054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:47:09.966963 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a25cccc-604b-4b0b-8781-718c5bb46f09 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335946 Mar 29 02:47:09.968605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2941/5654] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:47:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:47:09.984236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4dabadf-fee6-4e97-8472-1381811d5d8c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:09.989291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4dabadf-fee6-4e97-8472-1381811d5d8c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:10.121422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4dabadf-fee6-4e97-8472-1381811d5d8c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:10.128934 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4dabadf-fee6-4e97-8472-1381811d5d8c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1213 microversion: 2.1 time: 0.152782 Mar 29 02:47:10.133201 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2714/5655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:09 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:10.742722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:10.743403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:10.760770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:10.760770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:10.761965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:10.765135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:11.146643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22d15419-eca1-4d9c-b20a-63d60d19e0ef tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:11.147322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22d15419-eca1-4d9c-b20a-63d60d19e0ef tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:11.167603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:11.177929 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ded603e-f0e2-4b95-b20f-513cbf93074e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.439041 Mar 29 02:47:11.181255 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2942/5656] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:10 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:11.249594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9753c4fa-6de7-49de-a648-f76bedca708f req-ce433b47-6154-413f-8467-ed619b34c17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aedb383-d1ff-4a40-97c6-8b28f1fa928b", "name": "network-vif-plugged", "status": "completed", "tag": "2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:11.251564 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:11.251564 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:11.252900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22d15419-eca1-4d9c-b20a-63d60d19e0ef tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:11.261537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9753c4fa-6de7-49de-a648-f76bedca708f req-ce433b47-6154-413f-8467-ed619b34c17e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:11.261800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22d15419-eca1-4d9c-b20a-63d60d19e0ef tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1213 microversion: 2.1 time: 0.118613 Mar 29 02:47:11.261974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9753c4fa-6de7-49de-a648-f76bedca708f req-ce433b47-6154-413f-8467-ed619b34c17e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:11.268010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2715/5657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:11 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:11.282434 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9753c4fa-6de7-49de-a648-f76bedca708f req-ce433b47-6154-413f-8467-ed619b34c17e service nova] Creating event network-vif-plugged:2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6 for instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b on n-h1-828148-1 Mar 29 02:47:11.288548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9753c4fa-6de7-49de-a648-f76bedca708f req-ce433b47-6154-413f-8467-ed619b34c17e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042914 Mar 29 02:47:11.289482 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2943/5658] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:47:12.195845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:12.196566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:12.209120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:12.211430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:12.212874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:12.216452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:12.282544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:12.284246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:12.298594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:12.299816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:12.301092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:12.301731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:12.550456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:12.568324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3239ce2a-6274-479d-863e-c406338f4d61 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1265 microversion: 2.1 time: 0.288051 Mar 29 02:47:12.587711 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2944/5659] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:12 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:12.668529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:12.683064 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eae86a11-0707-43e1-b9fd-86357a4e7469 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1472 microversion: 2.1 time: 0.491375 Mar 29 02:47:12.686176 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2716/5660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:12 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:13.591143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:13.591873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:13.605684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:13.606354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:13.607489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:13.608066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:13.608662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-272389291", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "b0054ce2-4778-4e7b-b975-3cdd2c342342"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1996457110", "security_groups": [{"name": "tempest-secgroup-smoke-367206580"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:13.876829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:13.905767 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-beb5117b-b799-4888-aec7-04c5bfdf0816 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1283 microversion: 2.1 time: 0.317563 Mar 29 02:47:13.907022 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2945/5661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:13 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1283 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:13.912627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:13.913531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:13.963392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:13.965454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:13.966744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:13.967612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:14.271104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] validate_networks() for [('b0054ce2-4778-4e7b-b975-3cdd2c342342', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:47:14.289626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:14.304096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac992570-1c19-4212-907c-caad32744c53 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1643 microversion: 2.1 time: 0.394218 Mar 29 02:47:14.314505 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2946/5662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:13 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1643 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:14.325219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:14.326013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:14.348785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:14.349279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:14.350096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:14.350536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:14.849071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:14.857480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-09ed5c0e-7cf3-4e38-9535-c22246ea13ba tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1643 microversion: 2.1 time: 0.537352 Mar 29 02:47:14.876418 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2947/5663] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:14 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1643 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:14.881376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:14.881994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:14.896007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:14.897359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:14.898553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:14.899065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:15.533030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:15.558188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:47:15.569892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Getting quotas for user b83b97dc189f492597920841d1e68b0d and project 5d11d7c3db0948a5a1aa0b7f0eb42848. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:47:15.588714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:47:15.589134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:47:15.787186 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7c8c2c8b-2df3-4d7a-9c43-f0ad3857eb3f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.195809 Mar 29 02:47:15.790530 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2717/5664] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:47:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 2201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:47:15.805198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:15.809852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:15.839665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:15.839665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:15.839665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:15.839665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:15.949651 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-14e624de-1843-4e1c-8a6a-3d23527e7c1b tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1794 microversion: 2.1 time: 1.071681 Mar 29 02:47:15.965160 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2948/5665] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:14 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1794 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:15.966372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b827d3a7-d189-437a-8673-2f53dee3299e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:15.966986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b827d3a7-d189-437a-8673-2f53dee3299e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:16.421353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b827d3a7-d189-437a-8673-2f53dee3299e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:16.432634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b827d3a7-d189-437a-8673-2f53dee3299e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1266 microversion: 2.1 time: 0.477819 Mar 29 02:47:16.433395 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2949/5666] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:15 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1266 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:16.655933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:16.666943 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d1373a2a-4888-47fe-910d-6f5f9ce93db5 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.872437 Mar 29 02:47:16.666943 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2718/5667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:15 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:17.450104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:17.451376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:17.466408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:17.467126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:17.468035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:17.468611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:17.648347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:17.658181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-096778e5-11dc-4697-a124-afdf0d4fc232 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1270 microversion: 2.1 time: 0.212304 Mar 29 02:47:17.658688 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2950/5668] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:17 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1270 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:17.681344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:17.681974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:17.696673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:17.701471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:17.702292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:17.702733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:18.591876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:18.616282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b74fd438-2678-45b5-81c5-8a94b496c0cd tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.933068 Mar 29 02:47:18.616282 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2719/5669] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:17 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:18.692719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:18.694897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:18.722519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:18.723167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:18.723960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:18.724396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:19.126592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:19.140709 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4d3f779-db80-4c8b-a762-84b74f656d8b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1318 microversion: 2.1 time: 0.466424 Mar 29 02:47:19.156560 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2951/5670] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:18 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:19.628274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:19.635971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:19.648887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:19.649640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:19.652732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:19.653495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:19.657687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6611bf8d-57c2-477d-8143-d77abe1d0b24 req-d40593ec-8c0e-46b5-8c2d-9019b00abb83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "436a00f3-c012-4f80-950b-6d398309e0f3", "tag": "cc422322-d57c-4227-81d3-20400fcc42e4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:19.658990 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:19.658990 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:19.677928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6611bf8d-57c2-477d-8143-d77abe1d0b24 req-d40593ec-8c0e-46b5-8c2d-9019b00abb83 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:19.678371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6611bf8d-57c2-477d-8143-d77abe1d0b24 req-d40593ec-8c0e-46b5-8c2d-9019b00abb83 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:19.713127 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6611bf8d-57c2-477d-8143-d77abe1d0b24 req-d40593ec-8c0e-46b5-8c2d-9019b00abb83 service nova] Creating event network-changed:cc422322-d57c-4227-81d3-20400fcc42e4 for instance 436a00f3-c012-4f80-950b-6d398309e0f3 on n-h1-828148-1 Mar 29 02:47:19.746228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6611bf8d-57c2-477d-8143-d77abe1d0b24 req-d40593ec-8c0e-46b5-8c2d-9019b00abb83 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092288 Mar 29 02:47:19.747412 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2952/5671] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:47:20.171947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:20.172652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:20.191482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:20.191876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:20.193532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:20.194413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:20.284783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:20.296173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cae9d87b-7337-44d7-abfb-fe3fa5924651 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.670263 Mar 29 02:47:20.300200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2720/5672] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:19 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:20.531787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:20.565559 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf7ffbe5-562d-48f5-897b-7ef4b1ad31ba tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1324 microversion: 2.1 time: 0.397529 Mar 29 02:47:20.568595 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2953/5673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:20 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1324 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:21.311256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:21.311860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:21.319226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:21.319675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:21.320442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:21.320923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:21.585163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:21.586013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:21.613344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:21.617170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:21.619340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:21.619794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:21.818853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:21.830064 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d36aa310-6331-437c-900a-1571e580d086 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.522182 Mar 29 02:47:21.830646 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2721/5674] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:21 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:22.006350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:22.019831 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6cc2cab4-1262-4009-825a-d68742a4810b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1324 microversion: 2.1 time: 0.439751 Mar 29 02:47:22.030529 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2954/5675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:21 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:22.193069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8441a49b-ca87-4688-80db-adbc93f3760e req-dc41752e-0de1-43bf-b6d8-b00dff80b2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aedb383-d1ff-4a40-97c6-8b28f1fa928b", "tag": "2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:22.194657 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:22.194657 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:47:22.210877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8441a49b-ca87-4688-80db-adbc93f3760e req-dc41752e-0de1-43bf-b6d8-b00dff80b2f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:22.214595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8441a49b-ca87-4688-80db-adbc93f3760e req-dc41752e-0de1-43bf-b6d8-b00dff80b2f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:22.256074 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8441a49b-ca87-4688-80db-adbc93f3760e req-dc41752e-0de1-43bf-b6d8-b00dff80b2f5 service nova] Creating event network-changed:2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6 for instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b on n-h1-828148-1 Mar 29 02:47:22.267477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8441a49b-ca87-4688-80db-adbc93f3760e req-dc41752e-0de1-43bf-b6d8-b00dff80b2f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079549 Mar 29 02:47:22.268100 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2722/5676] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:47:22.854793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:22.854793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:22.874017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:22.874883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:22.882785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:22.883196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:22.948017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:22.948627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:22.967929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:22.968381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:22.969201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:22.981324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:23.324888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lazy-loading 'services' on Instance uuid 2281f005-a176-4cfd-91a8-4292815dff29 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:47:23.687118 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9aaec7f-41ee-47ec-b3a0-e73771c595c4 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29/os-volume_attachments/4f8f40d4-55d9-4363-b775-215993b3a285" status: 202 len: 0 microversion: 2.1 time: 0.745981 Mar 29 02:47:23.688270 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2723/5677] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:47:22 2022] DELETE /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29/os-volume_attachments/4f8f40d4-55d9-4363-b775-215993b3a285 => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:47:23.720733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:23.730113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:23.754700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:23.767689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:23.772154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:23.773995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:24.022504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:24.032525 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-db831a60-3624-4001-bd53-a33ee1dc198b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 1.188081 Mar 29 02:47:24.046883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2955/5678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:22 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:24.496818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:24.511937 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51f96a59-9863-4ecc-80a9-27fc9b07fcdf tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.822119 Mar 29 02:47:24.515400 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2724/5679] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:23 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:25.052041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:25.053639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:25.066305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:25.066819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:25.067603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:25.068033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:25.310369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1be60a50-660b-46b1-bc27-f515999e49f0 req-3484ab0e-9b89-46e7-9679-cadc8bba1595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:25.312064 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:25.312064 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:47:25.333635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1be60a50-660b-46b1-bc27-f515999e49f0 req-3484ab0e-9b89-46e7-9679-cadc8bba1595 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:25.334396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1be60a50-660b-46b1-bc27-f515999e49f0 req-3484ab0e-9b89-46e7-9679-cadc8bba1595 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:25.364552 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1be60a50-660b-46b1-bc27-f515999e49f0 req-3484ab0e-9b89-46e7-9679-cadc8bba1595 service nova] Creating event network-changed:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:47:25.371890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1be60a50-660b-46b1-bc27-f515999e49f0 req-3484ab0e-9b89-46e7-9679-cadc8bba1595 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069684 Mar 29 02:47:25.373053 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2725/5680] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:47:25.491894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:25.503295 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-702d7693-5b4f-4709-a3ad-6143e765c69e tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.455450 Mar 29 02:47:25.504411 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2956/5681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:25 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:25.534119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:25.535188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:25.546689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:25.547217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:25.548058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:25.548823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:25.995133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:25.995133 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-02fbcce7-3d28-4e7a-b987-2f3e832edb14 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.334141 Mar 29 02:47:25.995133 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2726/5682] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:25 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:26.252262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:26.252748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:26.264711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.265212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.265994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.266887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.334030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:47:26.520827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:26.521618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:26.530090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.530641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.537085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.537085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.797099 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a69b0841-a021-454c-ae53-4b2d2fa26a19 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 204 len: 0 microversion: 2.1 time: 0.548021 Mar 29 02:47:26.797952 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2957/5683] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:47:26 2022] DELETE /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:47:26.806469 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:26.807465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:26.816668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.817386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.818250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.818909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.874009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:26.889175 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5e33f7e5-9ba9-492d-96f9-a4f3683fcedf tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.371783 Mar 29 02:47:26.900345 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2727/5684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:26 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:26.905619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:26.906515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:26.915193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.916151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:26.918745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:26.919399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:27.062009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:27.072189 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c9c1759f-7cc2-4a29-acde-cb30561ed108 tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1469 microversion: 2.1 time: 0.269709 Mar 29 02:47:27.073665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2958/5685] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:26 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:27.179266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:27.195338 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19f9c9bb-ea7a-454b-9290-b4677a6fbbb5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.287198 Mar 29 02:47:27.195338 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2728/5686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:26 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:27.906614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:27.907162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:27.914726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:27.915315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:27.916123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:27.916632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.099807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:28.101057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:28.111984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:28.113738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.114188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:28.114805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.185920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:28.197758 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2aad4763-fa98-4767-b960-5aa34277e7fa tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.295076 Mar 29 02:47:28.198797 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2959/5687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:27 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:28.209087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:28.209837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:28.223677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:28.224197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.225109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:28.225609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.497620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:28.506147 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca1223ac-75ea-4ed0-933f-a81739c37a8f tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1469 microversion: 2.1 time: 0.415908 Mar 29 02:47:28.507103 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2729/5688] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:28 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1469 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:28.686059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:28.695533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-655613f6-5006-473a-9334-540b58613f43 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.492948 Mar 29 02:47:28.699898 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2960/5689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:28 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:28.889436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-64aadb46-45cb-41c7-a3fc-8183ba2a6929 req-5612644f-b500-47ef-9412-03591498707e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436a00f3-c012-4f80-950b-6d398309e0f3", "name": "network-vif-plugged", "status": "completed", "tag": "cc422322-d57c-4227-81d3-20400fcc42e4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:28.891435 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:28.891435 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:47:28.912336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-64aadb46-45cb-41c7-a3fc-8183ba2a6929 req-5612644f-b500-47ef-9412-03591498707e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:28.912787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-64aadb46-45cb-41c7-a3fc-8183ba2a6929 req-5612644f-b500-47ef-9412-03591498707e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:28.938410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-64aadb46-45cb-41c7-a3fc-8183ba2a6929 req-5612644f-b500-47ef-9412-03591498707e service nova] Creating event network-vif-plugged:cc422322-d57c-4227-81d3-20400fcc42e4 for instance 436a00f3-c012-4f80-950b-6d398309e0f3 on n-h1-828148-1 Mar 29 02:47:28.944458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-64aadb46-45cb-41c7-a3fc-8183ba2a6929 req-5612644f-b500-47ef-9412-03591498707e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058990 Mar 29 02:47:28.946844 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2730/5690] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:47:29.214829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:29.215466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:29.229953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.230954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.235645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.238579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.526198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:29.526949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:29.537736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.546966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.546966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.546966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.653140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:29.667075 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7188b3a3-db85-40b4-9c6f-12e4048c714b tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1313 microversion: 2.1 time: 0.456875 Mar 29 02:47:29.672958 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2961/5691] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:29 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:29.675285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e5824533-ea3f-4faf-9a1a-8d35cae8c31e req-a6bb026b-db7c-4c46-8e65-8528138fbdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281f005-a176-4cfd-91a8-4292815dff29", "name": "network-vif-deleted", "tag": "e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:29.681309 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:29.681309 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:29.691324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e5824533-ea3f-4faf-9a1a-8d35cae8c31e req-a6bb026b-db7c-4c46-8e65-8528138fbdf8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.692357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e5824533-ea3f-4faf-9a1a-8d35cae8c31e req-a6bb026b-db7c-4c46-8e65-8528138fbdf8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.715817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:29.719525 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e5824533-ea3f-4faf-9a1a-8d35cae8c31e req-a6bb026b-db7c-4c46-8e65-8528138fbdf8 service nova] Creating event network-vif-deleted:e9e01d8b-b8a6-435f-8f9d-d0e26dc556e5 for instance 2281f005-a176-4cfd-91a8-4292815dff29 on n-h2-828148-1 Mar 29 02:47:29.724757 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e5824533-ea3f-4faf-9a1a-8d35cae8c31e req-a6bb026b-db7c-4c46-8e65-8528138fbdf8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055582 Mar 29 02:47:29.725876 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2962/5692] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:47:29.732611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:29.734624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:29.744077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.744529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.745376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:29.745825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:29.748999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e265692d-8c4a-49e3-a1a2-0a1dac2d19cd tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1427 microversion: 2.1 time: 0.210972 Mar 29 02:47:29.750721 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2731/5693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:29 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1427 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:30.038030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:30.048446 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-252746a1-730c-4e4b-9f48-384e476c61fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.321378 Mar 29 02:47:30.049391 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2963/5694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:29 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:30.681837 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:47:30.685475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:30.685656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:30.705140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:30.705611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:30.706820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:30.707393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:30.767035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:30.774057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:30.777421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:30.777421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:30.777750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:30.778208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:30.866496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:30.866944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:30.867408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lazy-loading 'fault' on Instance uuid 2281f005-a176-4cfd-91a8-4292815dff29 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:47:30.941359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:30.950623 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37aa2e55-fab2-4a01-82ce-3caeb8da1c6a tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1498 microversion: 2.1 time: 0.270933 Mar 29 02:47:30.951202 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2732/5695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:30 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1498 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:31.067282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:31.067933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:31.075679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:31.076137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:31.077023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:31.077632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:31.096037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2b731e780ae4f0b87c198469e9e49b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3228cb76f273418ea96b93693aa3f4c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:31.107181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a6bf91e9-0497-4eb6-ba49-1381b44902ef tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 200 len: 1304 microversion: 2.1 time: 0.344147 Mar 29 02:47:31.118158 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2964/5696] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:30 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 1304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:31.444311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:31.453223 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8809630e-5b4d-4dd1-adc0-c3d39fe6082a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.390152 Mar 29 02:47:31.453790 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2733/5697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:31 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:32.127330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:32.128552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] [instance: 2281f005-a176-4cfd-91a8-4292815dff29] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:32.145727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:32.145727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:32.145727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:32.145727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:32.193934 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] HTTP exception thrown: Instance 2281f005-a176-4cfd-91a8-4292815dff29 could not be found. Mar 29 02:47:32.194543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] Returning 404 to user: Instance 2281f005-a176-4cfd-91a8-4292815dff29 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:47:32.195371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b98a128-afc9-4f96-84fe-a869ff36b9ae tempest-VolumesBackupsTest-1043623394 tempest-VolumesBackupsTest-1043623394-project] 10.222.0.36 "GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29" status: 404 len: 111 microversion: 2.1 time: 0.072348 Mar 29 02:47:32.195976 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2965/5698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:32 2022] GET /compute/v2.1/servers/2281f005-a176-4cfd-91a8-4292815dff29 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:47:32.471315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:32.473440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:32.489282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:32.494133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:32.495199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:32.495786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:32.602176 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 43604. Mar 29 02:47:32.784119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:32.803713 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-df1ab6d4-7f8a-476b-9b2c-d75c77a1f657 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.336387 Mar 29 02:47:32.804299 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2734/5699] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:32 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:33.700208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-43bc3b9f-f6fc-4a08-a6ae-198f7d122a30 req-d27f8e64-c2c9-4d86-9486-230871cd41fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "name": "network-vif-plugged", "status": "completed", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:33.706365 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:33.706365 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:33.718483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43bc3b9f-f6fc-4a08-a6ae-198f7d122a30 req-d27f8e64-c2c9-4d86-9486-230871cd41fb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:33.719595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43bc3b9f-f6fc-4a08-a6ae-198f7d122a30 req-d27f8e64-c2c9-4d86-9486-230871cd41fb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:33.747071 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-43bc3b9f-f6fc-4a08-a6ae-198f7d122a30 req-d27f8e64-c2c9-4d86-9486-230871cd41fb service nova] Creating event network-vif-plugged:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:47:33.752791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-43bc3b9f-f6fc-4a08-a6ae-198f7d122a30 req-d27f8e64-c2c9-4d86-9486-230871cd41fb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060703 Mar 29 02:47:33.758930 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2966/5700] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:47:33.825771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:33.826218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:33.834205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:33.834659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:33.835594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:33.836040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:34.187065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:34.203739 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec6d2da6-81ff-4c47-8a55-542b18864c49 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.385585 Mar 29 02:47:34.205076 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2735/5701] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:33 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:35.229566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:35.229566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:35.236091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:35.237182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:35.238176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:35.238885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:35.500900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:35.510950 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3f949cf2-457d-49f5-8dbb-dbe1f3c6cd5f tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1391 microversion: 2.1 time: 0.292179 Mar 29 02:47:35.511743 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2967/5702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:35 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:36.339770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:36.340638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:36.351061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.351061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:36.351061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.351061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:36.418876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:47:36.530864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:36.532017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:36.539452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.540062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:36.541087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.541661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:36.796541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a951aba-7b3c-49c4-9ada-2d3e85cb8874 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "DELETE /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 204 len: 0 microversion: 2.1 time: 0.460436 Mar 29 02:47:36.797091 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2736/5703] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:47:36 2022] DELETE /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:47:36.807288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:36.808107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:36.816794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.817430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:36.818412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:36.818968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:37.021451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:37.029917 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5dab392f-f77b-4323-bdb2-c9d13b2ccbaa tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1564 microversion: 2.1 time: 0.502632 Mar 29 02:47:37.030489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2968/5704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:36 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1564 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:37.046761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:37.047396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:37.054576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:37.055549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:37.056302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:37.056898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:37.070136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:37.079569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a55a72e3-0d9d-4d8a-885d-086305e14fcc tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1504 microversion: 2.1 time: 0.277409 Mar 29 02:47:37.080143 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2737/5705] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:36 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:37.289899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:37.298829 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65071c5e-5ce0-4a0b-808a-9535d0e6669c tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1564 microversion: 2.1 time: 0.255836 Mar 29 02:47:37.299685 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2969/5706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:37 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1564 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:38.098519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:38.099843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:38.114598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:38.114598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:38.114598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:38.114598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:38.420581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:38.434085 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c1ed000-b821-40c6-afea-719a2c6ee5b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1504 microversion: 2.1 time: 0.340092 Mar 29 02:47:38.434721 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2738/5707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:38 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:47:39.456543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:39.458091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:39.468716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:39.469501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:39.470455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:39.472100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:39.632011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5a223983-d514-42e9-b151-8a6bfb230da4 req-18b53181-32bd-4566-8814-7c3778e4b300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "436a00f3-c012-4f80-950b-6d398309e0f3", "name": "network-vif-deleted", "tag": "cc422322-d57c-4227-81d3-20400fcc42e4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:39.635246 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:39.635246 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:47:39.655117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5a223983-d514-42e9-b151-8a6bfb230da4 req-18b53181-32bd-4566-8814-7c3778e4b300 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:39.655747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5a223983-d514-42e9-b151-8a6bfb230da4 req-18b53181-32bd-4566-8814-7c3778e4b300 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:39.681127 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5a223983-d514-42e9-b151-8a6bfb230da4 req-18b53181-32bd-4566-8814-7c3778e4b300 service nova] Creating event network-vif-deleted:cc422322-d57c-4227-81d3-20400fcc42e4 for instance 436a00f3-c012-4f80-950b-6d398309e0f3 on n-h1-828148-1 Mar 29 02:47:39.700109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5a223983-d514-42e9-b151-8a6bfb230da4 req-18b53181-32bd-4566-8814-7c3778e4b300 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077568 Mar 29 02:47:39.703253 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2739/5708] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:47:39.902354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57dcae98f962474ca31fa42461ad8366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652d9d7214845cf9fc4c57a5b0983a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:39.913432 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d3d4913-7c92-4110-a90c-5edc705b874c tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 200 len: 1462 microversion: 2.1 time: 0.465730 Mar 29 02:47:39.914518 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2970/5709] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:39 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 1462 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:40.741870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-78feab1d-b250-4209-89dd-b84e8ab95bdb req-4f5eaf2e-a5f2-4c34-8a94-855626db00c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:40.743806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:40.744569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:40.747923 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:47:40.747923 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:47:40.761058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:40.761739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:40.764596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-78feab1d-b250-4209-89dd-b84e8ab95bdb req-4f5eaf2e-a5f2-4c34-8a94-855626db00c5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:40.765024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:40.765548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:40.768250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-78feab1d-b250-4209-89dd-b84e8ab95bdb req-4f5eaf2e-a5f2-4c34-8a94-855626db00c5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:40.802548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-78feab1d-b250-4209-89dd-b84e8ab95bdb req-4f5eaf2e-a5f2-4c34-8a94-855626db00c5 service nova] Creating event network-changed:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:47:40.814481 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-78feab1d-b250-4209-89dd-b84e8ab95bdb req-4f5eaf2e-a5f2-4c34-8a94-855626db00c5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075940 Mar 29 02:47:40.815949 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2971/5710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:47:40.932253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:47:40.933358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] [instance: 436a00f3-c012-4f80-950b-6d398309e0f3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:40.950105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:40.950815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:40.955160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:40.957675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:41.021875 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] HTTP exception thrown: Instance 436a00f3-c012-4f80-950b-6d398309e0f3 could not be found. Mar 29 02:47:41.022816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] Returning 404 to user: Instance 436a00f3-c012-4f80-950b-6d398309e0f3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:47:41.024202 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-145b1f69-c061-4217-bfac-49f1f9b7c4b4 tempest-VolumesActionsTest-1785315546 tempest-VolumesActionsTest-1785315546-project] 10.222.0.36 "GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3" status: 404 len: 111 microversion: 2.1 time: 0.097078 Mar 29 02:47:41.025606 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2972/5711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:40 2022] GET /compute/v2.1/servers/436a00f3-c012-4f80-950b-6d398309e0f3 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:47:41.128281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:47:41.139443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffc14517-8b69-4163-8e42-a9bee179aa9e tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1564 microversion: 2.1 time: 0.406764 Mar 29 02:47:41.140032 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2740/5712] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:47:40 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1564 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:47:59.830957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:47:59.831901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:47:59.840078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:59.840514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:59.841325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:47:59.841754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:47:59.934712 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-882591ad-699e-426f-acaa-c7d9e79a37d6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action" status: 200 len: 24571 microversion: 2.1 time: 0.107053 Mar 29 02:47:59.935342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2973/5713] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:47:59 2022] POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action => generated 24571 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:48:05.833706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-39f169f4-223c-4078-b8ee-9cf5d5395002 req-9e301cc6-9714-4315-96f7-7cf395f880e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:05.837098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:05.837098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:05.839314 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:48:05.839314 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:48:05.857279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:05.857279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:05.862317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:05.862979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:05.864966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-39f169f4-223c-4078-b8ee-9cf5d5395002 req-9e301cc6-9714-4315-96f7-7cf395f880e5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:05.865460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-39f169f4-223c-4078-b8ee-9cf5d5395002 req-9e301cc6-9714-4315-96f7-7cf395f880e5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:05.902008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-39f169f4-223c-4078-b8ee-9cf5d5395002 req-9e301cc6-9714-4315-96f7-7cf395f880e5 service nova] Creating event network-changed:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:48:05.911030 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-39f169f4-223c-4078-b8ee-9cf5d5395002 req-9e301cc6-9714-4315-96f7-7cf395f880e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081013 Mar 29 02:48:05.914680 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2974/5714] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:48:05.951604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:48:06.494376 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4dd9092b-e82c-4f52-956f-dbb6eacc4e6d tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 204 len: 0 microversion: 2.1 time: 0.668762 Mar 29 02:48:06.494956 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2741/5715] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:48:05 2022] DELETE /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:48:06.509119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:06.509119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:06.513787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:06.514235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:06.515011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:06.515445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:07.028262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:07.053105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eea84201-6b71-437b-a096-11c86595b338 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1584 microversion: 2.1 time: 0.553412 Mar 29 02:48:07.053703 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2975/5716] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:06 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1584 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:08.071354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:08.072038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:08.079739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:08.080176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:08.080972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:08.081439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:08.308910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:08.319321 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2613e236-cddc-451e-b40a-a6fac24ba233 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1466 microversion: 2.1 time: 0.252516 Mar 29 02:48:08.320677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2742/5717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:08 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1466 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:09.259105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8536afbc-85a5-4b26-9a87-d0d029092b3d req-ceb00a25-a3ce-412a-99cb-1f7ebe623c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44c436f-583f-4da2-88e8-ebdeae552c1c", "name": "network-vif-deleted", "tag": "322edf2e-6477-4e47-a701-22a751c8c87e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:09.260644 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:48:09.260644 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:48:09.269687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8536afbc-85a5-4b26-9a87-d0d029092b3d req-ceb00a25-a3ce-412a-99cb-1f7ebe623c62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:09.270192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8536afbc-85a5-4b26-9a87-d0d029092b3d req-ceb00a25-a3ce-412a-99cb-1f7ebe623c62 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:09.285917 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8536afbc-85a5-4b26-9a87-d0d029092b3d req-ceb00a25-a3ce-412a-99cb-1f7ebe623c62 service nova] Creating event network-vif-deleted:322edf2e-6477-4e47-a701-22a751c8c87e for instance f44c436f-583f-4da2-88e8-ebdeae552c1c on n-h2-828148-1 Mar 29 02:48:09.291076 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8536afbc-85a5-4b26-9a87-d0d029092b3d req-ceb00a25-a3ce-412a-99cb-1f7ebe623c62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035563 Mar 29 02:48:09.295244 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2976/5718] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:48:09.337692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:09.338307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:09.345979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:09.346427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:09.347195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:09.347664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:09.504354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:09.521513 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9b4441ae-649f-4031-8e60-b1f9225698bb tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1399 microversion: 2.1 time: 0.187921 Mar 29 02:48:09.532036 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2743/5719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:09 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1399 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:10.540508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:10.541358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:10.549057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:10.549574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:10.550400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:10.550898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:10.630224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:10.630666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:10.631124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lazy-loading 'fault' on Instance uuid f44c436f-583f-4da2-88e8-ebdeae552c1c {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:48:10.826106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dafdab8b25ce4546a5e04436ffd6c8b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df639ac1a85d475e96fba9d9bd50548b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:10.835788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ddca939-602b-41d8-9201-ff0ccad01f98 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 200 len: 1235 microversion: 2.1 time: 0.299169 Mar 29 02:48:10.836813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2977/5720] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:10 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 1235 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:10.841258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:10.843423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:10.852225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:10.853046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:10.853824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:10.854254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:10.981314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:48:10.981736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:48:10.982321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:48:10.982733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:48:10.983145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:48:11.489269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:11.509575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.510324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:11.512094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.514784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:11.642622 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-de43ec04-9821-458c-beeb-0428acd23740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action" status: 202 len: 1138 microversion: 2.1 time: 0.805469 Mar 29 02:48:11.654346 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2744/5721] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:48:10 2022] POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action => generated 1138 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Mar 29 02:48:11.659016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:11.659755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:11.680612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.681265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:11.682159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.682702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:11.857935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:11.865134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] [instance: f44c436f-583f-4da2-88e8-ebdeae552c1c] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:11.884830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.889380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:11.892245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:11.892870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:12.016164 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] HTTP exception thrown: Instance f44c436f-583f-4da2-88e8-ebdeae552c1c could not be found. Mar 29 02:48:12.017037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Returning 404 to user: Instance f44c436f-583f-4da2-88e8-ebdeae552c1c could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:48:12.018027 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-63fbaf70-0b58-436c-9f2c-277a5380bddd tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c" status: 404 len: 111 microversion: 2.1 time: 0.166830 Mar 29 02:48:12.018778 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2745/5722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:11 2022] GET /compute/v2.1/servers/f44c436f-583f-4da2-88e8-ebdeae552c1c => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 02:48:12.041002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:12.051384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b5e729ef-1354-4cbc-aee0-4d8352799740 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.397089 Mar 29 02:48:12.052052 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2978/5723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:11 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:12.433261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b94c1056-9a8b-4c7d-88dc-5168e969c276 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] Calling method '.version_select at 0x7f8717d573a0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:12.540640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b94c1056-9a8b-4c7d-88dc-5168e969c276 tempest-TestVolumeBackupRestore-877399975 tempest-TestVolumeBackupRestore-877399975-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1199507416" status: 202 len: 0 microversion: 2.1 time: 0.110912 Mar 29 02:48:12.541228 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2746/5724] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 02:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1199507416 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:48:13.070325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:13.071068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:13.085502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:13.098712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:13.099742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:13.102133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:13.581971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:13.593550 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fdf5a542-f50b-41b8-a5a0-f3966bb5e0e4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.527693 Mar 29 02:48:13.605276 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2979/5725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:13 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:14.617987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:14.619134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:14.635739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:14.642925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:14.643852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:14.644432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:15.228864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:15.244206 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9dc10fb3-80ce-4e63-b74a-a8a996b15f5a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.631169 Mar 29 02:48:15.249671 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2747/5726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:14 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:16.266654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:16.268786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:16.282702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:16.283154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:16.283949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:16.284672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:16.913159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:16.929022 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-701fa638-034a-48c2-8d1e-1018eb062763 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.665656 Mar 29 02:48:16.939529 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2980/5727] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:16 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:17.946120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:17.946740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:17.967375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:17.967829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:17.968621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:17.973236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:18.724866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:18.741230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21110940-b025-46a4-af1c-9bbf23848576 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.799119 Mar 29 02:48:18.742121 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2748/5728] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:17 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:19.761530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:19.767785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:19.785982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:19.789275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:19.790235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:19.790750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:20.105864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:20.114818 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d2d1ad2-7c8c-4425-8fd4-6dd8bd7afed5 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.360601 Mar 29 02:48:20.115692 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2981/5729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:19 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:21.131423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:21.132722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:21.140722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:21.141499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:21.142514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:21.143196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:22.326409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:22.334515 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-629a6b7e-db6b-4871-ba71-891e9f0d2eb4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 1.206800 Mar 29 02:48:22.335673 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2749/5730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:21 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:23.353615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:23.357196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:23.362074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:23.362787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:23.363952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:23.364730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:23.737278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:23.747713 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-001a83a7-10d7-43c6-aa33-5945542da23b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.398639 Mar 29 02:48:23.754672 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2982/5731] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:23 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:24.765754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:24.767212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:24.771453 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:48:24.777341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:24.777855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:24.778686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:24.779217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:25.289582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:25.300640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-42bea671-2bcb-49e6-acd9-55896c1a6b4b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.538829 Mar 29 02:48:25.301964 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2750/5732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:24 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:26.318955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:26.319747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:26.336619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:26.337293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:26.338714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:26.339313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:27.439985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:27.445407 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4898761c-4389-4357-991f-e2d8130580e8 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 1.130206 Mar 29 02:48:27.446626 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2983/5733] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:26 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:28.462759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:28.463370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:28.478802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:28.479263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:28.480054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:28.480486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:28.605615 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45200. Mar 29 02:48:29.120952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:29.134981 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-de2389f7-7a78-4e11-bdac-8b4d2c44bd78 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1692 microversion: 2.1 time: 0.676515 Mar 29 02:48:29.135719 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2751/5734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:28 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1692 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:30.153864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:30.155011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:30.167442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:30.168101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:30.169157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:30.169754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:30.918994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:30.933687 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7821e657-8ce4-400d-b0a1-239191305ba4 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1698 microversion: 2.1 time: 0.783873 Mar 29 02:48:30.938970 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2984/5735] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:30 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1698 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:31.952613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:31.954107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:31.962603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:31.963341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:31.964510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:31.965352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:32.979756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:32.990006 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-995c573a-f3f3-4ae2-84e5-3e45573326fd tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1698 microversion: 2.1 time: 1.042072 Mar 29 02:48:32.991801 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2752/5736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:31 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1698 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:34.007777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:34.008424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:34.021607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:34.022584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:34.023369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:34.023813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:34.145225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-59a60de6-cfbf-4add-91d1-8747f9c617bd req-cb195ed7-7eb9-433a-a23a-195303f5855c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "name": "network-vif-unplugged", "status": "completed", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:34.147259 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:48:34.147259 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:48:34.179227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-59a60de6-cfbf-4add-91d1-8747f9c617bd req-cb195ed7-7eb9-433a-a23a-195303f5855c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:34.179671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-59a60de6-cfbf-4add-91d1-8747f9c617bd req-cb195ed7-7eb9-433a-a23a-195303f5855c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:34.256733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-59a60de6-cfbf-4add-91d1-8747f9c617bd req-cb195ed7-7eb9-433a-a23a-195303f5855c service nova] Creating event network-vif-unplugged:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:48:34.270433 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-59a60de6-cfbf-4add-91d1-8747f9c617bd req-cb195ed7-7eb9-433a-a23a-195303f5855c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128627 Mar 29 02:48:34.273840 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2753/5737] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:48:34.963685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:34.973340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-719d6d1a-fa82-46f1-ac72-92d23992dfa6 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1683 microversion: 2.1 time: 0.969716 Mar 29 02:48:34.989165 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2985/5738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:34 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1683 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:40.082606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-79379243-865e-4efc-999e-10a039eb096d req-7b0c99e0-e8d1-4627-87b1-3365573c80b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "name": "network-vif-plugged", "status": "completed", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:40.085396 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:48:40.085396 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:48:40.122658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-79379243-865e-4efc-999e-10a039eb096d req-7b0c99e0-e8d1-4627-87b1-3365573c80b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:40.124560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-79379243-865e-4efc-999e-10a039eb096d req-7b0c99e0-e8d1-4627-87b1-3365573c80b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:40.202713 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-79379243-865e-4efc-999e-10a039eb096d req-7b0c99e0-e8d1-4627-87b1-3365573c80b0 service nova] Creating event network-vif-plugged:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:48:40.218620 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-79379243-865e-4efc-999e-10a039eb096d req-7b0c99e0-e8d1-4627-87b1-3365573c80b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140528 Mar 29 02:48:40.219820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2754/5739] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:48:42.787826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-811775502", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "55bb03ed-5435-49c3-b3cd-e72c26046998"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1980655370", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4aedb383-d1ff-4a40-97c6-8b28f1fa928b"]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:43.301023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] validate_networks() for [('55bb03ed-5435-49c3-b3cd-e72c26046998', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:48:45.348781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:48:45.349349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:48:45.350348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:48:45.350768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:48:45.351189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:48:45.372683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:45.375119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:45.377643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:45.378320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:45.429707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for project f031b238b1394bd5b24083b052fcae8b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:48:45.442076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Getting quotas for user da0f401200204f8ebcfd7faa6919b2fc and project f031b238b1394bd5b24083b052fcae8b. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:48:45.476579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:48:45.481321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:48:45.682781 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-342166f2-079a-4e99-8d7a-8e599d2ea424 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.899337 Mar 29 02:48:45.690936 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2986/5740] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:48:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 2908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:48:45.703949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e278f6a0-488f-4c25-8882-0d0a277e4155 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:45.704701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e278f6a0-488f-4c25-8882-0d0a277e4155 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:46.044869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e278f6a0-488f-4c25-8882-0d0a277e4155 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:46.055931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e278f6a0-488f-4c25-8882-0d0a277e4155 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1241 microversion: 2.1 time: 0.358308 Mar 29 02:48:46.061224 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2755/5741] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:45 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1241 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:47.072455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:47.081877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:47.097432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:47.100960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:47.102110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:47.103800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:47.269801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:47.281418 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-969766fa-0bd1-4e48-8be3-151d6a2b75a3 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1245 microversion: 2.1 time: 0.212760 Mar 29 02:48:47.290593 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2987/5742] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:47 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1245 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:48.297935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:48.298655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:48.319250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:48.319779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:48.320612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:48.322297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:48.592677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:48.596816 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0838b4de-90d7-43e1-9a65-6fa65be42248 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1293 microversion: 2.1 time: 0.302437 Mar 29 02:48:48.607038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2756/5743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:48 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1293 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:49.614798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:49.615780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:49.634340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:49.635039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:49.636213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:49.637140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:49.868966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:49.878242 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b9beb7f-e5bd-4371-9df0-fd19b837b1c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.267998 Mar 29 02:48:49.878821 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2988/5744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:49 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:50.899017 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:50.900895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:50.914361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:50.915317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:50.917261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:50.918557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:51.159790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:51.167905 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f5d6335-1869-4a0a-8b81-e37930a4b838 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.274945 Mar 29 02:48:51.168666 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2757/5745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:50 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:52.185822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:52.186440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:52.210818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:52.210818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:52.210818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:52.210818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:52.751862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:52.769700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f5e5f03-b25e-4478-977e-40d16b9c99fc tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.587442 Mar 29 02:48:52.771824 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2989/5746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:52 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:52.923570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-da7ab340-a429-425b-9aeb-3ac3910f7fc1 req-505b4e32-eca1-49df-86d5-978d3b11a854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c853975a-c7ac-439e-b3fa-d9f56ef38adb", "tag": "fe4e06ae-2dab-49ec-a050-17e20eabb169"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:52.925668 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:48:52.925668 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:48:52.946126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-da7ab340-a429-425b-9aeb-3ac3910f7fc1 req-505b4e32-eca1-49df-86d5-978d3b11a854 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:52.946803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-da7ab340-a429-425b-9aeb-3ac3910f7fc1 req-505b4e32-eca1-49df-86d5-978d3b11a854 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:52.972321 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-da7ab340-a429-425b-9aeb-3ac3910f7fc1 req-505b4e32-eca1-49df-86d5-978d3b11a854 service nova] Creating event network-changed:fe4e06ae-2dab-49ec-a050-17e20eabb169 for instance c853975a-c7ac-439e-b3fa-d9f56ef38adb on n-h2-828148-1 Mar 29 02:48:52.981463 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-da7ab340-a429-425b-9aeb-3ac3910f7fc1 req-505b4e32-eca1-49df-86d5-978d3b11a854 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061173 Mar 29 02:48:52.984985 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2758/5747] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:48:53.789683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:53.791099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:53.809789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:53.810788 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:53.812134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:53.812716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:54.177964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:54.192372 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6172f60-0b57-462a-a780-9e4172e8a34e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.408488 Mar 29 02:48:54.193051 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2990/5748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:53 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:55.218974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:55.218974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:55.227535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:55.228367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:55.229428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:55.230086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:55.427983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:55.438412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b61022e-b610-4f1c-8a46-58b36e0f07e6 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.226594 Mar 29 02:48:55.439338 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2759/5749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:55 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:55.639676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:48:55.640713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:55.672565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:55.673349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:55.674359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:55.675004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:55.815302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-198ecd0a-4b8b-42cc-9dd6-0d08349be30a tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action" status: 200 len: 24566 microversion: 2.1 time: 0.179852 Mar 29 02:48:55.816621 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2991/5750] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:48:55 2022] POST /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678/action => generated 24566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 02:48:56.455494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:56.456116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:56.470008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:56.470785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:56.471936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:56.473032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:56.721297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:56.731784 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab615a6f-6f8b-4b2b-adcb-d4796237b7c0 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.279914 Mar 29 02:48:56.741718 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2760/5751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:56 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:57.751129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:57.753116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:57.766097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:57.766978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:57.768211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:57.769027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:57.947947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:57.958008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-713075f9-fb77-4fd5-8095-c5484d1fad6d tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.211831 Mar 29 02:48:57.959072 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2992/5752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:57 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:48:58.977322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:48:58.978543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:48:58.987694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:58.989123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:58.990761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:48:58.991410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:48:59.189763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:48:59.213794 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c370958-abf2-4e1a-87e4-b9394e2c7c8e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.232301 Mar 29 02:48:59.213794 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2761/5753] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:48:58 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:00.221454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:00.222115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:00.231011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:00.231484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:00.232239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:00.232681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:00.479975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:00.488098 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-188c8828-03e8-40fc-ae39-3d8523a706ca tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.270329 Mar 29 02:49:00.488712 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2993/5754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:00 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:01.505200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:01.505906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:01.514879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:01.515616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:01.516668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:01.517422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:01.751195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:01.764907 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98546494-c7a8-4840-83c1-49fb7c40d0e2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.263401 Mar 29 02:49:01.777649 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2762/5755] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:01 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:01.992242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a212f46a-4557-4d2a-97d3-8801c11bbe47 req-d62d08cd-9cdc-405b-813d-04749eedbfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c853975a-c7ac-439e-b3fa-d9f56ef38adb", "name": "network-vif-plugged", "status": "completed", "tag": "fe4e06ae-2dab-49ec-a050-17e20eabb169"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:01.994379 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:01.994379 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:49:02.002930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a212f46a-4557-4d2a-97d3-8801c11bbe47 req-d62d08cd-9cdc-405b-813d-04749eedbfe2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:02.003361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a212f46a-4557-4d2a-97d3-8801c11bbe47 req-d62d08cd-9cdc-405b-813d-04749eedbfe2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:02.020324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a212f46a-4557-4d2a-97d3-8801c11bbe47 req-d62d08cd-9cdc-405b-813d-04749eedbfe2 service nova] Creating event network-vif-plugged:fe4e06ae-2dab-49ec-a050-17e20eabb169 for instance c853975a-c7ac-439e-b3fa-d9f56ef38adb on n-h2-828148-1 Mar 29 02:49:02.025920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a212f46a-4557-4d2a-97d3-8801c11bbe47 req-d62d08cd-9cdc-405b-813d-04749eedbfe2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037661 Mar 29 02:49:02.027124 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2994/5756] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:02.782208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:02.782824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:02.803354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:02.803799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:02.814117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:02.814561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:03.151182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:03.163069 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-353be2ff-6004-4557-9c43-45fb5d6a6105 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1299 microversion: 2.1 time: 0.384909 Mar 29 02:49:03.168696 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2763/5757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:02 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:04.187036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:04.188503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:04.202051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:04.202717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:04.204546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:04.205260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:04.471611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:04.482437 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7105db8-3779-4837-9ce1-c56d0d0cefb5 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1471 microversion: 2.1 time: 0.300951 Mar 29 02:49:04.485485 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2995/5758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:04 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:04.500899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:04.501516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:04.511498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:04.516209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:04.517633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:04.518283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:05.105979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:05.120372 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3007683e-e1e0-4bf3-a2fe-044d84778d81 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1471 microversion: 2.1 time: 0.620209 Mar 29 02:49:05.125435 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2764/5759] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:04 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:05.134002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:05.134769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:05.143485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:05.144276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:05.145338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:05.146039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:05.374066 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7d030536-f692-4982-862e-3d2c8525dae3 tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1622 microversion: 2.1 time: 0.243790 Mar 29 02:49:05.375983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2996/5760] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:05 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1622 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:05.390958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:05.391806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:05.403001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:05.403717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:05.404509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:05.404968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:05.980285 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4b9099d8-ba17-4d81-8413-13593829aa2d tempest-TestSecurityGroupsBasicOps-758375312 tempest-TestSecurityGroupsBasicOps-758375312-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1913 microversion: 2.1 time: 0.581103 Mar 29 02:49:05.980285 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2765/5761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:05 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1913 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:06.229701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:06.230205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:06.237719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:06.238535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:06.239590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:06.240239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:06.315886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:49:06.713108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43f68e02-2fdc-4e02-a6f6-88b38d47b3c8 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 204 len: 0 microversion: 2.1 time: 0.486617 Mar 29 02:49:06.714852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2997/5762] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:49:06 2022] DELETE /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:49:06.724149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:06.725221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:06.737253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:06.737896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:06.738834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:06.739517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:07.078630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:07.089593 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56f896b6-47a9-48eb-936e-663f6c98e03c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1477 microversion: 2.1 time: 0.370262 Mar 29 02:49:07.090853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2766/5763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:06 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:49:08.109960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:08.111099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:08.121703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:08.122445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:08.123598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:08.124259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:08.688043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:08.711514 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d9b50cb-fcc1-4fde-807a-752c352e2eb2 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1477 microversion: 2.1 time: 0.604735 Mar 29 02:49:08.713384 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2998/5764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:08 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1477 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:09.737477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:09.738092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:09.739199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:09.740714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:09.754282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:09.754619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:09.756235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:09.756873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:09.758502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:09.758874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:09.760313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:09.760567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:09.894832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:49:10.233893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:10.248151 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1888c6df-59b0-4caf-ad34-0f9708d9049a tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1477 microversion: 2.1 time: 0.520957 Mar 29 02:49:10.248998 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2767/5765] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:09 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:10.253532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-164b636d-0489-4cdb-a761-9ef898e44386 req-52fac1f8-d617-4778-a28d-ce2540d35edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:10.264451 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:10.264451 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:49:10.287283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-164b636d-0489-4cdb-a761-9ef898e44386 req-52fac1f8-d617-4778-a28d-ce2540d35edc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:10.288004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-164b636d-0489-4cdb-a761-9ef898e44386 req-52fac1f8-d617-4778-a28d-ce2540d35edc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:10.337035 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-164b636d-0489-4cdb-a761-9ef898e44386 req-52fac1f8-d617-4778-a28d-ce2540d35edc service nova] Creating event network-changed:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:49:10.353604 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea56df32-50dd-4925-8ff4-f099ceca309b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 204 len: 0 microversion: 2.1 time: 0.621849 Mar 29 02:49:10.357603 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 2999/5766] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:49:09 2022] DELETE /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:49:10.364243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:10.365548 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-164b636d-0489-4cdb-a761-9ef898e44386 req-52fac1f8-d617-4778-a28d-ce2540d35edc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110542 Mar 29 02:49:10.366318 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2768/5767] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:10.378667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:10.396627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:10.397350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:10.398314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:10.398915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:11.266505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:11.267815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:11.283818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:11.284535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:11.285559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:11.286777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:11.436467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:11.439194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:11.439795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lazy-loading 'fault' on Instance uuid c853975a-c7ac-439e-b3fa-d9f56ef38adb {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:49:11.497645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:11.508979 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3b876190-c182-4506-8b42-ac230c437547 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1689 microversion: 2.1 time: 1.149861 Mar 29 02:49:11.511569 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3000/5768] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:10 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1689 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:11.635374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:11.656826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c494949-0676-4161-bb48-0e53109ef86e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 200 len: 1331 microversion: 2.1 time: 0.394383 Mar 29 02:49:11.657758 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2769/5769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:11 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 1331 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:49:12.433293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ec530d3d-3273-402d-9ff1-820449528685 req-0476c374-27ef-46a3-980d-2728be3ef154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c853975a-c7ac-439e-b3fa-d9f56ef38adb", "name": "network-vif-deleted", "tag": "fe4e06ae-2dab-49ec-a050-17e20eabb169"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:12.435345 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:12.435345 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:49:12.460510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec530d3d-3273-402d-9ff1-820449528685 req-0476c374-27ef-46a3-980d-2728be3ef154 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:12.461244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec530d3d-3273-402d-9ff1-820449528685 req-0476c374-27ef-46a3-980d-2728be3ef154 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:12.510207 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ec530d3d-3273-402d-9ff1-820449528685 req-0476c374-27ef-46a3-980d-2728be3ef154 service nova] Creating event network-vif-deleted:fe4e06ae-2dab-49ec-a050-17e20eabb169 for instance c853975a-c7ac-439e-b3fa-d9f56ef38adb on n-h2-828148-1 Mar 29 02:49:12.520907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ec530d3d-3273-402d-9ff1-820449528685 req-0476c374-27ef-46a3-980d-2728be3ef154 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092823 Mar 29 02:49:12.521524 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3001/5770] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:12.528852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:12.530300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:12.541831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:12.542250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:12.543135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:12.545647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:12.675939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:12.678782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: c853975a-c7ac-439e-b3fa-d9f56ef38adb] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:12.694357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:12.695153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:12.696164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:12.698789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:12.775384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] HTTP exception thrown: Instance c853975a-c7ac-439e-b3fa-d9f56ef38adb could not be found. Mar 29 02:49:12.776425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Returning 404 to user: Instance c853975a-c7ac-439e-b3fa-d9f56ef38adb could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:49:12.777514 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51029a6e-1c45-4058-ba9a-87b60ee57b4e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb" status: 404 len: 111 microversion: 2.1 time: 0.105840 Mar 29 02:49:12.778630 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3002/5771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:12 2022] GET /compute/v2.1/servers/c853975a-c7ac-439e-b3fa-d9f56ef38adb => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:49:13.330578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:13.344536 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c424bb97-3b10-4a38-89e6-07c70257b423 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1570 microversion: 2.1 time: 0.818246 Mar 29 02:49:13.345641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2770/5772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:12 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1570 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:14.360586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:14.361274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:14.375572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:14.376018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:14.376790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:14.377305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:14.545371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:14.545847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:14.546314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lazy-loading 'fault' on Instance uuid e2d75a92-c8c6-42f6-9342-16d774354678 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:49:14.624168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c822c828-cd6e-412d-952b-47a2b1feee92 req-91218be6-17d6-4c3a-90c8-ab2e6cd69691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d75a92-c8c6-42f6-9342-16d774354678", "name": "network-vif-deleted", "tag": "95d906e8-72db-4610-a990-0496e56be095"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:14.625936 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:14.625936 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:49:14.646827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c822c828-cd6e-412d-952b-47a2b1feee92 req-91218be6-17d6-4c3a-90c8-ab2e6cd69691 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:14.647218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c822c828-cd6e-412d-952b-47a2b1feee92 req-91218be6-17d6-4c3a-90c8-ab2e6cd69691 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:14.686931 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c822c828-cd6e-412d-952b-47a2b1feee92 req-91218be6-17d6-4c3a-90c8-ab2e6cd69691 service nova] Creating event network-vif-deleted:95d906e8-72db-4610-a990-0496e56be095 for instance e2d75a92-c8c6-42f6-9342-16d774354678 on n-h2-828148-1 Mar 29 02:49:14.693553 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c822c828-cd6e-412d-952b-47a2b1feee92 req-91218be6-17d6-4c3a-90c8-ab2e6cd69691 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073407 Mar 29 02:49:14.694708 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2771/5773] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:14.960715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b83b97dc189f492597920841d1e68b0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d11d7c3db0948a5a1aa0b7f0eb42848', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:14.970742 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-187e0526-1ad6-4521-8c2f-1beb66c98a07 tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 200 len: 1356 microversion: 2.1 time: 0.613692 Mar 29 02:49:14.973357 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3003/5774] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:14 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 1356 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:15.991396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:15.992692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] [instance: e2d75a92-c8c6-42f6-9342-16d774354678] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:16.008763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:16.009240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:16.010025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:16.010461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:16.064071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] HTTP exception thrown: Instance e2d75a92-c8c6-42f6-9342-16d774354678 could not be found. Mar 29 02:49:16.064929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Returning 404 to user: Instance e2d75a92-c8c6-42f6-9342-16d774354678 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:49:16.065906 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a6d7f25-08e0-4fa8-a712-efe44e4433da tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678" status: 404 len: 111 microversion: 2.1 time: 0.079475 Mar 29 02:49:16.067084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2772/5775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:15 2022] GET /compute/v2.1/servers/e2d75a92-c8c6-42f6-9342-16d774354678 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:49:24.495575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:24.496798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:24.500203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-27d600d6-04ff-450e-a905-150e17d6e3a0 req-eda11597-34ad-43ab-a0f2-4b042a79b929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aedb383-d1ff-4a40-97c6-8b28f1fa928b", "tag": "2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:24.502454 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:24.502454 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:49:24.515493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:24.516281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:24.517300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:24.517854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:24.518625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-27d600d6-04ff-450e-a905-150e17d6e3a0 req-eda11597-34ad-43ab-a0f2-4b042a79b929 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:24.529193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-27d600d6-04ff-450e-a905-150e17d6e3a0 req-eda11597-34ad-43ab-a0f2-4b042a79b929 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:24.554215 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-27d600d6-04ff-450e-a905-150e17d6e3a0 req-eda11597-34ad-43ab-a0f2-4b042a79b929 service nova] Creating event network-changed:2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6 for instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b on n-h1-828148-1 Mar 29 02:49:24.562475 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-27d600d6-04ff-450e-a905-150e17d6e3a0 req-eda11597-34ad-43ab-a0f2-4b042a79b929 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065596 Mar 29 02:49:24.577210 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2773/5776] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:24.704853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:49:25.385211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e62ae7f-2b5e-47f8-a591-030438f479af tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 204 len: 0 microversion: 2.1 time: 0.894599 Mar 29 02:49:25.386614 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3004/5777] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:49:24 2022] DELETE /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 0 bytes in 897 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:49:25.396102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:25.398059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:25.418082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:25.419297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:25.420426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:25.422574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:25.981989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73379fe9-137e-4a89-9586-5e0ad30aa12b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] Calling method '.version_select at 0x7f87240cfdc0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:26.094864 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73379fe9-137e-4a89-9586-5e0ad30aa12b tempest-TestNetworkAdvancedServerOps-760812788 tempest-TestNetworkAdvancedServerOps-760812788-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996457110" status: 202 len: 0 microversion: 2.1 time: 0.120471 Mar 29 02:49:26.095690 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3005/5778] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 02:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1996457110 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:49:26.671405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:26.687507 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b66e22b1-61a6-4c33-9a41-7043ffdcae75 tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1649 microversion: 2.1 time: 1.295753 Mar 29 02:49:26.692921 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2774/5779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:25 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1649 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:27.711900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:27.712921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:27.750335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:27.755030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:27.758081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:27.758537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:28.263970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:28.277324 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac76dd91-a669-4179-a4af-57cc99f5df3e tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1649 microversion: 2.1 time: 0.570605 Mar 29 02:49:28.284299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-19a98051-fbd6-4695-a5ac-98b2b1d8a61a req-d9d83242-7395-44cf-92a7-8ffefba4f78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aedb383-d1ff-4a40-97c6-8b28f1fa928b", "name": "network-vif-deleted", "tag": "2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:28.286941 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:49:28.286941 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:49:28.289273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3006/5780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:27 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1649 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:28.301192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-19a98051-fbd6-4695-a5ac-98b2b1d8a61a req-d9d83242-7395-44cf-92a7-8ffefba4f78d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:28.302787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-19a98051-fbd6-4695-a5ac-98b2b1d8a61a req-d9d83242-7395-44cf-92a7-8ffefba4f78d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:28.323358 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-19a98051-fbd6-4695-a5ac-98b2b1d8a61a req-d9d83242-7395-44cf-92a7-8ffefba4f78d service nova] Creating event network-vif-deleted:2528c2fd-31f5-4bd9-a38c-4dc5a530e3d6 for instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b on n-h1-828148-1 Mar 29 02:49:28.329150 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-19a98051-fbd6-4695-a5ac-98b2b1d8a61a req-d9d83242-7395-44cf-92a7-8ffefba4f78d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049120 Mar 29 02:49:28.331116 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2775/5781] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:49:29.295371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:29.296040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:29.307410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:29.307914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:29.308718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:29.309175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:29.464599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:29.464986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:29.474162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lazy-loading 'fault' on Instance uuid 4aedb383-d1ff-4a40-97c6-8b28f1fa928b {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:49:29.608513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da0f401200204f8ebcfd7faa6919b2fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f031b238b1394bd5b24083b052fcae8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:29.617358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6d636f6-da7c-48d2-b33c-9f0baff64a5c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 200 len: 1384 microversion: 2.1 time: 0.325452 Mar 29 02:49:29.627451 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3007/5782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:29 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 1384 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:30.636534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:30.638146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] [instance: 4aedb383-d1ff-4a40-97c6-8b28f1fa928b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:30.649279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:30.649279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:30.649826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:30.650414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:30.718121 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] HTTP exception thrown: Instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b could not be found. Mar 29 02:49:30.718967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Returning 404 to user: Instance 4aedb383-d1ff-4a40-97c6-8b28f1fa928b could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:49:30.721452 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b9250b4-ff93-49af-b198-ee27cbd0beee tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b" status: 404 len: 111 microversion: 2.1 time: 0.089650 Mar 29 02:49:30.726103 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2776/5783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:30 2022] GET /compute/v2.1/servers/4aedb383-d1ff-4a40-97c6-8b28f1fa928b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:49:39.829657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-be1cd6b5-0e6a-4d8d-be45-909c94aca89c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] Calling method '.version_select at 0x7f8717fc0c10>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:39.951358 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-be1cd6b5-0e6a-4d8d-be45-909c94aca89c tempest-TestSecurityGroupsBasicOps-1546307664 tempest-TestSecurityGroupsBasicOps-1546307664-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1980655370" status: 202 len: 0 microversion: 2.1 time: 0.125646 Mar 29 02:49:39.953021 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3008/5784] 10.222.0.36 () {58 vars in 1277 bytes} [Tue Mar 29 02:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1980655370 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:49:50.732407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1064177527", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "ca9647cd-22ec-46d3-909b-eb36fe453811"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:49:50.987619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] validate_networks() for [('ca9647cd-22ec-46d3-909b-eb36fe453811', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:49:52.230514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:49:52.231305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:49:52.231885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:49:52.232396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:49:52.233101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:49:52.244321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:52.245183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:52.246248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:52.247072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:52.289763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Getting quotas for project 093ed0d8acf3496a89678f408848a4aa. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:49:52.302922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Getting quotas for user 74cb2ee1acd7400aa4636b2ced58687f and project 093ed0d8acf3496a89678f408848a4aa. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:49:52.330989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:49:52.338245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:49:52.475182 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9fade932-4a9b-4d36-8acf-9329db232ffd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.102365 Mar 29 02:49:52.476094 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2777/5785] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:49:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:49:52.484406 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:49:52.489551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03b5c340-0fc3-441d-83f2-811f678bd6f6 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:52.489938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03b5c340-0fc3-441d-83f2-811f678bd6f6 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:52.668212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-03b5c340-0fc3-441d-83f2-811f678bd6f6 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:52.678983 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03b5c340-0fc3-441d-83f2-811f678bd6f6 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1215 microversion: 2.1 time: 0.193868 Mar 29 02:49:52.682131 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3009/5786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:52 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:53.696177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e3291ea3-cd9a-4cb1-bb84-a3fd9cc610a1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:53.697614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e3291ea3-cd9a-4cb1-bb84-a3fd9cc610a1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:53.873374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e3291ea3-cd9a-4cb1-bb84-a3fd9cc610a1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:53.895887 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e3291ea3-cd9a-4cb1-bb84-a3fd9cc610a1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1215 microversion: 2.1 time: 0.203563 Mar 29 02:49:53.896751 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2778/5787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:53 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1215 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:54.913143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:54.913842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:54.933153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:54.933698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:54.934567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:54.935070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:55.006866 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47100. Mar 29 02:49:55.209883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:55.223780 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eabd321f-1026-47f8-9989-78f3f5156f17 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1211 microversion: 2.1 time: 0.314686 Mar 29 02:49:55.224557 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3010/5788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:54 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1211 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:56.247567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:56.252612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:56.281425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:56.282270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:56.283520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:56.285434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:56.523451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:56.541988 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a6b9b7fd-3c58-4818-910b-2c1155c3cf52 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1275 microversion: 2.1 time: 0.299845 Mar 29 02:49:56.543067 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2779/5789] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:56 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1275 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:57.559759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:57.560531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:57.569213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:57.570268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:57.571427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:57.572088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:57.764860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:49:57.774833 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-335477ff-64e3-4d00-a9ce-f87c0fcd8cb2 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1273 microversion: 2.1 time: 0.219134 Mar 29 02:49:57.787091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3011/5790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:57 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:49:58.805415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:49:58.806091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:49:58.841949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:58.842398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:49:58.843177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:49:58.857764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:00.157152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:00.167819 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f5f469d4-430c-411e-aee1-9edd7bb3abbf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 1.367909 Mar 29 02:50:00.170601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2780/5791] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:49:58 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:01.194588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:01.194588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:01.223360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:01.223360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:01.223360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:01.223360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:01.680136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:01.691521 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b4afa80-c123-4247-9ee2-6c34bff6d1f8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.510225 Mar 29 02:50:01.692684 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3012/5792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:01 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:02.075205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f48ddfce-8ec9-4121-8b99-76168eb7c830 req-f79407df-1f4c-4aa2-9075-7d0e16d2d19d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba7ed738-3c95-4825-b022-2281412ff222", "tag": "6ffe0f88-7662-45a4-877e-90010ccbed2d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:02.077639 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:02.077639 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:50:02.094111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f48ddfce-8ec9-4121-8b99-76168eb7c830 req-f79407df-1f4c-4aa2-9075-7d0e16d2d19d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:02.095319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f48ddfce-8ec9-4121-8b99-76168eb7c830 req-f79407df-1f4c-4aa2-9075-7d0e16d2d19d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:02.146424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f48ddfce-8ec9-4121-8b99-76168eb7c830 req-f79407df-1f4c-4aa2-9075-7d0e16d2d19d service nova] Creating event network-changed:6ffe0f88-7662-45a4-877e-90010ccbed2d for instance ba7ed738-3c95-4825-b022-2281412ff222 on n-h1-828148-1 Mar 29 02:50:02.156523 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f48ddfce-8ec9-4121-8b99-76168eb7c830 req-f79407df-1f4c-4aa2-9075-7d0e16d2d19d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.412230 Mar 29 02:50:02.159175 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2781/5793] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:50:02.711248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:02.711855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:02.837821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:02.837821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:02.837821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:02.845116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:03.450330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:03.460575 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18e9307b-8c9e-4124-b834-49d97f086908 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.755600 Mar 29 02:50:03.477239 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3013/5794] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:02 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:04.491453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:04.491453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:04.504543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:04.505022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:04.505818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:04.506255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:05.204826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:05.223072 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-824e182d-463b-4d2e-9d00-13b17684a5ca tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.740621 Mar 29 02:50:05.225593 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2782/5795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:04 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:06.245187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:06.245819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:06.264743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:06.265233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:06.266028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:06.266610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:07.306552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:07.317779 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49202bff-6d8f-40d0-9e68-d9d8a83fc03d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 1.079164 Mar 29 02:50:07.319376 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3014/5796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:06 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:08.337370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:08.340830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:08.346788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:08.347870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:08.350043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:08.350043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:09.085163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:09.099332 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19110284-32c9-42f6-a877-71183faa6898 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.760890 Mar 29 02:50:09.099332 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2783/5797] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:08 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:10.118826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:10.118826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:10.126238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:10.128063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:10.128063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:10.128063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:10.703499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:10.714731 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-66d5957c-aeec-4aae-b644-c3a161250371 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.606735 Mar 29 02:50:10.715307 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3015/5798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:10 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:11.735983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:11.735983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:11.749847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:11.749847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:11.756710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:11.756710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:12.413340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:12.426906 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d687e67b-0e8b-410c-8164-2c170af1f832 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.699880 Mar 29 02:50:12.436319 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2784/5799] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:11 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:13.450589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:13.451363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:13.462510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:13.464226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:13.465635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:13.466201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:14.155077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:14.165619 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3b79bf7-1b68-41c5-9299-7bfb6fd22e22 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.725284 Mar 29 02:50:14.166199 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3016/5800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:13 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:14.298146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cf780dae-240b-4ec6-9efa-7d32cf427ca2 req-346cfb76-8c34-4c3d-b18b-f1c00ed8c27a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7ed738-3c95-4825-b022-2281412ff222", "name": "network-vif-plugged", "status": "completed", "tag": "6ffe0f88-7662-45a4-877e-90010ccbed2d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:14.300384 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:14.300384 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:50:14.316684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf780dae-240b-4ec6-9efa-7d32cf427ca2 req-346cfb76-8c34-4c3d-b18b-f1c00ed8c27a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:14.322300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cf780dae-240b-4ec6-9efa-7d32cf427ca2 req-346cfb76-8c34-4c3d-b18b-f1c00ed8c27a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:14.349219 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cf780dae-240b-4ec6-9efa-7d32cf427ca2 req-346cfb76-8c34-4c3d-b18b-f1c00ed8c27a service nova] Creating event network-vif-plugged:6ffe0f88-7662-45a4-877e-90010ccbed2d for instance ba7ed738-3c95-4825-b022-2281412ff222 on n-h1-828148-1 Mar 29 02:50:14.354944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cf780dae-240b-4ec6-9efa-7d32cf427ca2 req-346cfb76-8c34-4c3d-b18b-f1c00ed8c27a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.393741 Mar 29 02:50:14.354944 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2785/5801] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:50:15.189738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:15.190919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:15.205450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:15.205961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:15.206880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:15.207465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:15.953132 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:15.967996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c98d459d-7b09-4bd4-bea4-975e6000b248 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1315 microversion: 2.1 time: 0.785053 Mar 29 02:50:15.968611 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3017/5802] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:15 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:16.986605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:16.987909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:17.003923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:17.004430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:17.017150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:17.019595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:17.837689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:17.845857 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d64d6cfc-67fe-4b80-b2e4-08c924f606be tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1502 microversion: 2.1 time: 0.863499 Mar 29 02:50:17.869973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2786/5803] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:16 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1502 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:17.876737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:17.878611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:17.887906 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:17.893951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:17.893951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:17.893951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:18.456747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:18.458655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Action: 'create', calling method: .version_select at 0x7f872405d820>, body: {"keypair": {"name": "tempest-TestServerBasicOps-591750293"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:18.468483 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ded7e697-ff17-4e93-be87-e05fb2c4f5cd tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1502 microversion: 2.1 time: 0.595737 Mar 29 02:50:18.469630 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3018/5804] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:17 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1502 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:18.494609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:18.497688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:18.503520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:18.504247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:18.504966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:50:18.505400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:18.506145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:18.511444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for user 18a974be3f874158966c47cf94d62bf6 and project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:50:18.581533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lazy-loading 'flavor' on Instance uuid ba7ed738-3c95-4825-b022-2281412ff222 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:50:19.021057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:50:19.021057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for user 18a974be3f874158966c47cf94d62bf6 and project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:50:19.072798 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-265b403e-8554-46b6-8773-fb2ac855d506 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.814258 Mar 29 02:50:19.079926 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2787/5805] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 02:50:18 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:19.114478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4901100c-2e07-4608-9284-9ce7be9818c8 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action" status: 202 len: 0 microversion: 2.1 time: 0.613916 Mar 29 02:50:19.114478 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3019/5806] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:50:18 2022] POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 02:50:19.120396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:19.120396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:19.139274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:19.139274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:19.144079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:19.148202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:19.594385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:19.614728 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f4759ad-f9f6-4664-9789-beb89828eb25 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1510 microversion: 2.1 time: 0.497722 Mar 29 02:50:19.614728 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2788/5807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:19 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:20.623372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:20.624733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:20.638302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:20.640273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:20.644313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:20.645109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:21.259761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:21.271718 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-41487f71-f31f-488d-ad1a-9a814d9bbc5d tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1493 microversion: 2.1 time: 0.650844 Mar 29 02:50:21.271718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3020/5808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:20 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1493 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:21.288435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:21.289105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:21.297712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:21.300158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:21.300158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:21.301414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:21.809675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fcdce347-bf14-4151-a1c8-885aa2ad0295 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action" status: 202 len: 0 microversion: 2.1 time: 0.525330 Mar 29 02:50:21.812155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2789/5809] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:50:21 2022] POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:50:21.822842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:21.823508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:21.840148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:21.840609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:21.841536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:21.844281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:22.485280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:22.499029 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-788cb620-36bf-4900-80f2-19163e188dcf tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1499 microversion: 2.1 time: 0.681692 Mar 29 02:50:22.504686 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3021/5810] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:21 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1499 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:23.564012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:24.962636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:24.980741 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-310fab68-5d64-4928-9e65-99e11e5322e0 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1499 microversion: 2.1 time: 1.461834 Mar 29 02:50:24.991431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2790/5811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:23 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1499 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:25.272295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1534599178", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-591750293", "security_groups": [{"name": "tempest-secgroup-smoke-1517163341"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "27ee8354-ce4c-4b2d-8133-b2909f713520"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:25.676867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] validate_networks() for [('27ee8354-ce4c-4b2d-8133-b2909f713520', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:50:25.998505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:25.999933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:26.010202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:26.010900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:26.011877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:26.012509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:26.558787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:26.589299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0234472a-5735-4d2e-b1da-2df1f4e692c4 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1499 microversion: 2.1 time: 0.574758 Mar 29 02:50:26.603383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2791/5812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:25 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1499 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:27.126519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:50:27.142247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for user 18a974be3f874158966c47cf94d62bf6 and project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: dict_keys(['metadata_items']) {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:50:27.206959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:50:27.209760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:50:27.210878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:50:27.214495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:50:27.215147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:50:27.247449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:27.248283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:27.249335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:27.249770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:27.296986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:50:27.303907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Getting quotas for user 18a974be3f874158966c47cf94d62bf6 and project 2dcb55987f3846a3b8d49a9f4cb58d77. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:50:27.318642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:50:27.321833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:50:27.476752 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a84724a-1919-493b-979d-3feb24e31c34 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.216246 Mar 29 02:50:27.478513 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3022/5813] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:50:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:50:27.488992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb8af358-44fb-4c91-ba2c-7bd03c53069c tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:27.489701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb8af358-44fb-4c91-ba2c-7bd03c53069c tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:27.610990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:27.610990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:27.644748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:27.644748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:27.644748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:27.644748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:27.889327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb8af358-44fb-4c91-ba2c-7bd03c53069c tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:27.897990 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb8af358-44fb-4c91-ba2c-7bd03c53069c tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1302 microversion: 2.1 time: 0.412956 Mar 29 02:50:27.905855 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2792/5814] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:27 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1302 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:28.363998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:28.372732 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4d200d6-25dc-41ea-b33d-ef4d4ddbb229 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1502 microversion: 2.1 time: 0.766148 Mar 29 02:50:28.383709 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3023/5815] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:27 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1502 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:28.391021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:28.392167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:28.409183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:28.411275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:28.412119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:28.412566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:28.517231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lazy-loading 'flavor' on Instance uuid ba7ed738-3c95-4825-b022-2281412ff222 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:50:28.923598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3cb6b4db-b3d4-4594-8a22-f4df0e3e3d14 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:28.923598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3cb6b4db-b3d4-4594-8a22-f4df0e3e3d14 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:29.050350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3cb6b4db-b3d4-4594-8a22-f4df0e3e3d14 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:29.058069 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3cb6b4db-b3d4-4594-8a22-f4df0e3e3d14 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1302 microversion: 2.1 time: 0.139898 Mar 29 02:50:29.068355 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3024/5816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:28 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1302 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:29.312368 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e88b90c0-a784-4c8a-b247-f0eca0543656 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action" status: 202 len: 0 microversion: 2.1 time: 0.920205 Mar 29 02:50:29.312368 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2793/5817] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:50:28 2022] POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:50:29.325290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:29.325290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:29.348278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:29.348278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:29.348278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:29.348278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:29.741187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:29.754001 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f30a8db-ff88-4ec8-b41e-2c809d421d16 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1510 microversion: 2.1 time: 0.442051 Mar 29 02:50:29.756662 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3025/5818] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:29 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1510 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:30.075109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:30.079353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:30.083942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:30.084383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:30.085173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:30.085602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:30.413436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:30.422509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-644a4eb6-8df0-475c-acb7-8e33442b6dc6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1306 microversion: 2.1 time: 0.346937 Mar 29 02:50:30.442485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2794/5819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:30 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1306 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:30.773035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:30.773635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:30.788811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:30.789293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:30.790155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:30.790593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.090059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:31.099486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-618f0963-0a81-449c-bad4-92ee30608c05 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1493 microversion: 2.1 time: 0.326946 Mar 29 02:50:31.099486 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3026/5820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:30 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1493 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:31.134362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:31.134362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:31.140998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.140998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.140998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.140998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.419591 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-886fd014-a7ee-486d-b18e-91928cf8fd99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action" status: 202 len: 0 microversion: 2.1 time: 0.303799 Mar 29 02:50:31.419591 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2795/5821] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:50:31 2022] POST /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:50:31.426349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:31.426349 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:31.442833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.442833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.442833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.442833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.454216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:31.454216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:31.459912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.459912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.459912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:31.459912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:31.640796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:31.652485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6768cf7c-810b-4124-965a-d6ac93999252 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1362 microversion: 2.1 time: 0.220218 Mar 29 02:50:31.656210 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2796/5822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:31 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:32.000726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:32.005830 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c3a01fe-1a9f-40ce-b80f-cb80195832ba tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1499 microversion: 2.1 time: 0.586253 Mar 29 02:50:32.008139 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3027/5823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:31 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1499 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:32.679180 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:50:32.679180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:32.679180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:32.695036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:32.695036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:32.695036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:32.695036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:32.978746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:32.983744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c669df50-249c-44a8-8811-2a1e67b8b532 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1360 microversion: 2.1 time: 0.312650 Mar 29 02:50:32.983744 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2797/5824] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:32 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1360 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:33.031936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:33.031936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:33.043293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:33.043293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:33.047886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:33.047886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:33.645856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:33.667157 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a5fafe4-fd5e-4026-9965-a4139fb4b1fb tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1499 microversion: 2.1 time: 0.638623 Mar 29 02:50:33.667817 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3028/5825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:33 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:34.000971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:34.003649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:34.012521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:34.013000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:34.013834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:34.014275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:34.084407 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 47698. Mar 29 02:50:34.287451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:34.309396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-96a49e43-344a-4d1c-9f00-62632c45e2fb tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.309567 Mar 29 02:50:34.331126 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2798/5826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:33 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:34.685545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:34.686156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:34.704977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:34.705133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:34.706004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:34.706439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.255411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:35.272644 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7b83a346-87e5-4c91-85df-6c2488f58bee tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1502 microversion: 2.1 time: 0.583741 Mar 29 02:50:35.272644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3029/5827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:34 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1502 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:35.291222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:35.291222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:35.304866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.304866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.311845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.311845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.335917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:35.335917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:35.357378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.357378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.357378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.357378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.442088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:50:35.873320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:35.877535 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18f96f8c-8a08-49db-8423-3af0476512a3 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.551656 Mar 29 02:50:35.891514 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3030/5828] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:35 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:35.893607 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6cef5ea8-bf89-42cc-8fc0-80ae9ebeac99 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 204 len: 0 microversion: 2.1 time: 0.606367 Mar 29 02:50:35.893607 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2799/5829] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:50:35 2022] DELETE /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:50:35.899967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:35.899967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:35.927749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.927749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:35.927749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:35.927749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:36.152756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1fcf62f3-df14-4514-8b33-927d334fe32c req-1d7c0033-885f-45d7-b932-3982051c06cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51e6a96-6a83-4d7d-920e-f6bcced86928", "tag": "ca178d3c-e31b-427e-9c82-054010b68ef8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:36.152756 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:36.152756 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:50:36.166398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1fcf62f3-df14-4514-8b33-927d334fe32c req-1d7c0033-885f-45d7-b932-3982051c06cd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:36.166909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1fcf62f3-df14-4514-8b33-927d334fe32c req-1d7c0033-885f-45d7-b932-3982051c06cd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:36.186606 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1fcf62f3-df14-4514-8b33-927d334fe32c req-1d7c0033-885f-45d7-b932-3982051c06cd service nova] Creating event network-changed:ca178d3c-e31b-427e-9c82-054010b68ef8 for instance f51e6a96-6a83-4d7d-920e-f6bcced86928 on n-h2-828148-1 Mar 29 02:50:36.194705 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1fcf62f3-df14-4514-8b33-927d334fe32c req-1d7c0033-885f-45d7-b932-3982051c06cd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313337 Mar 29 02:50:36.195764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3031/5830] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:50:36.241852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:36.255458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c8ec04f-5149-4cc8-8d23-3070d2f2cf2a tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1508 microversion: 2.1 time: 0.358257 Mar 29 02:50:36.255458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2800/5831] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:35 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:36.897119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:36.898568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:36.910644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:36.915841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:36.915841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:36.915841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:37.268426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:37.269266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:37.279330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:37.279999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:37.281050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:37.281685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:37.575271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:37.584371 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38278b81-4c80-42e5-877d-3bf697a6ea84 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.691828 Mar 29 02:50:37.592875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3032/5832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:36 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:37.952929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:37.963089 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-112262b7-c1b7-4004-bf9a-7514e0693ff9 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1508 microversion: 2.1 time: 0.699262 Mar 29 02:50:37.964883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2801/5833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:37 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:38.808764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:38.988868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:38.989309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:38.999158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:38.999616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:39.000412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:39.000875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:39.115597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:39.125424 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-494a9bc8-bde4-41b0-964f-6b9d36d78114 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.526997 Mar 29 02:50:39.126497 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3033/5834] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:38 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:39.191823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:39.207869 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-93426848-a823-469d-ab29-48aa8dac7564 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1466 microversion: 2.1 time: 0.226209 Mar 29 02:50:39.209004 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2802/5835] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:38 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1466 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:39.274102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-37574feb-96dc-468c-8630-74a063b50410 req-0a4e954a-37bb-4cb3-8e68-64d68cad11b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7ed738-3c95-4825-b022-2281412ff222", "name": "network-vif-deleted", "tag": "6ffe0f88-7662-45a4-877e-90010ccbed2d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:39.274102 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:39.274102 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:50:39.286608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-37574feb-96dc-468c-8630-74a063b50410 req-0a4e954a-37bb-4cb3-8e68-64d68cad11b4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:39.286608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-37574feb-96dc-468c-8630-74a063b50410 req-0a4e954a-37bb-4cb3-8e68-64d68cad11b4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:39.317213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-37574feb-96dc-468c-8630-74a063b50410 req-0a4e954a-37bb-4cb3-8e68-64d68cad11b4 service nova] Creating event network-vif-deleted:6ffe0f88-7662-45a4-877e-90010ccbed2d for instance ba7ed738-3c95-4825-b022-2281412ff222 on n-h1-828148-1 Mar 29 02:50:39.327542 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-37574feb-96dc-468c-8630-74a063b50410 req-0a4e954a-37bb-4cb3-8e68-64d68cad11b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059823 Mar 29 02:50:39.327542 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3034/5836] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:50:40.145059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:40.146368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:40.156546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:40.157396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:40.186332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:40.186332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:40.233524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:40.233524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:40.245389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:40.245389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:40.245389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:40.245389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:40.377724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:40.378213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:40.378620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lazy-loading 'fault' on Instance uuid ba7ed738-3c95-4825-b022-2281412ff222 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:50:40.458937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74cb2ee1acd7400aa4636b2ced58687f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093ed0d8acf3496a89678f408848a4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:40.475225 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8fe11c22-c8f9-4c0a-94f6-5f232e534df1 tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 200 len: 1305 microversion: 2.1 time: 0.253493 Mar 29 02:50:40.486616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3035/5837] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:40 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 1305 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:40.870661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:40.898660 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-850cf467-1060-4533-b306-cb8353da5ec4 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.746515 Mar 29 02:50:40.898660 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2803/5838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:40 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:50:41.501807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:41.501807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] [instance: ba7ed738-3c95-4825-b022-2281412ff222] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:41.509024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:41.509024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:41.509024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:41.509024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:41.575065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] HTTP exception thrown: Instance ba7ed738-3c95-4825-b022-2281412ff222 could not be found. Mar 29 02:50:41.575065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] Returning 404 to user: Instance ba7ed738-3c95-4825-b022-2281412ff222 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:50:41.575065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6f8bd58-ffdb-4be3-b2fc-6c2cb4b4056e tempest-TestServerAdvancedOps-1036625090 tempest-TestServerAdvancedOps-1036625090-project] 10.222.0.36 "GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222" status: 404 len: 111 microversion: 2.1 time: 0.082986 Mar 29 02:50:41.575065 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3036/5839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:41 2022] GET /compute/v2.1/servers/ba7ed738-3c95-4825-b022-2281412ff222 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:50:41.912427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:41.912819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:41.947417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:41.948062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:41.948673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:41.949048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:42.385188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:42.396683 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2f5aa9b-3506-4926-b46d-0486688ae42a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.497067 Mar 29 02:50:42.397983 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2804/5840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:41 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:42.973679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c69ba237-067e-423c-b1c6-5cf3babe75e6 req-2ce4cdaf-80a9-43a1-9167-80101c578d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51e6a96-6a83-4d7d-920e-f6bcced86928", "name": "network-vif-plugged", "status": "completed", "tag": "ca178d3c-e31b-427e-9c82-054010b68ef8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:42.973679 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:42.973679 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:50:42.979755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c69ba237-067e-423c-b1c6-5cf3babe75e6 req-2ce4cdaf-80a9-43a1-9167-80101c578d63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:42.980119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c69ba237-067e-423c-b1c6-5cf3babe75e6 req-2ce4cdaf-80a9-43a1-9167-80101c578d63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:43.011271 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c69ba237-067e-423c-b1c6-5cf3babe75e6 req-2ce4cdaf-80a9-43a1-9167-80101c578d63 service nova] Creating event network-vif-plugged:ca178d3c-e31b-427e-9c82-054010b68ef8 for instance f51e6a96-6a83-4d7d-920e-f6bcced86928 on n-h2-828148-1 Mar 29 02:50:43.027682 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c69ba237-067e-423c-b1c6-5cf3babe75e6 req-2ce4cdaf-80a9-43a1-9167-80101c578d63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060994 Mar 29 02:50:43.029261 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3037/5841] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:50:43.413181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:43.413804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:43.421470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:43.421914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:43.422718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:43.426263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:44.313827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:44.332522 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c25df7e2-276a-403f-8e03-089aa0d6da99 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1428 microversion: 2.1 time: 0.914906 Mar 29 02:50:44.342873 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2805/5842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:43 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1428 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:45.358904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:45.358904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:45.372167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:45.372167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:45.372167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:45.372167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:45.836576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:45.853266 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f5c49b5-7e04-4c0a-98ef-2659970c48dc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1607 microversion: 2.1 time: 0.507773 Mar 29 02:50:45.853266 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3038/5843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:45 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1607 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:45.897294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:46.460052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:46.480554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7736bd1-5ecc-48df-8c14-1fa1988faf7a tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1607 microversion: 2.1 time: 0.605058 Mar 29 02:50:46.480554 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2806/5844] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:45 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1607 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:46.489268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:50:46.489268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:50:46.498896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:46.498896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:46.498896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:46.498896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:46.908454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:50:46.920742 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78d214f5-0798-440a-bb73-24733f7b5e62 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1607 microversion: 2.1 time: 0.433452 Mar 29 02:50:46.920742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3039/5845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:50:46 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1607 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:50:52.617113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-57aef88b-ed08-4200-a0fc-ac58e4fa41d9 req-9af3a3cf-183b-4242-b42d-2b4efe730b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51e6a96-6a83-4d7d-920e-f6bcced86928", "tag": "ca178d3c-e31b-427e-9c82-054010b68ef8"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:50:52.622672 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:50:52.622672 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:50:52.636910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57aef88b-ed08-4200-a0fc-ac58e4fa41d9 req-9af3a3cf-183b-4242-b42d-2b4efe730b65 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:50:52.642331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57aef88b-ed08-4200-a0fc-ac58e4fa41d9 req-9af3a3cf-183b-4242-b42d-2b4efe730b65 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:50:52.663326 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-57aef88b-ed08-4200-a0fc-ac58e4fa41d9 req-9af3a3cf-183b-4242-b42d-2b4efe730b65 service nova] Creating event network-changed:ca178d3c-e31b-427e-9c82-054010b68ef8 for instance f51e6a96-6a83-4d7d-920e-f6bcced86928 on n-h2-828148-1 Mar 29 02:50:52.680801 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-57aef88b-ed08-4200-a0fc-ac58e4fa41d9 req-9af3a3cf-183b-4242-b42d-2b4efe730b65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067459 Mar 29 02:50:52.681920 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2807/5846] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:51:21.283217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:51:21.283818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:51:21.291551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:51:21.292079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:51:21.292941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:51:21.293379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:51:21.353089 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e501e85-087f-4a85-89da-4900b4b35f1d tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.074220 Mar 29 02:51:21.353839 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3040/5847] 10.222.0.36 () {58 vars in 1292 bytes} [Tue Mar 29 02:51:21 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928/os-server-password => generated 116 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:52:06.525313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-51646868", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a9593541-b85c-41f5-bf1f-442e54f15031"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:52:06.544938 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 02:52:06.606115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] validate_networks() for [('a9593541-b85c-41f5-bf1f-442e54f15031', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:52:07.136211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:52:07.136643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:52:07.137149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:52:07.137570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:52:07.138003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:52:07.147838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:07.153602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:07.154509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:07.154954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:07.172769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Getting quotas for project c1adb215bea3413dbb69d3f5ec7b8892. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:52:07.178057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Getting quotas for user 00f82e703ca04e81a904f46e5e0a038d and project c1adb215bea3413dbb69d3f5ec7b8892. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:52:07.190487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:52:07.192906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:52:07.290327 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0e04aea-7667-4e10-9fb8-cf6edfa6863b tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769736 Mar 29 02:52:07.291021 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2808/5848] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:52:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:52:07.301251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bdd552cf-59ce-4731-8f5a-b5dc3c972edd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:07.301884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bdd552cf-59ce-4731-8f5a-b5dc3c972edd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:07.307466 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:52:07.379731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bdd552cf-59ce-4731-8f5a-b5dc3c972edd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:07.388195 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bdd552cf-59ce-4731-8f5a-b5dc3c972edd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1217 microversion: 2.1 time: 0.090604 Mar 29 02:52:07.389465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3041/5849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:07 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:08.405671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:08.406492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:08.415340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:08.415869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:08.416855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:08.417295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:08.468807 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50840. Mar 29 02:52:08.546200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:08.555999 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e282e9f8-412c-4c0c-a806-260ee1ce1317 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1221 microversion: 2.1 time: 0.155125 Mar 29 02:52:08.556785 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2809/5850] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:08 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:09.662063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:09.662063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:09.670441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:09.671322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:09.672294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:09.673776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:09.735755 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 50856. Mar 29 02:52:09.793677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:09.801681 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8bc44b05-aedb-4624-b114-fbde79711ae8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1213 microversion: 2.1 time: 0.144864 Mar 29 02:52:09.802230 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3042/5851] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:09 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:10.818855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:10.819744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:10.827727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:10.828279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:10.829200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:10.829873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:10.995846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:11.007268 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cdf17e51-5a28-43d4-b511-3661d68dc9bd tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1275 microversion: 2.1 time: 0.191948 Mar 29 02:52:11.013097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2810/5852] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:10 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:12.024731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:12.026223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:12.044781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:12.051133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:12.054670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:12.056335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:12.391707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:12.401300 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0125df69-a303-4ecd-909d-852f323c0525 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.380600 Mar 29 02:52:12.401884 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3043/5853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:12 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:12.746690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a77a89fe-2e64-4c23-bc30-1934251cfb65 req-0059e238-c07f-4032-bfa0-b00f723a54a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ce3000-0ac8-47fe-b17f-f83995998fda", "tag": "ee8986d4-c770-4378-aa71-4036cc01589c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:52:12.748938 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:52:12.748938 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:52:12.758177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a77a89fe-2e64-4c23-bc30-1934251cfb65 req-0059e238-c07f-4032-bfa0-b00f723a54a9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:12.758786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a77a89fe-2e64-4c23-bc30-1934251cfb65 req-0059e238-c07f-4032-bfa0-b00f723a54a9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:12.775030 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a77a89fe-2e64-4c23-bc30-1934251cfb65 req-0059e238-c07f-4032-bfa0-b00f723a54a9 service nova] Creating event network-changed:ee8986d4-c770-4378-aa71-4036cc01589c for instance 03ce3000-0ac8-47fe-b17f-f83995998fda on n-h1-828148-1 Mar 29 02:52:12.779727 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a77a89fe-2e64-4c23-bc30-1934251cfb65 req-0059e238-c07f-4032-bfa0-b00f723a54a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036608 Mar 29 02:52:12.780702 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2811/5854] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:52:13.417643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:13.418398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:13.426101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:13.426560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:13.427399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:13.427923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:13.636585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:13.647238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0681f129-e3ec-48c5-ae89-8d1960e8d611 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.233183 Mar 29 02:52:13.660987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3044/5855] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:13 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:14.664438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:14.665357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:14.673684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:14.674126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:14.674905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:14.675345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:14.980451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:14.988863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ac2891c1-2040-4c68-9a35-bc66bef44a4f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.328853 Mar 29 02:52:14.995238 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2812/5856] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:14 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:16.006444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:16.007142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:16.015224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:16.015964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:16.016803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:16.017380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:16.313482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:16.322039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c484d2ce-9296-4c21-9ea7-2676a7d6b5f1 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.319938 Mar 29 02:52:16.322617 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3045/5857] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:16 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:17.338996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:17.339617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:17.347742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:17.348544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:17.349057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:17.349486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:17.587489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:17.599876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06f0100a-c2da-4a1d-a4bc-55ca4fedeef9 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.260274 Mar 29 02:52:17.599876 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2813/5858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:17 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:18.625202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:18.625202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:18.635654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:18.635654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:18.635654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:18.635654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:18.839286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:18.848297 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e617f44f-3ec5-490f-8915-d1680b03ed06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.237288 Mar 29 02:52:18.848897 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3046/5859] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:18 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:19.865067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:19.865781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:19.873251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:19.873615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:19.874397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:19.874824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:20.080876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:20.089997 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-924a9264-55cd-4133-8a70-1663b1f2060e tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.228553 Mar 29 02:52:20.090558 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2814/5860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:19 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:20.171747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5e0dabc4-9583-488a-aa7d-96a8d8b3abaa req-e7d88481-3080-496f-b234-53ac8758c691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ce3000-0ac8-47fe-b17f-f83995998fda", "name": "network-vif-plugged", "status": "completed", "tag": "ee8986d4-c770-4378-aa71-4036cc01589c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:52:20.171747 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:52:20.171747 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:52:20.182694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5e0dabc4-9583-488a-aa7d-96a8d8b3abaa req-e7d88481-3080-496f-b234-53ac8758c691 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:20.182694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5e0dabc4-9583-488a-aa7d-96a8d8b3abaa req-e7d88481-3080-496f-b234-53ac8758c691 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:20.206490 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5e0dabc4-9583-488a-aa7d-96a8d8b3abaa req-e7d88481-3080-496f-b234-53ac8758c691 service nova] Creating event network-vif-plugged:ee8986d4-c770-4378-aa71-4036cc01589c for instance 03ce3000-0ac8-47fe-b17f-f83995998fda on n-h1-828148-1 Mar 29 02:52:20.214834 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5e0dabc4-9583-488a-aa7d-96a8d8b3abaa req-e7d88481-3080-496f-b234-53ac8758c691 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051696 Mar 29 02:52:20.214834 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3047/5861] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:52:21.117034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:21.117034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:21.118518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:21.118926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:21.119767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:21.120215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:21.379718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:21.388276 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84ef937f-f4d0-4492-a899-507bf6e2f6c3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1317 microversion: 2.1 time: 0.284164 Mar 29 02:52:21.388861 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2815/5862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:21 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:22.413370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:52:22.413370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:22.444797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:22.444797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:22.444797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:22.444797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:22.841915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:52:22.851813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-76227c27-29e9-49a4-a125-e88d7a08c943 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1506 microversion: 2.1 time: 0.449826 Mar 29 02:52:22.853043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3048/5863] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:52:22 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:52:58.014950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05a1ff81-0241-4465-ae79-f790acfcdfe8", "device": "/dev/sdb"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:52:58.016043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:52:58.023901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:58.024348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:58.025148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:52:58.025582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:52:58.879576 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-91cbc1fa-e046-4bb7-8fe5-9b2828db795f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "POST /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867814 Mar 29 02:52:58.885152 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2816/5864] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:52:58 2022] POST /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:53:09.683609 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:53:09.684113 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:53:12.157338 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:53:12.157794 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:53:23.007927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:23.008440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:23.011733 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:53:23.025603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:23.026220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:23.029053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:23.029530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:23.208737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lazy-loading 'services' on Instance uuid 03ce3000-0ac8-47fe-b17f-f83995998fda {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:53:23.492700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2efbe4bf-9334-4253-9a35-b2813aabc50f tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda/os-volume_attachments/05a1ff81-0241-4465-ae79-f790acfcdfe8" status: 202 len: 0 microversion: 2.1 time: 0.490439 Mar 29 02:53:23.493249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3049/5865] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:53:22 2022] DELETE /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda/os-volume_attachments/05a1ff81-0241-4465-ae79-f790acfcdfe8 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:53:25.836862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:25.837726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:25.849465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:25.849916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:25.850686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:25.851120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:25.916093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:53:26.979317 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e982874c-3b7d-404b-a491-b3178ce18afa tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "DELETE /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 204 len: 0 microversion: 2.1 time: 1.146861 Mar 29 02:53:26.983288 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2817/5866] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:53:25 2022] DELETE /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 0 bytes in 1149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:53:26.990323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:26.991312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:27.004486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:27.004486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:27.004486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:27.004486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:27.010962 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 52616. Mar 29 02:53:27.231940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:27.241050 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a0febe2-f7b3-4133-a445-3398710980b6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1512 microversion: 2.1 time: 0.256312 Mar 29 02:53:27.248689 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3050/5867] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:26 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:53:28.260244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:28.261008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:28.269530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:28.270238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:28.271160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:28.271737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:28.485000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:28.493821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09a0b026-4e8b-4c47-965d-bdf92a09907c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1512 microversion: 2.1 time: 0.238194 Mar 29 02:53:28.497667 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2818/5868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:28 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:29.510728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:29.511575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:29.520460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:29.520921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:29.521929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:29.522430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:29.723120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:29.732101 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ed96abd-e887-41fb-b499-b4cb69c9efee tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1470 microversion: 2.1 time: 0.225533 Mar 29 02:53:29.743558 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3051/5869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:29 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1470 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:29.787845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-76a936a5-ed85-4586-baff-b796e5777514 req-3b2b003d-765b-47cb-956e-b902e66f51a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ce3000-0ac8-47fe-b17f-f83995998fda", "name": "network-vif-deleted", "tag": "ee8986d4-c770-4378-aa71-4036cc01589c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:53:29.790275 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:53:29.790275 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:53:29.799088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-76a936a5-ed85-4586-baff-b796e5777514 req-3b2b003d-765b-47cb-956e-b902e66f51a0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:29.799529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-76a936a5-ed85-4586-baff-b796e5777514 req-3b2b003d-765b-47cb-956e-b902e66f51a0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:29.815832 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-76a936a5-ed85-4586-baff-b796e5777514 req-3b2b003d-765b-47cb-956e-b902e66f51a0 service nova] Creating event network-vif-deleted:ee8986d4-c770-4378-aa71-4036cc01589c for instance 03ce3000-0ac8-47fe-b17f-f83995998fda on n-h1-828148-1 Mar 29 02:53:29.820925 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-76a936a5-ed85-4586-baff-b796e5777514 req-3b2b003d-765b-47cb-956e-b902e66f51a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038389 Mar 29 02:53:29.821516 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2819/5870] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:53:30.748787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:30.749429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:30.757955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:30.758515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:30.759946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:30.759946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:30.834924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:30.835368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:30.835820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lazy-loading 'fault' on Instance uuid 03ce3000-0ac8-47fe-b17f-f83995998fda {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:53:30.895827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:30.904173 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1ef8bc7-ef64-4a26-8c38-bb236050aed3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 200 len: 1307 microversion: 2.1 time: 0.159038 Mar 29 02:53:30.904732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3052/5871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:30 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:31.923313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:31.924063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: 03ce3000-0ac8-47fe-b17f-f83995998fda] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:31.931764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:31.932202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:31.933012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:31.933443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:31.988184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] HTTP exception thrown: Instance 03ce3000-0ac8-47fe-b17f-f83995998fda could not be found. Mar 29 02:53:31.988782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Returning 404 to user: Instance 03ce3000-0ac8-47fe-b17f-f83995998fda could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:53:31.989654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b794fcb-33fb-4408-ac8a-f93e2bcb6e1a tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda" status: 404 len: 111 microversion: 2.1 time: 0.071204 Mar 29 02:53:31.990248 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2820/5872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:31 2022] GET /compute/v2.1/servers/03ce3000-0ac8-47fe-b17f-f83995998fda => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:53:40.202855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-525670070", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "a9593541-b85c-41f5-bf1f-442e54f15031"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:53:40.282499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] validate_networks() for [('a9593541-b85c-41f5-bf1f-442e54f15031', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:53:41.056983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:53:41.056983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:53:41.056983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:53:41.056983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:53:41.057338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:53:41.067208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:41.067650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:41.068436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:41.068882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:41.086660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Getting quotas for project c1adb215bea3413dbb69d3f5ec7b8892. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:53:41.091802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Getting quotas for user 00f82e703ca04e81a904f46e5e0a038d and project c1adb215bea3413dbb69d3f5ec7b8892. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:53:41.103395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:53:41.105875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:53:41.259549 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04627886-a8dd-4748-a872-acb878df9f0d tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060475 Mar 29 02:53:41.260985 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3053/5873] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:53:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:53:41.274636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a925544-d777-41eb-9b50-db30c00f9597 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:41.276064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a925544-d777-41eb-9b50-db30c00f9597 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:41.652689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a925544-d777-41eb-9b50-db30c00f9597 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:41.660531 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a925544-d777-41eb-9b50-db30c00f9597 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1218 microversion: 2.1 time: 0.393359 Mar 29 02:53:41.661826 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2821/5874] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:41 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1218 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:42.678185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:42.678884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:42.686821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:42.687508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:42.688277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:42.688702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:42.801603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:42.809693 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ddaa45b-9112-4e18-bbf4-f1654d2cef7c tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1214 microversion: 2.1 time: 0.135478 Mar 29 02:53:42.810249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3054/5875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:42 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:43.829336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:43.830939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:43.847990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:43.850056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:43.853243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:43.854137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:44.019329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:44.027855 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-69626f4d-af89-4207-a1d1-909f47d75ce5 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1288 microversion: 2.1 time: 0.203882 Mar 29 02:53:44.028409 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2822/5876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:43 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1288 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:45.045334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:45.046549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:45.054089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:45.054657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:45.055434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:45.055870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:45.456517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:45.471336 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c8e45803-e589-468c-ba96-9271539c06b0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.430001 Mar 29 02:53:45.480663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3055/5877] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:45 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:45.843474 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-75ff6767-40c1-4b8d-9c67-5a6b2dfb94e9 req-aa43ced1-0fee-48c4-a07e-a42ee10decb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7fe7421-241a-4cf9-a3e1-0fcc52e938a3", "tag": "ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:53:45.846839 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:53:45.846839 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:53:45.857717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-75ff6767-40c1-4b8d-9c67-5a6b2dfb94e9 req-aa43ced1-0fee-48c4-a07e-a42ee10decb6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:45.858398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-75ff6767-40c1-4b8d-9c67-5a6b2dfb94e9 req-aa43ced1-0fee-48c4-a07e-a42ee10decb6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:45.876732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-75ff6767-40c1-4b8d-9c67-5a6b2dfb94e9 req-aa43ced1-0fee-48c4-a07e-a42ee10decb6 service nova] Creating event network-changed:ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1 for instance e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 on n-h1-828148-1 Mar 29 02:53:45.881930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-75ff6767-40c1-4b8d-9c67-5a6b2dfb94e9 req-aa43ced1-0fee-48c4-a07e-a42ee10decb6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044707 Mar 29 02:53:45.882520 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2823/5878] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:53:46.487692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:46.488255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:46.496597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:46.497068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:46.497847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:46.498286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:46.841928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:46.852982 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2aff083-4f31-46ba-a482-a77c55ecb2f6 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.367010 Mar 29 02:53:46.853760 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3056/5879] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:46 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:47.871494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:47.872240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:47.880287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:47.880740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:47.881516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:47.881942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:48.151936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:48.159981 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f8a29114-d018-4013-ab60-3b8bc70dea06 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.292700 Mar 29 02:53:48.160542 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2824/5880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:47 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:49.177925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:49.178544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:49.185982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:49.186428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:49.187195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:49.187700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:49.540638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:49.549167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb836b2a-3fa7-435c-96ff-80e549bca8f0 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.375609 Mar 29 02:53:49.549729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3057/5881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:49 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:50.565113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:50.565724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:50.572811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:50.573292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:50.574083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:50.574520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:50.795588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:50.804184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a441b15-08c5-479a-abe3-a72c759b23c4 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.242718 Mar 29 02:53:50.804962 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2825/5882] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:50 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:51.824777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:51.825419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:51.833066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:51.833515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:51.834456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:51.834890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:52.058942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:52.073042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-64586e06-9398-44a1-aa24-7d482e2fbfc7 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.251774 Mar 29 02:53:52.073633 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3058/5883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:51 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:52.312024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1b4df7b8-a8d8-4e68-84fe-26796b24819f req-a0a6c295-9cf8-47b7-a0aa-8927dfbdcc4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fe7421-241a-4cf9-a3e1-0fcc52e938a3", "name": "network-vif-plugged", "status": "completed", "tag": "ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:53:52.313700 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:53:52.313700 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:53:52.322748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1b4df7b8-a8d8-4e68-84fe-26796b24819f req-a0a6c295-9cf8-47b7-a0aa-8927dfbdcc4c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:52.323370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1b4df7b8-a8d8-4e68-84fe-26796b24819f req-a0a6c295-9cf8-47b7-a0aa-8927dfbdcc4c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:52.349050 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1b4df7b8-a8d8-4e68-84fe-26796b24819f req-a0a6c295-9cf8-47b7-a0aa-8927dfbdcc4c service nova] Creating event network-vif-plugged:ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1 for instance e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 on n-h1-828148-1 Mar 29 02:53:52.361824 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1b4df7b8-a8d8-4e68-84fe-26796b24819f req-a0a6c295-9cf8-47b7-a0aa-8927dfbdcc4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055009 Mar 29 02:53:52.363669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2826/5884] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:53:53.090054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:53.090669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:53.098153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:53.098596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:53.099363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:53.099793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:53.306200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:53.315878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49376ea0-6e5e-435f-beac-d1ea059aa402 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1318 microversion: 2.1 time: 0.229483 Mar 29 02:53:53.316455 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3059/5885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:53 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:54.334331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:53:54.335000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:54.342533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:54.342972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:54.344372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:54.344801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:54.546484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:53:54.554928 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-14d21c00-bbb3-401a-9c79-86277cf337a3 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1506 microversion: 2.1 time: 0.225197 Mar 29 02:53:54.555487 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2827/5886] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:53:54 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:53:54.572206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63656812-fd56-43a7-8dd8-b044b604f002", "device": "/dev/sdb"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:53:54.573408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:53:54.581843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:54.582635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:54.587081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:53:54.587081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:53:55.511138 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3e5681f2-45b7-427a-bb1c-2589fc7f2543 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "POST /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.942262 Mar 29 02:53:55.512029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3060/5887] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 02:53:54 2022] POST /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3/os-volume_attachments => generated 194 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:54:16.701524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:16.702073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:16.709714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:16.710161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:16.710926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:16.711356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:16.866058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lazy-loading 'services' on Instance uuid e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:54:17.170832 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adfef951-bebd-4fc9-8ec3-34fe906f2345 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3/os-volume_attachments/63656812-fd56-43a7-8dd8-b044b604f002" status: 202 len: 0 microversion: 2.1 time: 0.472760 Mar 29 02:54:17.174200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2828/5888] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 02:54:16 2022] DELETE /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3/os-volume_attachments/63656812-fd56-43a7-8dd8-b044b604f002 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:54:18.346870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:18.351171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:18.356312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:18.356755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:18.357533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:18.357960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:18.420645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:54:18.830671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f33b157-57b6-40b4-97d1-8051ad7295c8 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 204 len: 0 microversion: 2.1 time: 0.488055 Mar 29 02:54:18.831427 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3061/5889] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:54:18 2022] DELETE /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:54:18.840799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:18.841549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:18.849960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:18.862426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:18.862426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:18.862426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:19.054700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:54:19.062871 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-577c5308-c342-4ff0-b3df-70588b8c8823 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1512 microversion: 2.1 time: 0.226589 Mar 29 02:54:19.065355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2829/5890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:54:18 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:54:20.082654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:20.083350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:20.090627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:20.091070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:20.091836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:20.092343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:20.291122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:54:20.299501 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bff33ddd-a1e2-4c7b-ab86-b9b0bf4e6bbe tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1512 microversion: 2.1 time: 0.220971 Mar 29 02:54:20.300116 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3062/5891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:54:20 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:54:21.317486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:21.318681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:21.326451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:21.326906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:21.327687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:21.328119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:21.492193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f82e703ca04e81a904f46e5e0a038d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1adb215bea3413dbb69d3f5ec7b8892', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:54:21.502556 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c6ad0a2-8494-437c-8393-f2feb43b1d33 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 200 len: 1470 microversion: 2.1 time: 0.189741 Mar 29 02:54:21.503652 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2830/5892] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:54:21 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:54:21.507516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9551ef49-85c5-459a-b4e6-b4730c5b9ab2 req-866ea1cc-911b-4895-8aa3-f2314b26c421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7fe7421-241a-4cf9-a3e1-0fcc52e938a3", "name": "network-vif-deleted", "tag": "ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:54:21.509552 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:54:21.509552 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:54:21.522666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9551ef49-85c5-459a-b4e6-b4730c5b9ab2 req-866ea1cc-911b-4895-8aa3-f2314b26c421 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:21.523183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9551ef49-85c5-459a-b4e6-b4730c5b9ab2 req-866ea1cc-911b-4895-8aa3-f2314b26c421 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:21.545836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9551ef49-85c5-459a-b4e6-b4730c5b9ab2 req-866ea1cc-911b-4895-8aa3-f2314b26c421 service nova] Creating event network-vif-deleted:ef47b0e0-c686-4402-b8af-4b7dd5a9d6d1 for instance e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 on n-h1-828148-1 Mar 29 02:54:21.552621 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9551ef49-85c5-459a-b4e6-b4730c5b9ab2 req-866ea1cc-911b-4895-8aa3-f2314b26c421 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051836 Mar 29 02:54:21.553383 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3063/5893] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:54:22.519422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:54:22.520037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] [instance: e7fe7421-241a-4cf9-a3e1-0fcc52e938a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:54:22.527433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:22.527885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:22.528645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:54:22.529177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:54:22.582493 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] HTTP exception thrown: Instance e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 could not be found. Mar 29 02:54:22.582954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] Returning 404 to user: Instance e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:54:22.583786 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9ed4b42b-af24-4dcf-ab53-af3edca3f240 tempest-VolumesSnapshotTestJSON-1152079470 tempest-VolumesSnapshotTestJSON-1152079470-project] 10.222.0.36 "GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3" status: 404 len: 111 microversion: 2.1 time: 0.068149 Mar 29 02:54:22.584337 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2831/5894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:54:22 2022] GET /compute/v2.1/servers/e7fe7421-241a-4cf9-a3e1-0fcc52e938a3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:54:49.660429 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:54:49.661061 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:54:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:54:52.022549 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:54:52.023071 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:55:25.028665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:25.029402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:25.037176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:25.037807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:25.038582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:25.039019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:25.110510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:55:25.457315 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fe63d9b-8c12-422a-8cd8-ab7b62e627d6 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 204 len: 0 microversion: 2.1 time: 0.631382 Mar 29 02:55:25.458663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3064/5895] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:55:24 2022] DELETE /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:55:25.466577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:25.467178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:25.471336 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:55:25.477134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:25.477784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:25.478595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:25.479166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:25.703781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:55:25.719174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e92f22e-ad36-46dc-b0f8-7b7dc2088688 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1732 microversion: 2.1 time: 0.256757 Mar 29 02:55:25.726296 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2832/5896] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:25 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:55:26.736498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:26.737239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:26.744812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:26.745284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:26.746049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:26.746649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:27.142450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:55:27.152329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d55d8e3a-7e01-4520-8535-e1da1cde08fc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1732 microversion: 2.1 time: 0.420108 Mar 29 02:55:27.153927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3065/5897] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:26 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1732 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:55:28.172405 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:28.172987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:28.186000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:28.186464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:28.190957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:28.190957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:28.237805 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 53840. Mar 29 02:55:28.339313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:55:28.350459 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-12b2c3cd-538a-4563-925b-a5956703cffc tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1664 microversion: 2.1 time: 0.182709 Mar 29 02:55:28.351249 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2833/5898] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:28 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1664 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:55:28.575878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-60f9b031-a0cd-4128-8521-ee8dc522b5b6 req-a39a6be7-55f5-445f-871c-eadc198aa4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51e6a96-6a83-4d7d-920e-f6bcced86928", "name": "network-vif-deleted", "tag": "ca178d3c-e31b-427e-9c82-054010b68ef8"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:55:28.577595 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:55:28.577595 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:55:28.589464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-60f9b031-a0cd-4128-8521-ee8dc522b5b6 req-a39a6be7-55f5-445f-871c-eadc198aa4af service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:28.590077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-60f9b031-a0cd-4128-8521-ee8dc522b5b6 req-a39a6be7-55f5-445f-871c-eadc198aa4af service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:28.608499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-60f9b031-a0cd-4128-8521-ee8dc522b5b6 req-a39a6be7-55f5-445f-871c-eadc198aa4af service nova] Creating event network-vif-deleted:ca178d3c-e31b-427e-9c82-054010b68ef8 for instance f51e6a96-6a83-4d7d-920e-f6bcced86928 on n-h2-828148-1 Mar 29 02:55:28.613813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-60f9b031-a0cd-4128-8521-ee8dc522b5b6 req-a39a6be7-55f5-445f-871c-eadc198aa4af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041468 Mar 29 02:55:28.614884 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3066/5899] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:55:29.368054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:29.370566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:29.385311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:29.386639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:29.387744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:29.388885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:29.508233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:29.509269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:29.509905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lazy-loading 'fault' on Instance uuid f51e6a96-6a83-4d7d-920e-f6bcced86928 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:55:29.690613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18a974be3f874158966c47cf94d62bf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dcb55987f3846a3b8d49a9f4cb58d77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:55:29.699492 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e5ae2b0-c823-4da0-af12-02772c5fc721 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 200 len: 1388 microversion: 2.1 time: 0.335751 Mar 29 02:55:29.700057 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2834/5900] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:29 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 1388 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:55:30.717584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:30.718257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:30.726896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:30.727467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:30.728254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:30.728692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:30.792062 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] HTTP exception thrown: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. Mar 29 02:55:30.792679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Returning 404 to user: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:55:30.793540 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-390495d4-4150-4836-8034-cee613031ff1 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 404 len: 111 microversion: 2.1 time: 0.080859 Mar 29 02:55:30.794661 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3067/5901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:30 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:55:31.848955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:31.850015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:31.858121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:31.858560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:31.859321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:31.859904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:31.923049 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] HTTP exception thrown: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. Mar 29 02:55:31.923650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Returning 404 to user: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:55:31.924482 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c20fc78-2f22-4b99-be4e-5c337df43bba tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 404 len: 111 microversion: 2.1 time: 0.079245 Mar 29 02:55:31.925188 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2835/5902] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:55:31 2022] DELETE /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:55:31.933934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:31.934649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] [instance: f51e6a96-6a83-4d7d-920e-f6bcced86928] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:55:31.941827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:31.943214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:31.943877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:55:31.944496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:55:32.000655 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] HTTP exception thrown: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. Mar 29 02:55:32.001542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Returning 404 to user: Instance f51e6a96-6a83-4d7d-920e-f6bcced86928 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:55:32.002620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2c7ad97-f21e-4bc3-9f61-3d61c448c789 tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928" status: 404 len: 111 microversion: 2.1 time: 0.072809 Mar 29 02:55:32.003382 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3068/5903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:55:31 2022] GET /compute/v2.1/servers/f51e6a96-6a83-4d7d-920e-f6bcced86928 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:55:32.560634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efbc7b1c-75be-4974-a760-14c371aaaa4f tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] Calling method '.version_select at 0x7f8717f06af0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:55:32.646897 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efbc7b1c-75be-4974-a760-14c371aaaa4f tempest-TestServerBasicOps-1934305041 tempest-TestServerBasicOps-1934305041-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-591750293" status: 202 len: 0 microversion: 2.1 time: 0.090181 Mar 29 02:55:32.648021 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2836/5904] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 02:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-591750293 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 02:56:07.631540 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:07.632453 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-availability-zone:detail failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:07.632453 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:56:07.634045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:07.634563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:07.635441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:07.635957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:07.663479 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3583114d-cb8c-41cb-9b73-9c119208f1cf tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.153840 Mar 29 02:56:07.664175 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3069/5905] 10.222.0.36 () {58 vars in 1184 bytes} [Tue Mar 29 02:56:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:56:07.778940 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 02:56:07.782525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1387831909", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "availability_zone": "nova:n-h1-828148-1", "networks": [{"uuid": "cc1aabf7-9522-4651-9a76-b577a352adf4"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:07.853863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] validate_networks() for [('cc1aabf7-9522-4651-9a76-b577a352adf4', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:56:08.755481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:56:08.755931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:56:08.756449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:56:08.756831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:56:08.757369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:56:08.766469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:08.767272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:08.768067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:08.768494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:08.788632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Getting quotas for project 8545693cc9024659b29340636248b4cd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:56:08.794527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Getting quotas for user 561bcee1c8354273979609d237c49251 and project 8545693cc9024659b29340636248b4cd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:56:08.799994 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54238. Mar 29 02:56:08.811411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:56:08.813907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:56:08.904726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f8c6630b-cccb-485c-baaf-46f31ade7974 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126916 Mar 29 02:56:08.910218 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2837/5906] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:56:08.915016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8eab9f3b-298f-4fdd-b852-021f7b775751 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:08.915807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8eab9f3b-298f-4fdd-b852-021f7b775751 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:08.997188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8eab9f3b-298f-4fdd-b852-021f7b775751 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1329 microversion: 2.1 time: 0.085709 Mar 29 02:56:08.997841 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3070/5907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:08 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:56:10.014844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eac4ff18-b761-4c05-8737-ae51afc26266 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:10.019033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eac4ff18-b761-4c05-8737-ae51afc26266 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:10.090670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eac4ff18-b761-4c05-8737-ae51afc26266 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1329 microversion: 2.1 time: 0.079825 Mar 29 02:56:10.091293 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2838/5908] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:10 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1329 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:11.108104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:11.111692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:11.127846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:11.128850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:11.129910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:11.130504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:11.256169 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-816f4c44-7b7a-4bd8-baef-c99202f2b1b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1346 microversion: 2.1 time: 0.152240 Mar 29 02:56:11.256749 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3071/5909] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:11 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:12.275175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:12.275950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:12.284418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:12.284885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:12.285660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:12.286091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:12.436337 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62d2c0b4-9fa1-484a-a5d2-6a9163edfe08 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1424 microversion: 2.1 time: 0.164890 Mar 29 02:56:12.437257 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2839/5910] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:12 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1424 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:13.453212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:13.453938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:13.461572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:13.462148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:13.462983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:13.463419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:13.663833 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acc33e85-0e01-4693-8fc4-d6c6b28aabd3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.214435 Mar 29 02:56:13.665142 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3072/5911] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:13 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:14.218466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-854afbd2-16f6-449a-a220-cde360ca8e58 req-ccd33c86-c644-44b4-9318-d5706ca2728d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b440386a-e006-4499-9037-a8b2a2a1359d", "tag": "ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:14.220799 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:14.220799 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:56:14.230753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-854afbd2-16f6-449a-a220-cde360ca8e58 req-ccd33c86-c644-44b4-9318-d5706ca2728d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:14.231164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-854afbd2-16f6-449a-a220-cde360ca8e58 req-ccd33c86-c644-44b4-9318-d5706ca2728d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:14.248514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-854afbd2-16f6-449a-a220-cde360ca8e58 req-ccd33c86-c644-44b4-9318-d5706ca2728d service nova] Creating event network-changed:ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71 for instance b440386a-e006-4499-9037-a8b2a2a1359d on n-h1-828148-1 Mar 29 02:56:14.254217 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-854afbd2-16f6-449a-a220-cde360ca8e58 req-ccd33c86-c644-44b4-9318-d5706ca2728d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112072 Mar 29 02:56:14.255648 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2840/5912] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:56:14.681452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:14.682070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:14.689883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:14.690330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:14.691097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:14.691526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:14.886543 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad2fce2e-c5db-4925-842b-66879111d7a4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.208047 Mar 29 02:56:14.887144 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3073/5913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:14 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:15.904342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:15.904988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:15.912414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:15.912881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:15.913634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:15.914062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:16.282473 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd0ced1b-26df-4878-9a6f-a858bc6660c0 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.382581 Mar 29 02:56:16.283030 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2841/5914] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:15 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:17.299311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:17.299872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:17.307254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:17.308185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:17.308975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:17.309406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:17.495845 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb631ed7-b068-4c31-8731-7c4f25d01793 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.199752 Mar 29 02:56:17.496409 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3074/5915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:17 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:18.517416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:18.517949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:18.526327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:18.526770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:18.528158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:18.528646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:18.716207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e55c3ff4-8ca7-4277-9270-a9ca22bb08b9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.207128 Mar 29 02:56:18.716824 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2842/5916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:18 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:19.733550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:19.734183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:19.741806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:19.742246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:19.742998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:19.743420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:19.930989 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c201a491-b9c6-4f5b-ab84-94136357cb8a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.201684 Mar 29 02:56:19.932130 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3075/5917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:19 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:20.947461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:20.948059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:20.955670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:20.956108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:20.956876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:20.957302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:21.148665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-61e67bb4-8a92-4551-84ff-288965e55e42 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.204865 Mar 29 02:56:21.149486 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2843/5918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:20 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:21.189388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-12e332d2-c689-4ed3-9c04-b67267433895 req-959f48b3-d7c0-4188-adcd-65345d13014d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b440386a-e006-4499-9037-a8b2a2a1359d", "name": "network-vif-plugged", "status": "completed", "tag": "ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:21.190847 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:21.190847 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:56:21.199414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-12e332d2-c689-4ed3-9c04-b67267433895 req-959f48b3-d7c0-4188-adcd-65345d13014d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:21.199809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-12e332d2-c689-4ed3-9c04-b67267433895 req-959f48b3-d7c0-4188-adcd-65345d13014d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:21.216320 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-12e332d2-c689-4ed3-9c04-b67267433895 req-959f48b3-d7c0-4188-adcd-65345d13014d service nova] Creating event network-vif-plugged:ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71 for instance b440386a-e006-4499-9037-a8b2a2a1359d on n-h1-828148-1 Mar 29 02:56:21.221221 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-12e332d2-c689-4ed3-9c04-b67267433895 req-959f48b3-d7c0-4188-adcd-65345d13014d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095238 Mar 29 02:56:21.221806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3076/5919] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:56:22.166022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:22.167152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:22.174433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:22.174880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:22.177631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:22.177631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:22.363119 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29dab462-2752-4c0b-bd21-6204edaad93f tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1464 microversion: 2.1 time: 0.200736 Mar 29 02:56:22.363677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2844/5920] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:22 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1464 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:23.379874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:23.380564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:23.387933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.388336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:23.389158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.389603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:23.577893 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eaddd7c2-dd4a-45fb-966c-2003747be9b5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1649 microversion: 2.1 time: 0.202045 Mar 29 02:56:23.578449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3077/5921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:23 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1649 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:23.594066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:23.594715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:23.601896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.602341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:23.603099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.603535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:23.791169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-08d34e48-3acb-4d92-9e7f-1d2fa0367276 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1649 microversion: 2.1 time: 0.200742 Mar 29 02:56:23.791737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2845/5922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:23 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1649 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:23.806489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:23.807119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:23.814357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.814800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:23.815558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:23.815992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:24.101478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a27db40-931f-4a73-b235-aa6ce50388a8 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1649 microversion: 2.1 time: 0.298546 Mar 29 02:56:24.102038 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3078/5923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:23 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1649 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:24.159784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-388303862", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "availability_zone": "nova:n-h2-828148-1", "networks": [{"uuid": "cc1aabf7-9522-4651-9a76-b577a352adf4"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:24.228247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] validate_networks() for [('cc1aabf7-9522-4651-9a76-b577a352adf4', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:56:24.825731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:56:24.826216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:56:24.826612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:56:24.827022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:56:24.827452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:56:24.835959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:24.836400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:24.837225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:24.837657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:24.854565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Getting quotas for project 8545693cc9024659b29340636248b4cd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:56:24.863906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Getting quotas for user 561bcee1c8354273979609d237c49251 and project 8545693cc9024659b29340636248b4cd. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:56:24.881247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:56:24.883637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:56:25.009941 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5340a807-6eaa-462f-af98-ec1b83f4ddde tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853751 Mar 29 02:56:25.011127 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2846/5924] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:56:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:56:25.020961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b669a62c-8601-497c-b186-8fe74f88fa9d tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:25.021508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b669a62c-8601-497c-b186-8fe74f88fa9d tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:25.093979 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b669a62c-8601-497c-b186-8fe74f88fa9d tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1328 microversion: 2.1 time: 0.076618 Mar 29 02:56:25.094545 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3079/5925] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:25 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1328 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:26.109808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3a49a662-faf2-46af-b419-f6e6b4e416f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:26.110411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3a49a662-faf2-46af-b419-f6e6b4e416f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:26.187786 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3a49a662-faf2-46af-b419-f6e6b4e416f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1328 microversion: 2.1 time: 0.081507 Mar 29 02:56:26.188347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2847/5926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:26 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1328 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:27.204708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-72a5766e-e7b8-4fc0-8ad1-bd2e3c65214a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:27.205352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-72a5766e-e7b8-4fc0-8ad1-bd2e3c65214a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:27.208529 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:56:27.284246 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-72a5766e-e7b8-4fc0-8ad1-bd2e3c65214a tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1328 microversion: 2.1 time: 0.083158 Mar 29 02:56:27.285035 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3080/5927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:27 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1328 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:28.301345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dc0dd694-2e28-4d15-8589-5ad5d581fd54 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:28.301980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dc0dd694-2e28-4d15-8589-5ad5d581fd54 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:28.375765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dc0dd694-2e28-4d15-8589-5ad5d581fd54 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1328 microversion: 2.1 time: 0.077987 Mar 29 02:56:28.376321 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2848/5928] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:28 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1328 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:29.392444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:29.393084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:29.401959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:29.402404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:29.403166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:29.403596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:29.438567 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54350. Mar 29 02:56:29.528230 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7e0cc49-ac3c-474a-83ad-7f43ceecfc13 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1345 microversion: 2.1 time: 0.139395 Mar 29 02:56:29.528782 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3081/5929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:29 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:29.692295 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:56:29.692440 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:56:30.544997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:30.545608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:30.554971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:30.556030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:30.557209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:30.557638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:30.680787 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-84f6193a-1d79-4e55-b378-5ef5e3f52fff tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1415 microversion: 2.1 time: 0.139581 Mar 29 02:56:30.682635 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2849/5930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:30 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1415 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:31.697983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:31.698583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:31.705848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:31.706296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:31.707057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:31.707483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:32.223445 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c0d39f89-ecbd-474b-8f7c-8b73a91bef6b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.529219 Mar 29 02:56:32.223979 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3082/5931] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:31 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:33.240210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:33.240809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:33.248375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:33.249055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:33.249595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:33.250019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:33.415825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-36dc52d9-2187-4b01-a54e-50d8679bd40c req-2f78e874-4a12-4c4a-bc25-2e58256ab401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2dcfcf5-c372-46c8-ad8c-ce0824381a3a", "tag": "7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:33.423794 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:33.423794 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:56:33.429067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-36dc52d9-2187-4b01-a54e-50d8679bd40c req-2f78e874-4a12-4c4a-bc25-2e58256ab401 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:33.429575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-36dc52d9-2187-4b01-a54e-50d8679bd40c req-2f78e874-4a12-4c4a-bc25-2e58256ab401 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:33.458379 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-36dc52d9-2187-4b01-a54e-50d8679bd40c req-2f78e874-4a12-4c4a-bc25-2e58256ab401 service nova] Creating event network-changed:7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b for instance c2dcfcf5-c372-46c8-ad8c-ce0824381a3a on n-h2-828148-1 Mar 29 02:56:33.464042 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-36dc52d9-2187-4b01-a54e-50d8679bd40c req-2f78e874-4a12-4c4a-bc25-2e58256ab401 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142454 Mar 29 02:56:33.465381 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3083/5932] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:56:33.469937 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-25c8c838-7f57-4f2e-8439-f39645b17166 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.233236 Mar 29 02:56:33.471563 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2850/5933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:33 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:34.487318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:34.488127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:34.496167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:34.496667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:34.497723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:34.498150 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:34.855814 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93386e63-4d2c-40fc-ac94-5bb3268d49a3 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.372502 Mar 29 02:56:34.856492 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3084/5934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:34 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:35.873656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:35.874264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:35.881627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:35.882068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:35.882822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:35.883297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:36.077901 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a98703cc-0f0b-4e79-ac3e-6c7c9594ada4 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.208708 Mar 29 02:56:36.078528 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2851/5935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:35 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:37.094765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:37.095379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:37.103018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:37.104063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:37.104793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:37.105243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:37.393778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbe49ed4-cf57-480b-a603-c222b13a901b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.302549 Mar 29 02:56:37.394336 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3085/5936] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:37 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:38.410281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:38.410924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:38.418072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:38.418512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:38.419260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:38.419681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:38.759179 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad761e07-3d36-419b-aca0-4b7ed17b6241 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.352494 Mar 29 02:56:38.759732 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2852/5937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:38 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:39.776073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:39.776676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:39.784082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:39.784520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:39.785307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:39.785729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:39.973987 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b22e5fca-ba8e-438a-a402-d2439e0277e9 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.202207 Mar 29 02:56:39.974713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3086/5938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:39 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:39.983319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3a832efe-fb6d-4568-a389-0a46e9f8d62b req-b034407a-9b1d-41f6-b94b-c341c03ec5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2dcfcf5-c372-46c8-ad8c-ce0824381a3a", "name": "network-vif-plugged", "status": "completed", "tag": "7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:39.983319 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:39.983319 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:56:39.988676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3a832efe-fb6d-4568-a389-0a46e9f8d62b req-b034407a-9b1d-41f6-b94b-c341c03ec5f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:39.989145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3a832efe-fb6d-4568-a389-0a46e9f8d62b req-b034407a-9b1d-41f6-b94b-c341c03ec5f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:40.005101 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3a832efe-fb6d-4568-a389-0a46e9f8d62b req-b034407a-9b1d-41f6-b94b-c341c03ec5f6 service nova] Creating event network-vif-plugged:7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b for instance c2dcfcf5-c372-46c8-ad8c-ce0824381a3a on n-h2-828148-1 Mar 29 02:56:40.015311 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3a832efe-fb6d-4568-a389-0a46e9f8d62b req-b034407a-9b1d-41f6-b94b-c341c03ec5f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035601 Mar 29 02:56:40.015311 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2853/5939] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:56:40.989716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:40.990279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:40.998420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:40.998857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:40.999611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:41.000032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:41.196209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73246095-1e8c-4081-bf3c-4ba7dece82f1 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1463 microversion: 2.1 time: 0.210106 Mar 29 02:56:41.197675 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3087/5940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:40 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1463 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:42.214640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:42.215334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:42.222842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.223287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.224046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.224478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.408554 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-264329b7-9e5a-4cb4-932a-671d0a7409e5 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1648 microversion: 2.1 time: 0.198447 Mar 29 02:56:42.409130 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2854/5941] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:42 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1648 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:42.425198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:42.425808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:42.432995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.433434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.434184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.434610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.776361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1460a148-77c7-4c81-b32e-d8e6c379230e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1648 microversion: 2.1 time: 0.354617 Mar 29 02:56:42.776931 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3088/5942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:42 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1648 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:42.791637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:42.792249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:42.799487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.799930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.800688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:42.801141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:42.990382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-df86dfa2-ed47-4c39-ad9c-16fec8501596 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1648 microversion: 2.1 time: 0.202055 Mar 29 02:56:42.990712 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2855/5943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:42 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1648 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:43.006348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:43.006847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:43.014437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:43.014886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:43.015658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:43.016090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:43.075474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:56:43.397617 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04ff5647-065b-4ae1-8b12-6656c330889b tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 204 len: 0 microversion: 2.1 time: 0.394581 Mar 29 02:56:43.398198 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3089/5944] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:56:43 2022] DELETE /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:56:43.406542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:43.407158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:43.414961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:43.415409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:43.416207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:43.416645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:43.608095 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffa8fb3d-90ce-4674-bb64-291817cf14f7 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1654 microversion: 2.1 time: 0.205086 Mar 29 02:56:43.608653 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2856/5945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:43 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1654 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:44.626252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:44.626951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:44.634230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:44.635346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:44.636119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:44.636549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:44.926570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11cf2a3d-b34d-455d-b179-136608f2b617 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1654 microversion: 2.1 time: 0.304504 Mar 29 02:56:44.927133 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3090/5946] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:44 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1654 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:45.600607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fe9078c2-7df7-4733-b567-70cab1242abf req-50e7109a-3695-42d1-a0f7-4cef809fdcc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2dcfcf5-c372-46c8-ad8c-ce0824381a3a", "name": "network-vif-deleted", "tag": "7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:45.603194 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:45.603194 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:56:45.612978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fe9078c2-7df7-4733-b567-70cab1242abf req-50e7109a-3695-42d1-a0f7-4cef809fdcc2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:45.613909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fe9078c2-7df7-4733-b567-70cab1242abf req-50e7109a-3695-42d1-a0f7-4cef809fdcc2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:45.631800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fe9078c2-7df7-4733-b567-70cab1242abf req-50e7109a-3695-42d1-a0f7-4cef809fdcc2 service nova] Creating event network-vif-deleted:7ca9840f-3b49-4e5b-8f29-c5cf3dd5b33b for instance c2dcfcf5-c372-46c8-ad8c-ce0824381a3a on n-h2-828148-1 Mar 29 02:56:45.638383 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fe9078c2-7df7-4733-b567-70cab1242abf req-50e7109a-3695-42d1-a0f7-4cef809fdcc2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041160 Mar 29 02:56:45.639663 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2857/5947] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:56:45.943347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:45.943951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:45.951750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:45.952188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:45.952967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:45.953393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:46.018752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:46.019190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:46.019631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lazy-loading 'fault' on Instance uuid c2dcfcf5-c372-46c8-ad8c-ce0824381a3a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:56:46.155494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4736f32-c98b-4180-951a-67b6d1412b5e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 200 len: 1453 microversion: 2.1 time: 0.215792 Mar 29 02:56:46.156152 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3091/5948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:45 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:47.174151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:47.174849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: c2dcfcf5-c372-46c8-ad8c-ce0824381a3a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:47.182603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.183035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.183795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.184233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.233169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] HTTP exception thrown: Instance c2dcfcf5-c372-46c8-ad8c-ce0824381a3a could not be found. Mar 29 02:56:47.233699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Returning 404 to user: Instance c2dcfcf5-c372-46c8-ad8c-ce0824381a3a could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:56:47.234514 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38da2526-49f7-4187-ab71-131b1fff76ab tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a" status: 404 len: 111 microversion: 2.1 time: 0.064584 Mar 29 02:56:47.235040 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2858/5949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:47 2022] GET /compute/v2.1/servers/c2dcfcf5-c372-46c8-ad8c-ce0824381a3a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:56:47.243105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:47.243653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:47.251363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.251811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.252574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.253053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.315165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:56:47.574731 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-94401a9f-56ca-4741-a489-ff1d6ce4daef tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "DELETE /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 204 len: 0 microversion: 2.1 time: 0.335043 Mar 29 02:56:47.575325 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3092/5950] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:56:47 2022] DELETE /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:56:47.583153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:47.583771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:47.591089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.591605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.592366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:47.592793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:47.788073 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db6f5774-a708-42aa-b718-deabfcd6d291 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1655 microversion: 2.1 time: 0.208479 Mar 29 02:56:47.788626 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2859/5951] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:47 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1655 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:48.806252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:48.807466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:48.814855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:48.815354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:48.816130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:48.816556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:49.007153 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1b31d142-13be-44fb-ab98-7c6c2a8b1dec tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1655 microversion: 2.1 time: 0.204917 Mar 29 02:56:49.007819 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3093/5952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:48 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1655 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:50.031070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:50.031686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:50.034628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-53cde4a2-8c60-474c-8396-d014cc975e1f req-51a55189-dc98-4bba-8674-529d99a5492d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b440386a-e006-4499-9037-a8b2a2a1359d", "name": "network-vif-deleted", "tag": "ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:56:50.038603 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:56:50.038603 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:56:50.046939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-53cde4a2-8c60-474c-8396-d014cc975e1f req-51a55189-dc98-4bba-8674-529d99a5492d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:50.047292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:50.047406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-53cde4a2-8c60-474c-8396-d014cc975e1f req-51a55189-dc98-4bba-8674-529d99a5492d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:50.047910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:50.048815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:50.049398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:50.064563 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-53cde4a2-8c60-474c-8396-d014cc975e1f req-51a55189-dc98-4bba-8674-529d99a5492d service nova] Creating event network-vif-deleted:ad1f72db-d73c-4ad4-8c5c-1ed76a5f3d71 for instance b440386a-e006-4499-9037-a8b2a2a1359d on n-h1-828148-1 Mar 29 02:56:50.074791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-53cde4a2-8c60-474c-8396-d014cc975e1f req-51a55189-dc98-4bba-8674-529d99a5492d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049889 Mar 29 02:56:50.075445 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3094/5953] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:56:50.265549 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b5627085-89a1-4058-b8c0-d69f584f5f86 tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 200 len: 1613 microversion: 2.1 time: 0.244238 Mar 29 02:56:50.266104 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2860/5954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:50 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 1613 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:56:51.283649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:56:51.284347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] [instance: b440386a-e006-4499-9037-a8b2a2a1359d] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:56:51.292525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:51.293004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:51.293766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:56:51.294204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:56:51.341435 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] HTTP exception thrown: Instance b440386a-e006-4499-9037-a8b2a2a1359d could not be found. Mar 29 02:56:51.342017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] Returning 404 to user: Instance b440386a-e006-4499-9037-a8b2a2a1359d could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:56:51.342820 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-093e3133-013d-4836-8e77-74df58d98b1e tempest-TestServerMultinode-1372384727 tempest-TestServerMultinode-1372384727-project-admin] 10.222.0.36 "GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d" status: 404 len: 111 microversion: 2.1 time: 0.063311 Mar 29 02:56:51.343338 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3095/5955] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:56:51 2022] GET /compute/v2.1/servers/b440386a-e006-4499-9037-a8b2a2a1359d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:57:24.147515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1064819184", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "eeda8615-61c6-4549-91ae-6b3b0845aeeb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:57:24.253463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:57:24.897966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:57:24.898517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:57:24.899566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:57:24.900043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:57:24.900527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:57:24.909080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:24.909616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:24.910478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:24.910979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:24.928732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:57:24.934009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:57:25.023912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:57:25.026456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eeda8615-61c6-4549-91ae-6b3b0845aeeb',volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:57:25.615042 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dcf19ea4-31bb-4a4a-90d9-474ebaf75577 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.471239 Mar 29 02:57:25.621630 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2861/5956] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:57:25.626451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ef70ae9-cdb1-4c82-b4d9-6eec2692a437 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:25.627408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ef70ae9-cdb1-4c82-b4d9-6eec2692a437 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:25.884550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ef70ae9-cdb1-4c82-b4d9-6eec2692a437 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:25.890303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ef70ae9-cdb1-4c82-b4d9-6eec2692a437 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1057 microversion: 2.1 time: 0.267501 Mar 29 02:57:25.891046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3096/5957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:25 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1057 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:26.907134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:26.907722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:26.915883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:26.916342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:26.922932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:26.922932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:27.028822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:27.037173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6a8478f-57db-4142-ae40-49fddf189975 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1107 microversion: 2.1 time: 0.133656 Mar 29 02:57:27.037767 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2862/5958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:26 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1107 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:28.053843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:28.054435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:28.068285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:28.068738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:28.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:28.071597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:28.183429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:28.192037 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b10fe51-33a5-4143-8bff-2e3261f0da30 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1173 microversion: 2.1 time: 0.141799 Mar 29 02:57:28.192799 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3097/5959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:28 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1173 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:29.214016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:29.214718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:29.223554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:29.224426 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:29.225516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:29.226057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:29.667086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:29.675952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-167f696c-08f8-466e-ae85-42637ece2cc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1215 microversion: 2.1 time: 0.466195 Mar 29 02:57:29.676750 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2863/5960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:29 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1215 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:30.156608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d90238bf-65d3-48d4-823f-a57909f22041 req-7d2a6015-5b23-42a6-ba2e-b94a86387afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9eccb7-367f-4912-b460-4c6f8737445f", "tag": "43d665bc-5754-43d1-a838-e7a680b06121"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:57:30.158141 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:57:30.158141 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:57:30.166248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d90238bf-65d3-48d4-823f-a57909f22041 req-7d2a6015-5b23-42a6-ba2e-b94a86387afd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:30.167104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d90238bf-65d3-48d4-823f-a57909f22041 req-7d2a6015-5b23-42a6-ba2e-b94a86387afd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:30.184108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d90238bf-65d3-48d4-823f-a57909f22041 req-7d2a6015-5b23-42a6-ba2e-b94a86387afd service nova] Creating event network-changed:43d665bc-5754-43d1-a838-e7a680b06121 for instance 3d9eccb7-367f-4912-b460-4c6f8737445f on n-h1-828148-1 Mar 29 02:57:30.189182 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d90238bf-65d3-48d4-823f-a57909f22041 req-7d2a6015-5b23-42a6-ba2e-b94a86387afd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037050 Mar 29 02:57:30.190074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3098/5961] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:57:30.691805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:30.692406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:30.699504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:30.699947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:30.700725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:30.701183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:30.998336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:31.006487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d89634a9-b009-4510-bf4d-a0c6713abf28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.318406 Mar 29 02:57:31.007043 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2864/5962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:30 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:32.023674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:32.024296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:32.031696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:32.032137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:32.032988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:32.033429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:32.342000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:32.350086 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-25e5001e-fa30-4038-a5ff-9af8841c5ac2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.330643 Mar 29 02:57:32.353761 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3099/5963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:32 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:33.367229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:33.368355 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:33.375840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:33.376287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:33.377141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:33.377576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:33.575239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:33.583281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4610283d-5df6-48a1-a102-6432cfbbf34c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.219743 Mar 29 02:57:33.583833 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2865/5964] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:33 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:34.599480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:34.600090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:34.607392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:34.607838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:34.608603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:34.609078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:34.803196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:34.812168 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aca6a198-9be4-476f-949d-e37e993842ed tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.216455 Mar 29 02:57:34.812717 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3100/5965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:34 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:35.829023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:35.829627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:35.837498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:35.837939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:35.838684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:35.839111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:36.034125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:36.042293 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3635fbcd-c72a-4850-9c40-c60e8a12ddc7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.217034 Mar 29 02:57:36.042850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2866/5966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:35 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:37.058952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:37.059479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:37.066712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:37.067146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:37.067896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:37.068317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:37.263340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:37.271341 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-65268626-e4c6-4925-b586-1d69ba54f0a6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.216109 Mar 29 02:57:37.271888 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3101/5967] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:37 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:38.288249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:38.288977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:38.296790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:38.297274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:38.298035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:38.298467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:38.487820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:38.496399 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9fcea0e-647b-49d8-ad4b-ff26e61246e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.211679 Mar 29 02:57:38.497005 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2867/5968] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:38 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:39.513254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:39.513868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:39.521145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:39.521588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:39.522347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:39.522773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:39.717232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:39.725552 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2eac1bc0-0585-443c-af62-a2edf2b581e9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.216097 Mar 29 02:57:39.726038 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3102/5969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:39 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:40.742402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:40.743006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:40.751295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:40.751743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:40.752499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:40.752955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:40.945879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:40.953952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a253745d-4709-4e27-ba44-171aab29f1f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.215175 Mar 29 02:57:40.954509 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2868/5970] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:40 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:41.534236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-cf871d19-2d41-483d-b40b-275ea48c972d req-60db7c0f-3168-468b-80d9-c5476eb0536e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9eccb7-367f-4912-b460-4c6f8737445f", "name": "network-vif-plugged", "status": "completed", "tag": "43d665bc-5754-43d1-a838-e7a680b06121"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:57:41.535798 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:57:41.535798 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:57:41.546181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cf871d19-2d41-483d-b40b-275ea48c972d req-60db7c0f-3168-468b-80d9-c5476eb0536e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:41.546745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-cf871d19-2d41-483d-b40b-275ea48c972d req-60db7c0f-3168-468b-80d9-c5476eb0536e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:41.562319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-cf871d19-2d41-483d-b40b-275ea48c972d req-60db7c0f-3168-468b-80d9-c5476eb0536e service nova] Creating event network-vif-plugged:43d665bc-5754-43d1-a838-e7a680b06121 for instance 3d9eccb7-367f-4912-b460-4c6f8737445f on n-h1-828148-1 Mar 29 02:57:41.567229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-cf871d19-2d41-483d-b40b-275ea48c972d req-60db7c0f-3168-468b-80d9-c5476eb0536e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036644 Mar 29 02:57:41.567807 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3103/5971] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:57:41.970358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:41.971013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:41.978209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:41.978731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:41.979419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:41.979853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:42.176325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:42.185096 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5d73e61f-7601-443c-88d9-8299f085260c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1203 microversion: 2.1 time: 0.218380 Mar 29 02:57:42.185655 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2869/5972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:41 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1203 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:43.203161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:43.203861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:43.212406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.213025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.213927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.214492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.414032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:43.423421 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-553ca907-c0f7-4b38-8728-c69b0e72fec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1388 microversion: 2.1 time: 0.224491 Mar 29 02:57:43.429605 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3104/5973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:43 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1388 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:43.440070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:43.440709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:43.448801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.449292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.450090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.450594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.650062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:43.658571 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5eb4ca36-774d-4007-9b72-d836947fab4f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1388 microversion: 2.1 time: 0.222177 Mar 29 02:57:43.659363 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2870/5974] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:43 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1388 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:43.674491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:43.675099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:43.682637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.683022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.683792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.684225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.880528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:43.889229 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5705296b-b814-4767-adcb-1113d660e60e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1388 microversion: 2.1 time: 0.218329 Mar 29 02:57:43.889790 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3105/5975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:43 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1388 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:43.905166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:43.905606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:43.912693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.913184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.913944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:43.914376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:43.973011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:57:44.275795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f3f6ecd-43c5-4e02-9825-0ec2097d4275 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 204 len: 0 microversion: 2.1 time: 0.373894 Mar 29 02:57:44.276342 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2871/5976] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:57:43 2022] DELETE /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:57:44.284321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:44.288042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:44.292363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:44.292822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:44.293617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:44.294050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:44.485806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:44.494913 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3abec72-3cba-4432-82e0-6ad52fbd23f3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1394 microversion: 2.1 time: 0.213896 Mar 29 02:57:44.500046 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3106/5977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:44 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1394 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:45.512711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:45.513424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:45.520557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:45.521037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:45.521787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:45.522216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:45.715604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:45.723600 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9fb614a7-60a7-4309-9dfb-050eee67084b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1394 microversion: 2.1 time: 0.215435 Mar 29 02:57:45.724147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2872/5978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:45 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1394 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:46.739523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:46.740419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:46.748555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:46.749297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:46.750108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:46.750538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:46.819789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3021f846-ece8-449a-bb8b-a1f6198e0ab9 req-71fb0707-3d8e-4ece-86a9-ebf8ddcdc22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9eccb7-367f-4912-b460-4c6f8737445f", "name": "network-vif-deleted", "tag": "43d665bc-5754-43d1-a838-e7a680b06121"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:57:46.821896 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:57:46.821896 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:57:46.830424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3021f846-ece8-449a-bb8b-a1f6198e0ab9 req-71fb0707-3d8e-4ece-86a9-ebf8ddcdc22c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:46.833449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3021f846-ece8-449a-bb8b-a1f6198e0ab9 req-71fb0707-3d8e-4ece-86a9-ebf8ddcdc22c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:46.847004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3021f846-ece8-449a-bb8b-a1f6198e0ab9 req-71fb0707-3d8e-4ece-86a9-ebf8ddcdc22c service nova] Creating event network-vif-deleted:43d665bc-5754-43d1-a838-e7a680b06121 for instance 3d9eccb7-367f-4912-b460-4c6f8737445f on n-h1-828148-1 Mar 29 02:57:46.851907 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3021f846-ece8-449a-bb8b-a1f6198e0ab9 req-71fb0707-3d8e-4ece-86a9-ebf8ddcdc22c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036289 Mar 29 02:57:46.853394 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2873/5979] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:57:46.868945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:46.877700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-24dc1978-b11f-4271-9151-93c953844c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1352 microversion: 2.1 time: 0.141934 Mar 29 02:57:46.878274 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3107/5980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:46 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:47.895096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:47.895789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:47.903226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:47.903676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:47.904437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:47.904898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:47.970200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:47.970562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:47.971005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid 3d9eccb7-367f-4912-b460-4c6f8737445f {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:57:48.107803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:57:48.115954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0ccbe2f7-1f3d-4e9e-be6d-72de7e6e72c6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 200 len: 1193 microversion: 2.1 time: 0.224994 Mar 29 02:57:48.116544 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2874/5981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:47 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 1193 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:57:49.133493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:57:49.134113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 3d9eccb7-367f-4912-b460-4c6f8737445f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:57:49.142008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:49.142448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:49.143263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:57:49.143741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:57:49.193595 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 3d9eccb7-367f-4912-b460-4c6f8737445f could not be found. Mar 29 02:57:49.194182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 3d9eccb7-367f-4912-b460-4c6f8737445f could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:57:49.194987 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4973138d-5ed2-4018-af3c-3de142b72590 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f" status: 404 len: 111 microversion: 2.1 time: 0.065251 Mar 29 02:57:49.195514 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3108/5982] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:57:49 2022] GET /compute/v2.1/servers/3d9eccb7-367f-4912-b460-4c6f8737445f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:58:09.669413 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:58:09.670400 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 02:58:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:58:12.167187 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 02:58:12.168011 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 02:58:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 02:58:14.984009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-523949031", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6c6ac2a6-6715-4949-ab77-ab1ab53890dc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:58:15.125501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:58:15.641162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:58:15.641618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:58:15.642095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:58:15.642503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:58:15.642914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:58:15.651841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:15.652286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:15.653173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:15.653611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:15.670334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:58:15.675444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:58:15.687238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:58:15.689338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6c6ac2a6-6715-4949-ab77-ab1ab53890dc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:58:15.864443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d014822-eaf8-4a64-ac40-018bf32e50b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883996 Mar 29 02:58:15.865330 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2875/5983] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:58:15.873762 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:58:15.877034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-14b9f944-c92e-4822-93c6-9ffcf2d509c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:15.877638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-14b9f944-c92e-4822-93c6-9ffcf2d509c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:16.058225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-14b9f944-c92e-4822-93c6-9ffcf2d509c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:16.066302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-14b9f944-c92e-4822-93c6-9ffcf2d509c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1056 microversion: 2.1 time: 0.194206 Mar 29 02:58:16.069486 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3109/5984] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:15 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1056 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:17.083515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:17.084136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:17.092308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:17.092762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:17.093564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:17.094065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:17.205099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:17.213725 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae1ec834-c3b5-4770-a0af-a6c6c4b3435a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1108 microversion: 2.1 time: 0.134031 Mar 29 02:58:17.214290 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2876/5985] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:17 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1108 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:58:18.232431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:18.233104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:18.245342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:18.245804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:18.247006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:18.247677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:18.308085 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54854. Mar 29 02:58:18.378071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:18.393899 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ec837757-1331-48c6-824c-bcc224a9aac1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1126 microversion: 2.1 time: 0.164090 Mar 29 02:58:18.394440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3110/5986] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:18 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1126 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:19.410944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:19.414495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:19.419497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:19.419942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:19.420705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:19.421160 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:19.970242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:19.979190 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64ae1c90-c35c-4026-a24b-d6ecb8050c23 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.571843 Mar 29 02:58:19.979785 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2877/5987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:19 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:20.118581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e358f931-a83a-4332-9127-16100dadbc9d req-e77c7dd5-0736-456e-b6a4-e50db6199431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0694e7f5-895e-4bcb-9f5d-a284d052b6c3", "tag": "9d076f11-654b-4191-b04f-dee8a176585a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:58:20.120372 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:58:20.120372 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:58:20.129283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e358f931-a83a-4332-9127-16100dadbc9d req-e77c7dd5-0736-456e-b6a4-e50db6199431 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:20.130008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e358f931-a83a-4332-9127-16100dadbc9d req-e77c7dd5-0736-456e-b6a4-e50db6199431 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:20.151597 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e358f931-a83a-4332-9127-16100dadbc9d req-e77c7dd5-0736-456e-b6a4-e50db6199431 service nova] Creating event network-changed:9d076f11-654b-4191-b04f-dee8a176585a for instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 on n-h1-828148-1 Mar 29 02:58:20.157303 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e358f931-a83a-4332-9127-16100dadbc9d req-e77c7dd5-0736-456e-b6a4-e50db6199431 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042953 Mar 29 02:58:20.163186 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3111/5988] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:58:20.995956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:20.996761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:21.005168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:21.005952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:21.006930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:21.007481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:21.356337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:21.365419 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d8489aeb-4f47-477e-aab2-10c38a14d31f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.373577 Mar 29 02:58:21.366073 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2878/5989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:20 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:22.382753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:22.383456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:22.391119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:22.391567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:22.392337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:22.392771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:22.599866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:22.608679 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3279052b-1efc-4d7c-8087-2ed3b3152148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.230197 Mar 29 02:58:22.609264 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3112/5990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:22 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:23.626186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:23.626797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:23.634096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:23.634539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:23.635293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:23.635721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:23.839486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:23.847780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b8a19ec-795a-4474-83eb-0180ef722842 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.225676 Mar 29 02:58:23.848336 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2879/5991] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:23 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:24.868480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:24.869117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:24.876579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:24.877072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:24.877834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:24.878366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:25.085793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:25.094340 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81817769-91a9-4264-8262-f2d2fe363254 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.230364 Mar 29 02:58:25.094889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3113/5992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:24 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:58:26.111076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:26.111684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:26.120001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:26.120487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:26.121300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:26.121730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:26.335696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:26.346770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c00ba835-eeaf-44be-b17f-b628a1b1e10f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.239309 Mar 29 02:58:26.347331 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2880/5993] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:26 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:27.366210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:27.366858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:27.374693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:27.375145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:27.375919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:27.376355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:27.583548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:27.592233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0cb3c0c8-5fa7-40de-82ca-7f01e266ba36 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.229796 Mar 29 02:58:27.592777 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3114/5994] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:27 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:28.606653 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 02:58:28.609900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:28.610531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:28.617789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:28.618477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:28.620452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:28.620452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:28.821175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:28.829740 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cdb00f2e-7efa-432a-906d-70262bb05986 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.224779 Mar 29 02:58:28.830247 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2881/5995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:28 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:29.848211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:29.848818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:29.856902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:29.857422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:29.858181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:29.858605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:30.064391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:30.072900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fc47509a-d13b-41e2-b636-295c3d016a60 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.228956 Mar 29 02:58:30.073511 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3115/5996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:29 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:58:31.090310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:31.090980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:31.099365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:31.099807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:31.100771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:31.101549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:31.153790 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54882. Mar 29 02:58:31.310515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:31.319071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78116221-9598-4ec0-91ab-97f7a56eea03 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.232494 Mar 29 02:58:31.319631 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2882/5997] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:31 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:32.335178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:32.335780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:32.343053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:32.343552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:32.344245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:32.344670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:32.554095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:32.567295 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15d49d9b-a40e-44c1-8741-17d283af53a0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.235577 Mar 29 02:58:32.568153 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3116/5998] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:32 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:33.585169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:33.585787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:33.593613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:33.594062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:33.594849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:33.595252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:33.796199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:33.804227 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4ca5b729-31bd-49bc-b72a-f2fb7679c3c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.222846 Mar 29 02:58:33.804776 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2883/5999] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:33 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:34.820851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:34.821478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:34.831006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:34.831471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:34.832238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:34.832655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:35.040663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:35.052405 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e07b703-45d9-48ab-84b3-6e1063f40ec0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.235309 Mar 29 02:58:35.053014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3117/6000] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:34 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:36.069683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:36.070296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:36.077565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:36.078011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:36.078770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:36.079202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:36.284887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:36.293444 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b1aeb2d8-2b10-4399-93c5-16564730fb6e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.227779 Mar 29 02:58:36.293995 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2884/6001] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:36 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:37.311410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:37.312035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:37.320242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:37.320688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:37.321498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:37.321969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:37.529961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:37.538308 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-378ec46c-8fef-4dc6-a0ad-32fc3b3eced6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.231146 Mar 29 02:58:37.538851 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3118/6002] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:37 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:38.555354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:38.555989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:38.564421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:38.564896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:38.565764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:38.566313 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:38.778075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:38.787225 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-847d57c2-931f-467d-a79b-e2cf84590a28 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.235493 Mar 29 02:58:38.787943 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2885/6003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:38 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:58:39.803477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:39.804091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:39.811763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:39.812198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:39.813040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:39.813486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:40.018052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:40.026803 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-242f062d-5971-4a61-8268-51f5d3e9cfb3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.227059 Mar 29 02:58:40.027380 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3119/6004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:39 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:41.043452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:41.044000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:41.052069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:41.052512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:41.053305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:41.053732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:41.499335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:41.507637 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7cf3de1e-25f6-4ea5-b68b-e3a165357409 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1168 microversion: 2.1 time: 0.467872 Mar 29 02:58:41.508215 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2886/6005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:41 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1168 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:42.524432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:42.525089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:42.532869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:42.533329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:42.534093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:42.534527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:42.733270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:42.746105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-10154034-c92b-440a-a98a-02e957276b10 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1214 microversion: 2.1 time: 0.225337 Mar 29 02:58:42.746674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3120/6006] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:42 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1214 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:43.762863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:43.763366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:43.770741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:43.771187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:43.771945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:43.772377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:43.972049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:43.980253 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1dc8c698-f5e7-4d34-a239-bcc948b5d6da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.221204 Mar 29 02:58:43.981109 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2887/6007] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:43 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:44.998973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:44.999520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:45.006846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:45.007279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:45.008027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:45.008452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:45.261289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:45.269357 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e37b43c-c89d-4723-99ae-a830daea38ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.274815 Mar 29 02:58:45.269934 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3121/6008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:44 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:46.286730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:46.287336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:46.294598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:46.295040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:46.295791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:46.296248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:46.488658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:46.497618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7b966118-57c8-45e0-b5e9-6e9eff5586c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.213912 Mar 29 02:58:46.498174 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2888/6009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:46 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:47.513407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:47.514579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:47.521861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:47.522295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:47.523041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:47.523465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:47.715308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:47.723451 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fd41683-aed4-4c16-83d3-69cb96176003 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.213668 Mar 29 02:58:47.724002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3122/6010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:47 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:48.739699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:48.740335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:48.748157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:48.748600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:48.749388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:48.749815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:48.945723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:48.954392 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-017cad42-8e2e-4974-8111-52302c1fdb3c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.218394 Mar 29 02:58:48.954944 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2889/6011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:48 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:49.970441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:49.970956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:49.978131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:49.979114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:49.979306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:49.979734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:50.174299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:50.182398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6db9adb-9a7e-4915-b8fc-3eedb89aed52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.215955 Mar 29 02:58:50.182950 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3123/6012] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:49 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:51.198628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:51.199248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:51.207327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:51.207772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:51.208532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:51.209042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:51.405885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:51.414255 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f7682616-5e29-4497-8cf8-8ff5f27cb55c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.219261 Mar 29 02:58:51.415275 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2890/6013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:51 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:52.431198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:52.431807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:52.439041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:52.439476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:52.440228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:52.440652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:52.633007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:52.641787 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f9e1e5f-ee29-4e57-a6a3-7e1b4791a3ab tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.214236 Mar 29 02:58:52.642354 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3124/6014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:52 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:53.660704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:53.661390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:53.668653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:53.669199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:53.670625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:53.671057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:53.722624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-074d96e7-cd1c-4647-baa9-4af77a4c056f req-005c1852-0aaf-4a84-9d13-fd61cf7e8d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0694e7f5-895e-4bcb-9f5d-a284d052b6c3", "name": "network-vif-plugged", "status": "completed", "tag": "9d076f11-654b-4191-b04f-dee8a176585a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:58:53.724262 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:58:53.724262 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:58:53.733589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-074d96e7-cd1c-4647-baa9-4af77a4c056f req-005c1852-0aaf-4a84-9d13-fd61cf7e8d9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:53.734028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-074d96e7-cd1c-4647-baa9-4af77a4c056f req-005c1852-0aaf-4a84-9d13-fd61cf7e8d9e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:53.750289 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-074d96e7-cd1c-4647-baa9-4af77a4c056f req-005c1852-0aaf-4a84-9d13-fd61cf7e8d9e service nova] Creating event network-vif-plugged:9d076f11-654b-4191-b04f-dee8a176585a for instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 on n-h1-828148-1 Mar 29 02:58:53.755057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-074d96e7-cd1c-4647-baa9-4af77a4c056f req-005c1852-0aaf-4a84-9d13-fd61cf7e8d9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037155 Mar 29 02:58:53.755641 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3125/6015] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 02:58:53.913956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:53.922301 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3522e18d-02e0-4753-add9-eb564530c447 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.265429 Mar 29 02:58:53.922854 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2891/6016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:53 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:54.939405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:54.940035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:54.947561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:54.948005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:54.948792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:54.949250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:55.142807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:55.150841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8ab29c2-317c-411b-ac92-78fe6fbfcbac tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1202 microversion: 2.1 time: 0.216195 Mar 29 02:58:55.156977 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3126/6017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:54 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1202 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 02:58:56.168417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:56.169055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:56.176407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.176873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.177629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.178057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.366623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:56.374944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d8f86475-51c5-44f5-8c70-5fa48018d8f8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1387 microversion: 2.1 time: 0.210156 Mar 29 02:58:56.375491 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2892/6018] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:56 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1387 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:56.390953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:56.391567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:56.398790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.399239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.400030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.400460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.593336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:56.601449 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-144405ed-0f1e-4d1b-bcd5-5fa5db88931f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1387 microversion: 2.1 time: 0.214663 Mar 29 02:58:56.602011 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3127/6019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:56 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1387 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:56.616850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:56.617743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:56.625422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.625866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.626621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.627043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.823307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:56.831565 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f9ac7bb-ef89-43ab-b708-6b0210e32985 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1387 microversion: 2.1 time: 0.218489 Mar 29 02:58:56.832112 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2893/6020] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:56 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1387 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:56.929405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:56.929909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:56.937712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.938156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:56.938913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:56.939344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:57.001485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 02:58:57.315718 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d053005-cd11-4e41-8eb1-5fd05b1d6afc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 204 len: 0 microversion: 2.1 time: 0.389551 Mar 29 02:58:57.316219 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3128/6021] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:58:56 2022] DELETE /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 02:58:57.323990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:57.327245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:57.331929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:57.332382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:57.333179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:57.333609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:57.527592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:57.536228 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dd88097-2fa6-4929-8ad6-3a404690a0cc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1393 microversion: 2.1 time: 0.215829 Mar 29 02:58:57.536783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2894/6022] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:57 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1393 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:58.554662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:58.555387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:58.563290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:58.563817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:58.566276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:58.566276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:58.756991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:58:58.765102 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13b73726-f8d5-4db6-b5f4-509901cb261a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1393 microversion: 2.1 time: 0.214546 Mar 29 02:58:58.765666 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3129/6023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:58 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1393 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:58:59.782133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:58:59.782738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:58:59.790718 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:59.791436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:59.792215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:59.792652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:59.831208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5a835041-1888-4d8e-b032-474d86524451 req-28c629c5-9bbe-495e-985b-38e14230e08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0694e7f5-895e-4bcb-9f5d-a284d052b6c3", "name": "network-vif-deleted", "tag": "9d076f11-654b-4191-b04f-dee8a176585a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:58:59.834794 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:58:59.834794 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:58:59.843865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5a835041-1888-4d8e-b032-474d86524451 req-28c629c5-9bbe-495e-985b-38e14230e08c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:58:59.844299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5a835041-1888-4d8e-b032-474d86524451 req-28c629c5-9bbe-495e-985b-38e14230e08c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:58:59.861762 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5a835041-1888-4d8e-b032-474d86524451 req-28c629c5-9bbe-495e-985b-38e14230e08c service nova] Creating event network-vif-deleted:9d076f11-654b-4191-b04f-dee8a176585a for instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 on n-h1-828148-1 Mar 29 02:58:59.870170 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5a835041-1888-4d8e-b032-474d86524451 req-28c629c5-9bbe-495e-985b-38e14230e08c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044079 Mar 29 02:58:59.871538 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3130/6024] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:58:59.993904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:00.002978 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d55854d-808e-4934-b9ac-9033df72115e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1351 microversion: 2.1 time: 0.224820 Mar 29 02:59:00.003554 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2895/6025] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:58:59 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1351 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:01.021045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:01.021648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:01.029218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:01.029705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:01.030478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:01.030917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:01.101308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:01.101756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:01.102202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 02:59:01.162910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:01.171770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-57816e02-53d3-4e27-84a6-a24026470967 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 200 len: 1192 microversion: 2.1 time: 0.154932 Mar 29 02:59:01.172397 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3131/6026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:01 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 1192 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:02.188872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:02.189536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:02.198366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:02.198807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:02.199595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:02.200235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:02.263384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. Mar 29 02:59:02.264570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:59:02.265413 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0942c5fb-e4d7-4d02-a055-fd1029c2cc9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 404 len: 111 microversion: 2.1 time: 0.081040 Mar 29 02:59:02.265963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2896/6027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:02 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:59:03.407086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:03.407605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:03.414898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:03.415330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:03.416099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:03.416529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:03.466247 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. Mar 29 02:59:03.466757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:59:03.468131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ba295ef0-e1db-495c-8345-10bc8dbd7027 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 404 len: 111 microversion: 2.1 time: 0.065225 Mar 29 02:59:03.468681 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3132/6028] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 02:59:03 2022] DELETE /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:59:03.476710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:03.477416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 0694e7f5-895e-4bcb-9f5d-a284d052b6c3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:03.485436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:03.485968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:03.486733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:03.487164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:03.537927 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. Mar 29 02:59:03.538536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 0694e7f5-895e-4bcb-9f5d-a284d052b6c3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 02:59:03.539365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d08500c2-1d48-400b-b185-b7e667dd01f4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3" status: 404 len: 111 microversion: 2.1 time: 0.066441 Mar 29 02:59:03.539917 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2897/6029] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:03 2022] GET /compute/v2.1/servers/0694e7f5-895e-4bcb-9f5d-a284d052b6c3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 02:59:32.966603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-255577339", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6a3998aa-c28e-4dd9-ac33-8e2a675e14ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:59:32.979198 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:59:33.064628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:59:33.814110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:59:33.814564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:59:33.815065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:59:33.815501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:59:33.815917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:59:33.824811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:33.825280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:33.826070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:33.826500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:33.844764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:59:33.849685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:59:33.937858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:59:33.939957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a3998aa-c28e-4dd9-ac33-8e2a675e14ba',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:59:33.987257 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55136. Mar 29 02:59:34.409999 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 02:59:35.417927 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55138. Mar 29 02:59:35.421927 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b0d816f-3a46-4b6d-a3e7-9fae2275ff82 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.458865 Mar 29 02:59:35.425680 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3133/6030] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:59:35.432562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78b73c6d-eb1d-49fe-907a-04f010928141 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:35.433289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78b73c6d-eb1d-49fe-907a-04f010928141 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:35.438160 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 02:59:35.504542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78b73c6d-eb1d-49fe-907a-04f010928141 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:35.512688 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78b73c6d-eb1d-49fe-907a-04f010928141 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1070 microversion: 2.1 time: 0.083824 Mar 29 02:59:35.513256 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2898/6031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:35 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1070 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:36.529804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:36.530412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:36.538335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:36.538797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:36.539542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:36.539972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:36.653692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:36.662441 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3a1d7e9-d879-42b3-b025-66695af676f9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1112 microversion: 2.1 time: 0.135663 Mar 29 02:59:36.664893 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3134/6032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:36 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1112 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:37.680670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:37.681404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:37.691055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:37.691503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:37.692270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:37.692899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:37.753531 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55154. Mar 29 02:59:37.817850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:37.826293 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dbacd545-81a4-4d62-805b-b474ac051935 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1186 microversion: 2.1 time: 0.150638 Mar 29 02:59:37.833194 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2899/6033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:37 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1186 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:38.843506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:38.844698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:38.852176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:38.852747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:38.853563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:38.853990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:39.064690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:39.072889 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6c27ab9-3196-4d65-9fe8-4e4685935271 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1228 microversion: 2.1 time: 0.233180 Mar 29 02:59:39.073440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3135/6034] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:38 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:39.586337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ee045a81-bad4-4128-95d8-4ffabd4131ee req-c4c42d96-0070-471f-964b-f149396b11b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58ca3279-bfc3-42b2-bc06-a7afe3afa994", "tag": "22eb93af-6f32-4496-8653-fc794f25e9cb"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:59:39.587890 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:59:39.587890 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 02:59:39.597770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ee045a81-bad4-4128-95d8-4ffabd4131ee req-c4c42d96-0070-471f-964b-f149396b11b2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:39.600135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ee045a81-bad4-4128-95d8-4ffabd4131ee req-c4c42d96-0070-471f-964b-f149396b11b2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:39.616066 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ee045a81-bad4-4128-95d8-4ffabd4131ee req-c4c42d96-0070-471f-964b-f149396b11b2 service nova] Creating event network-changed:22eb93af-6f32-4496-8653-fc794f25e9cb for instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 on n-h1-828148-1 Mar 29 02:59:39.620942 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ee045a81-bad4-4128-95d8-4ffabd4131ee req-c4c42d96-0070-471f-964b-f149396b11b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038694 Mar 29 02:59:39.630824 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2900/6035] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:59:40.090012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:40.090648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:40.097754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:40.098195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:40.098977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:40.099409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:40.296276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:40.304936 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-91597268-6b39-4142-b8c1-a86cac85109c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.218540 Mar 29 02:59:40.305726 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3136/6036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:40 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:41.322417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:41.323114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:41.330723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:41.331167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:41.331922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:41.332358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:41.595284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:41.603290 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b43e4e49-123b-478e-b691-040a8b606085 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.285456 Mar 29 02:59:41.603850 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2901/6037] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:41 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:42.619630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:42.620241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:42.627664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:42.628116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:42.628905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:42.629336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:42.822089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:42.830196 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4d119af-6f52-4f98-8729-388c6f64f760 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.214595 Mar 29 02:59:42.830751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3137/6038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:42 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:43.847272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:43.847881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:43.855251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:43.855695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:43.856458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:43.856924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:44.153572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:44.161695 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-66cc3bb4-edce-4817-9e09-a2d443122673 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.318062 Mar 29 02:59:44.162245 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2902/6039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:43 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:45.178308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:45.178924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:45.186196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:45.186643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:45.187399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:45.187834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:45.381848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:45.389999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d2543cca-7a9e-44df-9920-3d69869e9fc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.215451 Mar 29 02:59:45.390562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3138/6040] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:45 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:46.406637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:46.407252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:46.415213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:46.415694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:46.416461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:46.416914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:46.609904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:46.618499 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a5f6642-b32f-4901-9867-55d571bdd451 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.215479 Mar 29 02:59:46.619072 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2903/6041] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:46 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:47.635139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:47.635744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:47.643068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:47.643503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:47.644255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:47.644679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:47.844700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:47.853499 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8fd87b1a-3478-4f71-b277-b389c016804b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.222008 Mar 29 02:59:47.854061 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3139/6042] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:47 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:48.870207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:48.870817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:48.878149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:48.878597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:48.879354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:48.879786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:49.074647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:49.082890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f1e8886-4eb4-4790-988c-b3f453cc4585 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.216336 Mar 29 02:59:49.087735 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2904/6043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:48 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:49.983500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b5b1c422-8f0e-42e2-a948-476b13156c45 req-2c3b34fc-1d3e-4b65-91a5-03314306103d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ca3279-bfc3-42b2-bc06-a7afe3afa994", "name": "network-vif-plugged", "status": "completed", "tag": "22eb93af-6f32-4496-8653-fc794f25e9cb"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:59:49.985145 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 02:59:49.985145 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 02:59:49.993976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b5b1c422-8f0e-42e2-a948-476b13156c45 req-2c3b34fc-1d3e-4b65-91a5-03314306103d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:49.994416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b5b1c422-8f0e-42e2-a948-476b13156c45 req-2c3b34fc-1d3e-4b65-91a5-03314306103d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:50.009870 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b5b1c422-8f0e-42e2-a948-476b13156c45 req-2c3b34fc-1d3e-4b65-91a5-03314306103d service nova] Creating event network-vif-plugged:22eb93af-6f32-4496-8653-fc794f25e9cb for instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 on n-h1-828148-1 Mar 29 02:59:50.014715 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b5b1c422-8f0e-42e2-a948-476b13156c45 req-2c3b34fc-1d3e-4b65-91a5-03314306103d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 Mar 29 02:59:50.016028 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3140/6044] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 02:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 02:59:50.100431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:50.101393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:50.109042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:50.109760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:50.110746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:50.111497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:50.311976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:50.320495 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82c332c8-a64a-4514-9022-e1853a03ed64 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.224483 Mar 29 02:59:50.321083 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2905/6045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:50 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:51.337777 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:51.338496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:51.346104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:51.346546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:51.347304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:51.347735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:51.545909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:51.554703 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62927edb-f0f8-4021-bf46-11df895fa466 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1216 microversion: 2.1 time: 0.221104 Mar 29 02:59:51.555270 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3141/6046] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:51 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:52.572005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:52.572607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:52.579893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:52.580332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:52.581112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:52.581540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:52.775936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:52.784028 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30521c4d-09cd-4897-a7e3-0b018c562ac6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1401 microversion: 2.1 time: 0.216164 Mar 29 02:59:52.784578 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2906/6047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:52 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1401 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:52.800209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:52.800822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:52.808602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:52.809083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:52.809844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:52.810276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:53.009775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:53.018008 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f3d7700-211a-43e5-8c1e-b6fcb73902b5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1401 microversion: 2.1 time: 0.221445 Mar 29 02:59:53.018557 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3142/6048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:52 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1401 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:53.033791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1319975098"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:59:53.034796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:53.041853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:53.042295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:53.043037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:53.043489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:53.173894 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.compute.api [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Attempting to quiesce instance before volume snapshot. Mar 29 02:59:53.234601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.compute.api [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Mar 29 02:59:53.488981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Creating snapshot from volume 6a3998aa-c28e-4dd9-ac33-8e2a675e14ba. {{(pid=103514) snapshot_instance /opt/stack/nova/nova/compute/api.py:3347}} Mar 29 02:59:55.429408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2de44f42-7923-48a8-b5e4-964260f8c73b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994/action" status: 202 len: 0 microversion: 2.1 time: 2.398966 Mar 29 02:59:55.430038 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2907/6049] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 02:59:53 2022] POST /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994/action => generated 0 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 02:59:56.621670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1105906148", "imageRef": "5393cb78-78bf-40c8-99a7-de3f40d67fac", "flavorRef": "452", "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 02:59:56.688020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 02:59:57.201641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 02:59:57.202059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 02:59:57.202529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 02:59:57.202932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 02:59:57.203336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 02:59:57.212158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:57.212595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:57.213437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:57.213862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:57.230697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 02:59:57.235715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 02:59:57.247237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 02:59:57.249754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3cee256e-89fa-4359-9837-efc1fe054ed0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 02:59:57.417922 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2b07056-3eb1-4775-8209-7b6f294ee157 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799899 Mar 29 02:59:57.418562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3143/6050] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 02:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 02:59:57.429698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba8cd51b-826f-41fe-95be-51c8ab3678fa tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:57.430401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba8cd51b-826f-41fe-95be-51c8ab3678fa tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:57.499722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba8cd51b-826f-41fe-95be-51c8ab3678fa tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:57.508319 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba8cd51b-826f-41fe-95be-51c8ab3678fa tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1230 microversion: 2.1 time: 0.083460 Mar 29 02:59:57.508990 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2908/6051] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:57 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1230 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:58.525697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:58.526312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:58.534296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:58.534741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:58.535502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:58.535932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:58.646962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:58.656684 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf839b3f-9fa9-4e9e-9110-db330d890683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1226 microversion: 2.1 time: 0.135496 Mar 29 02:59:58.657616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3144/6052] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:58 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 02:59:59.673867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 02:59:59.674482 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 02:59:59.685845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:59.686414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:59.687617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 02:59:59.688057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 02:59:59.806853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 02:59:59.817898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dad21d69-c40a-48da-850b-3aa9947c2454 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1300 microversion: 2.1 time: 0.147528 Mar 29 02:59:59.818673 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2909/6053] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 02:59:59 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1300 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:00.835198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:00.835928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:00.843840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:00.844271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:00.845272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:00.845869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:01.291977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:01.300395 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2870396-e45c-499a-9037-ac5a4f838328 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.469008 Mar 29 03:00:01.301303 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3145/6054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:00 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:01.713677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-db9a6959-6e1e-405f-9708-109e1ef14c1f req-592b0884-d7af-4fd9-b8d6-4736d76f63b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92ce1393-0dcc-4f3d-8c10-eab17b092e57", "tag": "753cdb65-6b04-45d8-822a-6d6cfbf8c6a9"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:00:01.713677 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:00:01.713677 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:00:01.734246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db9a6959-6e1e-405f-9708-109e1ef14c1f req-592b0884-d7af-4fd9-b8d6-4736d76f63b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:01.734246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db9a6959-6e1e-405f-9708-109e1ef14c1f req-592b0884-d7af-4fd9-b8d6-4736d76f63b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:01.761255 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-db9a6959-6e1e-405f-9708-109e1ef14c1f req-592b0884-d7af-4fd9-b8d6-4736d76f63b9 service nova] Creating event network-changed:753cdb65-6b04-45d8-822a-6d6cfbf8c6a9 for instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 on n-h2-828148-1 Mar 29 03:00:01.766223 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-db9a6959-6e1e-405f-9708-109e1ef14c1f req-592b0884-d7af-4fd9-b8d6-4736d76f63b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065949 Mar 29 03:00:01.767497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2910/6055] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:00:02.317666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:02.319468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:02.327940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:02.328398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:02.329859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:02.330317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:02.643496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:02.658299 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f6b073e6-0d29-4222-88cd-c7448a2de9d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.343889 Mar 29 03:00:02.658299 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3146/6056] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:02 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:03.677097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:03.677810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:03.686253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:03.686849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:03.687625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:03.688173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:03.897524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:03.905522 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39e5fa05-6379-4280-b46c-343c321fa153 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.234381 Mar 29 03:00:03.906081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2911/6057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:03 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:04.922915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:04.923557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:04.932307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:04.932735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:04.933550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:04.933983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:05.139165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:05.147178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-392b890b-0ad5-4590-a3a5-251c5921ece9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.228155 Mar 29 03:00:05.147734 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3147/6058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:04 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:06.165903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:06.165903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:06.173961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:06.174410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:06.175174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:06.175608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:06.386581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:06.394652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fe23f8b1-9351-455e-9393-bebfcc71ff2c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.234378 Mar 29 03:00:06.395197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2912/6059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:06 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:07.411285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:07.411928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:07.419249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:07.419691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:07.420453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:07.420989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:07.641811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:07.650537 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc61d865-b55d-4421-b78b-cc28d0f53ec2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.242907 Mar 29 03:00:07.657216 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3148/6060] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:07 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:08.671922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:08.671922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:08.681411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:08.681411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:08.681411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:08.681411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:08.912086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:08.928473 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba7d154f-ed8b-4c99-817e-a0e45f58a1ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.259477 Mar 29 03:00:08.928473 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2913/6061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:08 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:09.943297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:09.943897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:09.952215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:09.952679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:09.953463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:09.953891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:10.294721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:10.302840 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b6564dcd-1bf3-4f0e-90f4-3b4d09d6d64c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.363255 Mar 29 03:00:10.307033 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3149/6062] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:09 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:11.319877 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:11.321025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:11.328522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:11.329015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:11.329788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:11.330230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:11.541092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:11.549199 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d66eb09-d229-4285-a166-9abf5113efde tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.233143 Mar 29 03:00:11.550044 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2914/6063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:11 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:12.569396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:12.570016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:12.581198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:12.581198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:12.581198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:12.581198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:12.783319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:12.796364 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc19e843-4100-47b1-bd58-872572f058dd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.226649 Mar 29 03:00:12.796364 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3150/6064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:12 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:00:13.809784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:13.810510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:13.817903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:13.818354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:13.819115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:13.819552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:14.023540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:14.032415 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-24f5bc01-3674-4408-ad21-3a77e58478a5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.226686 Mar 29 03:00:14.033052 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2915/6065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:13 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:15.050324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:15.050953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:15.059285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:15.059730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:15.060494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:15.060955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:15.268157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:15.276900 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f9ffe7d-b3d5-4f83-8127-174797ca4c12 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.230397 Mar 29 03:00:15.277764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3151/6066] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:15 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:16.295024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:16.295665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:16.303007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:16.303458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:16.304217 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:16.304653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:16.499000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:16.507046 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-280b8c4c-cbd8-4b8d-b332-201e90979340 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.216318 Mar 29 03:00:16.507596 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2916/6067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:16 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:17.527140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:17.527950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:17.535006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:17.535478 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:17.536303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:17.536857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:17.753117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:17.757690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e8dcd8a5-4a12-4fd0-aaaa-82ca2b1a836e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.237322 Mar 29 03:00:17.758251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3152/6068] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:17 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:18.775986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:18.776633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:18.784750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:18.787798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:18.787798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:18.787798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:18.991793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:19.000152 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6adca21e-d159-4f39-a432-e9c0ead1a0f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.229020 Mar 29 03:00:19.000748 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2917/6069] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:18 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:20.017320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:20.017883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:20.025231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:20.025712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:20.026451 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:20.026879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:20.228062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:20.236676 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48143615-0488-49c2-aa1d-e210eeac0ef2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.223160 Mar 29 03:00:20.237254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3153/6070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:20 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:21.254275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:21.254947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:21.263622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:21.264081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:21.264939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:21.265385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:21.465344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:21.473732 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-52eb43e7-2e62-49d9-9c5d-158e51137748 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.223162 Mar 29 03:00:21.474297 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2918/6071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:21 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:00:22.491149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:22.491761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:22.499027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:22.499473 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:22.500227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:22.500655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:22.700714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:22.708791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0901388-f831-44a4-ab7e-a3b530dacf2d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.221540 Mar 29 03:00:22.709418 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3154/6072] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:22 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:23.725030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:23.725650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:23.733205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:23.733619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:23.734886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:23.734886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:23.933030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:23.941624 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4f0c76ec-4464-4546-b256-6588bba0bb5f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.220304 Mar 29 03:00:23.942335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2919/6073] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:23 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:24.959491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:24.960040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:24.967352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:24.967825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:24.968583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:24.969048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:25.178460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:25.187270 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90c9c7a5-f8c4-4288-97a3-917fc36f4850 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.231548 Mar 29 03:00:25.187828 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3155/6074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:24 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:26.204136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:26.204792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:26.212210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:26.212668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:26.213486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:26.213933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:26.423158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:26.431507 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47696f69-1cd6-4eff-809a-b6b8ce0033c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.231007 Mar 29 03:00:26.432064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2920/6075] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:26 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:27.448440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:27.449079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:27.456440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:27.456933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:27.457701 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:27.458131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:27.658154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:27.667244 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c9ca1558-7dc1-441f-8f81-a9e326bccaf1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.222491 Mar 29 03:00:27.677382 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3156/6076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:27 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:28.683901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:28.685404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:28.693640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:28.694125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:28.694936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:28.695376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:28.894730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:28.903382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-44bfb58f-8aca-49b5-be16-034f4eedf982 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.223364 Mar 29 03:00:28.903949 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2921/6077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:28 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:29.920278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:29.920904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:29.929099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:29.929741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:29.930682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:29.931112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:30.138278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:30.147176 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-56e2c4a4-185b-4bbb-a613-20ae9cfdf905 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.230589 Mar 29 03:00:30.147729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3157/6078] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:29 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:31.164264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:31.165492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:31.173430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:31.173956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:31.174745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:31.175187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:31.379692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:31.388196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af4068d0-a9ff-42aa-be7e-d03a002d1772 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.227962 Mar 29 03:00:31.388785 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2922/6079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:31 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:32.409887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:32.410568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:32.417878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:32.426759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:32.426759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:32.426759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:32.620014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:32.628591 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-314c6c59-40aa-48e1-8630-7f32ccfabef8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.223093 Mar 29 03:00:32.629466 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3158/6080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:32 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:33.645846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:33.646492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:33.653882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:33.654336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:33.655098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:33.655535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:33.865687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:33.873672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6640fc63-9549-43f8-a361-71ad18cb741a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.231551 Mar 29 03:00:33.874244 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2923/6081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:33 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:00:34.891570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:34.892189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:34.900370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:34.900823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:34.901629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:34.902065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:35.099623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:35.107974 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e9c5fcd-d899-4402-9b64-a87282b1d52c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.220839 Mar 29 03:00:35.108533 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3159/6082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:34 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:36.125417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:36.126157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:36.134064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:36.134517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:36.135304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:36.135748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:36.481763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:36.491184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71dc0d72-085a-456e-91cb-013c07441979 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1342 microversion: 2.1 time: 0.369359 Mar 29 03:00:36.491773 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2924/6083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:36 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1342 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:37.507868 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:37.508408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:37.515737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:37.516173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:37.516948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:37.517375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:37.727964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:37.736702 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f150c7f-76c5-4122-a4f8-2ab802e8ce7c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.232527 Mar 29 03:00:37.737287 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3160/6084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:37 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:38.753373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:38.754088 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:38.761372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:38.761898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:38.763538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:38.763538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:38.955797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:38.963943 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d398fbdf-8f79-4135-9be0-001d648875ec tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.214350 Mar 29 03:00:38.964510 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2925/6085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:38 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:39.980145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:39.980684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:39.987820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:39.988514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:39.989355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:39.989778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:40.185902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:40.194928 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e382ae0b-331f-4c5f-a798-86caf74fc5bb tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.218628 Mar 29 03:00:40.195487 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3161/6086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:39 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:41.211568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:41.212180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:41.220159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:41.220609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:41.221396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:41.221833 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:41.423053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:41.431129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-919bd5a3-d727-4a22-9fe1-da579944453f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.223212 Mar 29 03:00:41.434995 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2926/6087] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:41 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:42.448005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:42.448635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:42.456658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:42.457130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:42.457934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:42.458362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:42.650300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:42.659083 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43d7c6cd-b8a2-461c-83b2-069c5846e323 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.214731 Mar 29 03:00:42.663627 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3162/6088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:42 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:43.677099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:43.677738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:43.685577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:43.686034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:43.686812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:43.687458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:44.036826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:44.045087 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21f681fb-0751-4834-ab46-128f139bf944 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.372675 Mar 29 03:00:44.045642 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2927/6089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:43 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:45.061825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:45.062400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:45.069556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:45.069994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:45.070755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:45.071181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:45.273816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:45.282092 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcab8ff9-6e1a-4090-8576-c1f08b025934 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.223989 Mar 29 03:00:45.283139 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3163/6090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:45 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:46.299072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:46.299687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:46.306966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:46.307417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:46.308175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:46.308611 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:46.504566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:46.513070 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3185722f-52c9-44fb-9285-7dcafbb46689 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.218156 Mar 29 03:00:46.513614 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2928/6091] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:46 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:47.081912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-36ac377b-acb7-4cf3-9f71-42c968436ea0 req-d03fae0f-058c-4715-8ac7-3c809ab8443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ce1393-0dcc-4f3d-8c10-eab17b092e57", "name": "network-vif-plugged", "status": "completed", "tag": "753cdb65-6b04-45d8-822a-6d6cfbf8c6a9"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:00:47.083479 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:00:47.083479 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:00:47.091612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-36ac377b-acb7-4cf3-9f71-42c968436ea0 req-d03fae0f-058c-4715-8ac7-3c809ab8443a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:47.092065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-36ac377b-acb7-4cf3-9f71-42c968436ea0 req-d03fae0f-058c-4715-8ac7-3c809ab8443a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:47.108256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-36ac377b-acb7-4cf3-9f71-42c968436ea0 req-d03fae0f-058c-4715-8ac7-3c809ab8443a service nova] Creating event network-vif-plugged:753cdb65-6b04-45d8-822a-6d6cfbf8c6a9 for instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 on n-h2-828148-1 Mar 29 03:00:47.114206 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-36ac377b-acb7-4cf3-9f71-42c968436ea0 req-d03fae0f-058c-4715-8ac7-3c809ab8443a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036749 Mar 29 03:00:47.114767 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3164/6092] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:00:47.530187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:47.530765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:47.538118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:47.538580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:47.539351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:47.539796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:47.739677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:47.747758 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7d58e05-6d8f-4674-955c-2418c991a8a2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1376 microversion: 2.1 time: 0.221282 Mar 29 03:00:47.748318 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2929/6093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:47 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1376 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:48.765728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:48.766371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:48.774590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:48.775032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:48.775790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:48.776222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:48.969435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:48.978058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a606d1a4-5e53-4d6b-8a96-3784ee2198da tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1562 microversion: 2.1 time: 0.216198 Mar 29 03:00:48.978264 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3165/6094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:48 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:48.994447 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:48.995508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:49.002940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.003399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.004185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.004690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.198866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:49.207131 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7acb9d7-e2e9-41c1-92be-a1421378d29e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1562 microversion: 2.1 time: 0.216388 Mar 29 03:00:49.207688 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2930/6095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:48 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:49.305841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:49.306336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:49.314547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.314547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.315285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.315707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.375120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:00:49.665738 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3746f9f-b937-4e38-9bba-4c2a2260cf7b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 204 len: 0 microversion: 2.1 time: 0.363296 Mar 29 03:00:49.666376 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3166/6096] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:00:49 2022] DELETE /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:00:49.674784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:49.675404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:49.682869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.683322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.684112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:49.684555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:49.882195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:49.890671 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb2a435b-c906-4f7a-8c7c-153a2c5f488f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1568 microversion: 2.1 time: 0.220081 Mar 29 03:00:49.891253 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2931/6097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:49 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:50.911436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:50.913893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:50.919408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:50.919853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:50.920617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:50.921073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:51.119397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:51.128108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9526112c-ccbe-43f0-aac8-7e1767f34165 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1568 microversion: 2.1 time: 0.221451 Mar 29 03:00:51.128676 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3167/6098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:50 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:52.101316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8e16b63e-fe59-4515-86b4-6db09218a2f9 req-0698893b-cff5-4562-95a8-17a8f5608e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92ce1393-0dcc-4f3d-8c10-eab17b092e57", "name": "network-vif-deleted", "tag": "753cdb65-6b04-45d8-822a-6d6cfbf8c6a9"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:00:52.103396 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:00:52.103396 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:00:52.113106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8e16b63e-fe59-4515-86b4-6db09218a2f9 req-0698893b-cff5-4562-95a8-17a8f5608e04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:52.113868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8e16b63e-fe59-4515-86b4-6db09218a2f9 req-0698893b-cff5-4562-95a8-17a8f5608e04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:52.139292 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8e16b63e-fe59-4515-86b4-6db09218a2f9 req-0698893b-cff5-4562-95a8-17a8f5608e04 service nova] Creating event network-vif-deleted:753cdb65-6b04-45d8-822a-6d6cfbf8c6a9 for instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 on n-h2-828148-1 Mar 29 03:00:52.145719 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8e16b63e-fe59-4515-86b4-6db09218a2f9 req-0698893b-cff5-4562-95a8-17a8f5608e04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048209 Mar 29 03:00:52.145961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:52.147110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2932/6099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:00:52.147253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:52.155311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:52.156301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:52.156814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:52.157806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:52.383302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:52.392227 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce9e788f-af6d-4aea-9fac-866573a6c16d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1526 microversion: 2.1 time: 0.250101 Mar 29 03:00:52.392795 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3168/6100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:52 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1526 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:53.410556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:53.411272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:53.419042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:53.419525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:53.420302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:53.420744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:53.492785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:53.493265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:53.493729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid 92ce1393-0dcc-4f3d-8c10-eab17b092e57 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:00:53.552858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:53.561320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4596ecee-df03-4575-ae15-c286eb58841e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 200 len: 1366 microversion: 2.1 time: 0.156002 Mar 29 03:00:53.561958 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2933/6101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:53 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:54.579366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:54.583406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:54.592529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:54.593009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:54.593822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:54.594254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:54.646754 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. Mar 29 03:00:54.647363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:00:54.648178 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-90993b4e-8c55-437b-96cb-3afcedc6e692 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 404 len: 111 microversion: 2.1 time: 0.072803 Mar 29 03:00:54.648728 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3169/6102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:54 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:00:58.072561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:58.073096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:58.081070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:58.081541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:58.083463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:58.083463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:58.142384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:00:58.430817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f10ba72b-5911-46dc-920a-c4d95ee5a1bf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 204 len: 0 microversion: 2.1 time: 0.361716 Mar 29 03:00:58.431416 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2934/6103] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:00:58 2022] DELETE /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:00:58.439384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:58.439991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:58.448081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:58.448595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:58.449401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:58.449825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:58.646583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:58.655044 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9a7b06f-29d4-4ef8-88ef-59e87f838fe4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1407 microversion: 2.1 time: 0.219350 Mar 29 03:00:58.655595 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3170/6104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:58 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:00:59.672205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:00:59.672958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:00:59.680374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:59.680821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:59.681693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:00:59.682132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:00:59.882506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:00:59.890608 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a6d7325-6336-4d54-a830-ae4bff47a34d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1407 microversion: 2.1 time: 0.222522 Mar 29 03:00:59.891156 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2935/6105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:00:59 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:00.907257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:00.907917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:00.915675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:00.916113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:00.916882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:00.917317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:01.036946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:01.046097 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1db99177-4d98-4918-914b-8a09e5bd66b3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1365 microversion: 2.1 time: 0.142466 Mar 29 03:01:01.046671 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3171/6106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:00 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:01.110875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d772a744-f207-4ce3-b27b-73df0c88635e req-7b64e4a1-9e7e-46db-b21d-e33b3c544e68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58ca3279-bfc3-42b2-bc06-a7afe3afa994", "name": "network-vif-deleted", "tag": "22eb93af-6f32-4496-8653-fc794f25e9cb"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:01.113366 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:01:01.113366 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:01:01.121824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d772a744-f207-4ce3-b27b-73df0c88635e req-7b64e4a1-9e7e-46db-b21d-e33b3c544e68 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:01.122298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d772a744-f207-4ce3-b27b-73df0c88635e req-7b64e4a1-9e7e-46db-b21d-e33b3c544e68 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:01.137703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d772a744-f207-4ce3-b27b-73df0c88635e req-7b64e4a1-9e7e-46db-b21d-e33b3c544e68 service nova] Creating event network-vif-deleted:22eb93af-6f32-4496-8653-fc794f25e9cb for instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 on n-h1-828148-1 Mar 29 03:01:01.142460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d772a744-f207-4ce3-b27b-73df0c88635e req-7b64e4a1-9e7e-46db-b21d-e33b3c544e68 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035249 Mar 29 03:01:01.143086 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2936/6107] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:01:02.065610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:02.066185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:02.074381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:02.074771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:02.075547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:02.075975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:02.147269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:02.147711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:02.148160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid 58ca3279-bfc3-42b2-bc06-a7afe3afa994 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:01:02.204961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:02.213467 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15322fdd-c459-4313-b505-cdc386b8715a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 200 len: 1206 microversion: 2.1 time: 0.151562 Mar 29 03:01:02.214029 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3172/6108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:02 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 1206 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:03.231308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:03.231945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:03.240195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:03.240651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:03.241455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:03.241897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:03.290826 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. Mar 29 03:01:03.291359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:01:03.292195 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-879405c5-9a48-484a-b676-f9d87b15e148 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 404 len: 111 microversion: 2.1 time: 0.065195 Mar 29 03:01:03.292731 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2937/6109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:03 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:01:04.438967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:04.439467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:04.446882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:04.447332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:04.448107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:04.448544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:04.498506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. Mar 29 03:01:04.499118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:01:04.499949 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a6fddb6a-b3dd-4d6d-8414-ea897a67ec8a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 404 len: 111 microversion: 2.1 time: 0.064654 Mar 29 03:01:04.500500 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3173/6110] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:01:04 2022] DELETE /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:01:04.508410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:04.509070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 92ce1393-0dcc-4f3d-8c10-eab17b092e57] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:04.516284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:04.516741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:04.517555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:04.518004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:04.567366 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. Mar 29 03:01:04.567902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 92ce1393-0dcc-4f3d-8c10-eab17b092e57 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:01:04.568748 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e6f96b2d-9407-4a1a-8d2c-fcea86ba20b6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57" status: 404 len: 111 microversion: 2.1 time: 0.064015 Mar 29 03:01:04.569327 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2938/6111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:04 2022] GET /compute/v2.1/servers/92ce1393-0dcc-4f3d-8c10-eab17b092e57 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:01:05.348164 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:05.348995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:05.356126 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:05.356564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:05.357382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:05.357892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:05.407239 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. Mar 29 03:01:05.407858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:01:05.408663 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38303f84-4d89-47c3-8416-ee73ef88b3f0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 404 len: 111 microversion: 2.1 time: 0.064211 Mar 29 03:01:05.409215 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3174/6112] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:01:05 2022] DELETE /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:01:05.417399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:05.418080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 58ca3279-bfc3-42b2-bc06-a7afe3afa994] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:05.425385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:05.425840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:05.427111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:05.427535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:05.475587 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. Mar 29 03:01:05.476180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 58ca3279-bfc3-42b2-bc06-a7afe3afa994 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:01:05.477018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-309ca896-30e2-4699-b74d-dc607e807d1b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994" status: 404 len: 111 microversion: 2.1 time: 0.063325 Mar 29 03:01:05.477536 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2939/6113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:05 2022] GET /compute/v2.1/servers/58ca3279-bfc3-42b2-bc06-a7afe3afa994 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 03:01:05.611009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: .version_select at 0x7f87242e8d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1832022428"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:05.633158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:01:05.638159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:01:06.008385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:01:06.013599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:01:06.027841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e79c323d-0661-49c0-8fc9-edd9d913ebe1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.420545 Mar 29 03:01:06.028457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3175/6114] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:01:05 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:31.889272 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:01:31.892566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-158912120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832022428", "security_groups": [{"name": "tempest-secgroup-smoke-874966737"}], "block_device_mapping_v2": [{"uuid": "433557cf-9846-4f76-8c1b-26118694b7df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:32.035718 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:01:32.035878 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Mar 29 03:01:32.047371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:01:32.178090 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:01:32.178090 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.36) !!! Mar 29 03:01:32.692654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:01:32.693129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:01:32.693622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:01:32.694045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:01:32.694495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:01:32.702959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:32.703406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:32.704206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:32.704660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:32.722148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:01:32.727241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:01:32.815384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:01:32.817537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='433557cf-9846-4f76-8c1b-26118694b7df',volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:01:32.895983 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55656. Mar 29 03:01:33.193646 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b37207ef-e4e2-407a-885d-2061c35c93c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.305862 Mar 29 03:01:33.194304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2940/6115] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:01:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:01:33.202632 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:01:33.206417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2f658bc3-53da-4499-a4f0-73e479356688 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:33.207019 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2f658bc3-53da-4499-a4f0-73e479356688 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:33.282347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2f658bc3-53da-4499-a4f0-73e479356688 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:33.289672 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2f658bc3-53da-4499-a4f0-73e479356688 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1094 microversion: 2.1 time: 0.088589 Mar 29 03:01:33.290250 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3176/6116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:33 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:34.307500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:34.308125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:34.315839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:34.316307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:34.317143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:34.317621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:34.429299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:34.438049 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f93c7814-22b5-4f4d-9814-5c2fa603b080 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1144 microversion: 2.1 time: 0.135005 Mar 29 03:01:34.438637 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2941/6117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:34 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1144 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:35.455307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:35.455930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:35.466865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:35.467329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:35.468151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:35.468671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:35.509093 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55676. Mar 29 03:01:35.751831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:35.761147 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8066468e-c305-493f-89c4-665b308c6410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1210 microversion: 2.1 time: 0.309996 Mar 29 03:01:35.761720 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3177/6118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:35 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:36.778318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:36.779086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:36.786452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:36.787141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:36.787935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:36.788383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:37.205631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:37.214125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aa7edba2-a090-45db-9d07-24653a6d4c1a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1277 microversion: 2.1 time: 0.440147 Mar 29 03:01:37.214695 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2942/6119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:36 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1277 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:37.804784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4007e3bb-b9c1-47e7-841b-be8248f4a3a0 req-d5242cc4-6cff-4a70-a0d6-f7c1ea753612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1ec3c3-86f1-422c-b178-f219e34754a9", "tag": "5cc9bc13-69ee-4b33-8717-3e62c8e51290"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:37.806325 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:01:37.806325 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:01:37.814718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4007e3bb-b9c1-47e7-841b-be8248f4a3a0 req-d5242cc4-6cff-4a70-a0d6-f7c1ea753612 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:37.815155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4007e3bb-b9c1-47e7-841b-be8248f4a3a0 req-d5242cc4-6cff-4a70-a0d6-f7c1ea753612 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:37.830999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4007e3bb-b9c1-47e7-841b-be8248f4a3a0 req-d5242cc4-6cff-4a70-a0d6-f7c1ea753612 service nova] Creating event network-changed:5cc9bc13-69ee-4b33-8717-3e62c8e51290 for instance ea1ec3c3-86f1-422c-b178-f219e34754a9 on n-h1-828148-1 Mar 29 03:01:37.835933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4007e3bb-b9c1-47e7-841b-be8248f4a3a0 req-d5242cc4-6cff-4a70-a0d6-f7c1ea753612 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115527 Mar 29 03:01:37.836516 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3178/6120] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:01:38.230883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:38.233158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:38.240790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:38.241343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:38.242179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:38.242773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:38.624020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:38.632281 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f2547f6-78e8-48cf-8436-bbd3a8d63193 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.405402 Mar 29 03:01:38.632893 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2943/6121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:38 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:39.650937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:39.651638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:39.659191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:39.659672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:39.660436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:39.660887 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:39.924021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:39.932883 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ef2a5cdc-bf6f-47c6-b633-fb7cda485fee tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.286658 Mar 29 03:01:39.933431 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3179/6122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:39 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:40.949655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:40.950229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:40.957577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:40.958031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:40.958800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:40.959242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:41.155009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:41.163019 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60e52254-1110-486b-ac60-0628ab11fa54 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.217134 Mar 29 03:01:41.163579 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2944/6123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:40 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:42.179662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:42.180274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:42.187602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:42.188044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:42.188802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:42.189257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:42.381530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:42.389591 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e767e2a-02c6-48c8-99da-ee6a3784ff5c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.213645 Mar 29 03:01:42.390141 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3180/6124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:42 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:01:43.406327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:43.406971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:43.415102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:43.416351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:43.417187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:43.417632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:43.613897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:43.622960 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ab46f47-e802-4e3f-bfca-fca3e333f770 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.220317 Mar 29 03:01:43.632393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2945/6125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:43 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:44.639499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:44.640118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:44.647350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:44.650515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:44.650515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:44.650515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:44.845377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:44.858091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-47099ad1-4422-4c6b-a024-ee394dbd8e14 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.218244 Mar 29 03:01:44.858091 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3181/6126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:44 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:45.871331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:45.871969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:45.879243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:45.879703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:45.880470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:45.880936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:46.077142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:46.085110 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a148319c-b947-4c43-a30a-1f32be694512 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.217900 Mar 29 03:01:46.085665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2946/6127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:45 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:47.101467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:47.102073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:47.109366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:47.109803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:47.110809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:47.111234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:47.302118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:47.310539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-607d71df-39c6-418d-98b1-74738cda2419 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.212662 Mar 29 03:01:47.311250 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3182/6128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:47 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:48.327671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:48.328434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:48.339913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:48.341385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:48.341385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:48.341800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:48.541285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:48.549455 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-52274c43-fe10-4689-9829-c35a178bfd86 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.225688 Mar 29 03:01:48.550010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2947/6129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:48 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:49.566142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:49.566783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:49.574173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:49.574608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:49.575360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:49.575781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:49.769044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:49.777482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89d1cd2e-d50f-43a6-8e3e-2501b75a8248 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.214987 Mar 29 03:01:49.778030 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3183/6130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:49 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:50.703143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-96adeaef-c776-4d76-8fdc-8b400fcef833 req-20275ee2-2b29-4f38-b277-8aee14748714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ec3c3-86f1-422c-b178-f219e34754a9", "name": "network-vif-plugged", "status": "completed", "tag": "5cc9bc13-69ee-4b33-8717-3e62c8e51290"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:50.704574 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:01:50.704574 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:01:50.712821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-96adeaef-c776-4d76-8fdc-8b400fcef833 req-20275ee2-2b29-4f38-b277-8aee14748714 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:50.714939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-96adeaef-c776-4d76-8fdc-8b400fcef833 req-20275ee2-2b29-4f38-b277-8aee14748714 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:50.728676 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-96adeaef-c776-4d76-8fdc-8b400fcef833 req-20275ee2-2b29-4f38-b277-8aee14748714 service nova] Creating event network-vif-plugged:5cc9bc13-69ee-4b33-8717-3e62c8e51290 for instance ea1ec3c3-86f1-422c-b178-f219e34754a9 on n-h1-828148-1 Mar 29 03:01:50.733371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-96adeaef-c776-4d76-8fdc-8b400fcef833 req-20275ee2-2b29-4f38-b277-8aee14748714 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097549 Mar 29 03:01:50.734107 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2948/6131] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:01:50.794899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:50.795579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:50.802930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:50.803593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:50.804395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:50.804830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:51.004244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:51.012293 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1bca0dd-06a4-4621-927f-ca2011b22122 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.221901 Mar 29 03:01:51.012848 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3184/6132] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:50 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:52.029399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:52.030100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:52.037569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:52.038795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:52.039628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:52.040475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:52.241516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:52.250321 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7c91f01-e931-4703-966a-29c0f0285642 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1265 microversion: 2.1 time: 0.225134 Mar 29 03:01:52.250890 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2949/6133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:52 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:53.266876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:53.267490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:53.275437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:53.275881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:53.276636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:53.277094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:53.468032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:53.476151 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d4aee6a-757c-4c91-ab60-8e858349894c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1450 microversion: 2.1 time: 0.212929 Mar 29 03:01:53.476698 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3185/6134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:53 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:01:53.492272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:01:53.493001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:01:53.500705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:53.501202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:53.501975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:53.502422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:53.697364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:01:53.705979 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a24b5bec-90e3-4332-9d0d-44cbf3ff673c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1450 microversion: 2.1 time: 0.217362 Mar 29 03:01:53.706534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2950/6135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:01:53 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1450 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:01:56.556337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d2813c95-78cb-40e1-9e46-adde974c503e req-9616b1e5-d3d4-4173-8ab3-fb494c2d934c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1ec3c3-86f1-422c-b178-f219e34754a9", "tag": "5cc9bc13-69ee-4b33-8717-3e62c8e51290"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:01:56.557872 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:01:56.557872 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:01:56.565966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d2813c95-78cb-40e1-9e46-adde974c503e req-9616b1e5-d3d4-4173-8ab3-fb494c2d934c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:01:56.566411 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d2813c95-78cb-40e1-9e46-adde974c503e req-9616b1e5-d3d4-4173-8ab3-fb494c2d934c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:01:56.582418 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d2813c95-78cb-40e1-9e46-adde974c503e req-9616b1e5-d3d4-4173-8ab3-fb494c2d934c service nova] Creating event network-changed:5cc9bc13-69ee-4b33-8717-3e62c8e51290 for instance ea1ec3c3-86f1-422c-b178-f219e34754a9 on n-h1-828148-1 Mar 29 03:01:56.587227 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d2813c95-78cb-40e1-9e46-adde974c503e req-9616b1e5-d3d4-4173-8ab3-fb494c2d934c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092419 Mar 29 03:01:56.588115 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3186/6136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:03:09.700078 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:03:09.700665 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:03:09.703282 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:03:09.703653 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:04:34.352812 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:04:34.357624 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:04:34.404097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:34.404730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:34.412570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:34.413072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:34.413852 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:34.414298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:34.474745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:04:34.738519 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:04:35.363029 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55800. Mar 29 03:04:35.366933 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55802. Mar 29 03:04:35.745872 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55804. Mar 29 03:04:35.815298 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d2fe37b-0124-4224-9b6c-1cd6b76698d0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 204 len: 0 microversion: 2.1 time: 1.463796 Mar 29 03:04:35.815874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2951/6137] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:04:34 2022] DELETE /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 0 bytes in 1465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 03:04:35.821779 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:04:35.822609 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:04:35.826267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:35.827108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:35.836242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:35.836684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:35.837651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:35.838532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:36.084053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:36.093390 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38b4fb0b-e67f-4660-8b28-d07ef8c701b4 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1575 microversion: 2.1 time: 0.272079 Mar 29 03:04:36.093390 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3187/6138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:35 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:37.110804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:37.111566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:37.119316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:37.119766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:37.120524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:37.120987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:37.366351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:37.374396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aa75b362-0406-4b3e-8267-f3f58c030e57 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1575 microversion: 2.1 time: 0.267667 Mar 29 03:04:37.374945 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2952/6139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:37 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1575 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:38.391505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:38.392112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:38.407528 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55816. Mar 29 03:04:38.416435 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 55818. Mar 29 03:04:38.420379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:38.420826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:38.421632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:38.422062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:38.541746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:38.550514 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ac3fd76-cefc-4b4a-b726-215ae9d17ca3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1508 microversion: 2.1 time: 0.162843 Mar 29 03:04:38.554155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3188/6140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:38 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:39.041178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d453c651-fccf-425a-87b9-1ced9b697006 req-afe92416-b14c-4bb9-a93b-86e984fb4c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1ec3c3-86f1-422c-b178-f219e34754a9", "name": "network-vif-deleted", "tag": "5cc9bc13-69ee-4b33-8717-3e62c8e51290"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:04:39.046453 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:04:39.046453 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:04:39.051646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d453c651-fccf-425a-87b9-1ced9b697006 req-afe92416-b14c-4bb9-a93b-86e984fb4c73 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:39.052104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d453c651-fccf-425a-87b9-1ced9b697006 req-afe92416-b14c-4bb9-a93b-86e984fb4c73 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:39.069739 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d453c651-fccf-425a-87b9-1ced9b697006 req-afe92416-b14c-4bb9-a93b-86e984fb4c73 service nova] Creating event network-vif-deleted:5cc9bc13-69ee-4b33-8717-3e62c8e51290 for instance ea1ec3c3-86f1-422c-b178-f219e34754a9 on n-h1-828148-1 Mar 29 03:04:39.074652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d453c651-fccf-425a-87b9-1ced9b697006 req-afe92416-b14c-4bb9-a93b-86e984fb4c73 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037222 Mar 29 03:04:39.075280 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2953/6141] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:04:39.571962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:39.573655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:39.582219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:39.583046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:39.584807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:39.585463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:39.711495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:39.719911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e50e6b6b-0a19-4bff-a5a0-309703b7c4d5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 200 len: 1225 microversion: 2.1 time: 0.156153 Mar 29 03:04:39.720470 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3189/6142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:39 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:40.736467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:40.737237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:40.744708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:40.745196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:40.745972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:40.746415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:40.795422 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. Mar 29 03:04:40.796025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:04:40.796863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4cd9fc6e-df01-4f58-91f0-17e74154ea11 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 404 len: 111 microversion: 2.1 time: 0.064540 Mar 29 03:04:40.797395 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2954/6143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:40 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:04:40.846047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-815100308", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832022428", "security_groups": [{"name": "tempest-secgroup-smoke-874966737"}], "block_device_mapping_v2": [{"uuid": "433557cf-9846-4f76-8c1b-26118694b7df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:04:40.990209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:04:41.547948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:04:41.548372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:04:41.548894 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:04:41.549941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:04:41.550357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:04:41.558577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:41.559012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:41.559800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:41.560225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:41.576829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:04:41.581957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:04:41.670255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:04:41.672358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='433557cf-9846-4f76-8c1b-26118694b7df',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:04:42.143400 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3fd90e30-5034-4d13-9a0e-6781913dc4e2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.300392 Mar 29 03:04:42.144021 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3190/6144] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:04:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:04:42.153751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a083931-e6be-4c88-a336-edd452e034f1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:42.154372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a083931-e6be-4c88-a336-edd452e034f1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:42.292262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a083931-e6be-4c88-a336-edd452e034f1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:42.299602 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a083931-e6be-4c88-a336-edd452e034f1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1094 microversion: 2.1 time: 0.149537 Mar 29 03:04:42.300155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2955/6145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:42 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1094 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:04:43.316774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:43.317441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:43.326100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:43.326552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:43.327361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:43.327793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:43.442243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:43.452674 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6c57ea10-db63-45f6-9bc2-4734d8e10b9c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1144 microversion: 2.1 time: 0.138779 Mar 29 03:04:43.452674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3191/6146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:43 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1144 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:44.469000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:44.469717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:44.478255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:44.479019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:44.479780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:44.480308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:44.622285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:44.633125 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a520008e-a559-4675-9d43-195b252ccdc8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1210 microversion: 2.1 time: 0.167525 Mar 29 03:04:44.635948 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2956/6147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:44 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1210 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:45.652299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:45.653551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:45.664233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:45.664767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:45.665784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:45.666294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:45.868969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:45.883378 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18f49f92-3ee1-4b81-942c-aed61b422d45 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1277 microversion: 2.1 time: 0.236212 Mar 29 03:04:45.892566 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3192/6148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:45 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:46.516112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d2a1088e-efe6-4f0f-b902-16782688797b req-5bc46ffd-43be-4e74-bea7-9c54c2c0a0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b05e51-ee51-48cd-a935-dd7600943550", "tag": "90aaff2d-a52d-47c1-b626-cc9dfb2847d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:04:46.519085 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:04:46.519085 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:04:46.527904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d2a1088e-efe6-4f0f-b902-16782688797b req-5bc46ffd-43be-4e74-bea7-9c54c2c0a0fc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:46.528424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d2a1088e-efe6-4f0f-b902-16782688797b req-5bc46ffd-43be-4e74-bea7-9c54c2c0a0fc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:46.545822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d2a1088e-efe6-4f0f-b902-16782688797b req-5bc46ffd-43be-4e74-bea7-9c54c2c0a0fc service nova] Creating event network-changed:90aaff2d-a52d-47c1-b626-cc9dfb2847d6 for instance 56b05e51-ee51-48cd-a935-dd7600943550 on n-h1-828148-1 Mar 29 03:04:46.550831 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d2a1088e-efe6-4f0f-b902-16782688797b req-5bc46ffd-43be-4e74-bea7-9c54c2c0a0fc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039748 Mar 29 03:04:46.551668 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2957/6149] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:04:46.899745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:46.900354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:46.907630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:46.909951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:46.909951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:46.909951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:47.102959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:47.112216 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d38a40e-20ac-47e6-bfbd-40644c8aaed7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.215697 Mar 29 03:04:47.112788 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3193/6150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:46 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:48.128975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:48.129689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:48.137250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:48.137709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:48.138479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:48.138924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:48.397598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:48.405652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9f23ac24-fa67-4f83-81c3-30eaecb82d5b tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.280969 Mar 29 03:04:48.406233 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2958/6151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:48 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:49.422391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:49.423011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:49.430275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:49.430722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:49.431484 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:49.431921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:49.737459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:49.745548 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2da05f73-5a62-4dda-9221-7671b4cbfe35 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.326976 Mar 29 03:04:49.746097 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3194/6152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:49 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:50.762786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:50.763411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:50.771278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:50.771740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:50.772516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:50.772991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:50.967556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:50.976212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9db63fc8-82d2-4b5e-a1d5-1c14bf198d52 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.217173 Mar 29 03:04:50.976770 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2959/6153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:50 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:51.993026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:51.993537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:52.000682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:52.001155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:52.001909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:52.002332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:52.045854 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:04:52.046403 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:04:52.189172 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:04:52.189344 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:04:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:04:52.200647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:52.208678 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4459fa0-9dc3-4123-90c0-73a274893683 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.219409 Mar 29 03:04:52.209257 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3195/6154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:51 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:04:53.225710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:53.226329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:53.233859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:53.234312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:53.235100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:53.235522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:53.429916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:53.438036 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82182da4-b867-4ca4-8431-874d0b3427f5 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.216609 Mar 29 03:04:53.438611 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2960/6155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:53 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:54.455025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:54.455641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:54.462926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:54.463364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:54.464114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:54.464541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:54.655886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:54.664608 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a2096464-c3a0-4bf5-83c9-ee73a63abff3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.213268 Mar 29 03:04:54.666018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3196/6156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:54 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:55.681246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:55.681868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:55.689373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:55.689850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:55.690618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:55.691058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:55.889859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:55.898066 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3758e543-7dfd-4d79-99c5-9c866e3d69c3 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.220541 Mar 29 03:04:55.898622 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2961/6157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:55 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:56.914832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:56.915474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:56.922801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:56.923252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:56.924015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:56.924442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:57.121193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:57.129751 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-49670f28-aa35-40aa-93ca-753d43aa89e7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.218594 Mar 29 03:04:57.130304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3197/6158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:56 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:58.146480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:58.147020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:58.154179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:58.154629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:58.155396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:58.155831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:58.349773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:58.358015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-893b9c16-ce0c-4b49-8ea9-08b55d8b9410 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.215374 Mar 29 03:04:58.358562 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2962/6159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:58 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:59.373897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:04:59.376876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:04:59.382545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:59.382982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:59.383828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:59.384252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:59.589125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:04:59.597967 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-77dd2949-cbe8-4b51-a93f-6e8cd131f66f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.227177 Mar 29 03:04:59.598475 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3198/6160] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:04:59 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:04:59.646374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-86bde6d3-eae4-4df3-8a8b-fe0428b81214 req-535d3437-fbb1-4605-a5d7-6037cecdf826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b05e51-ee51-48cd-a935-dd7600943550", "name": "network-vif-plugged", "status": "completed", "tag": "90aaff2d-a52d-47c1-b626-cc9dfb2847d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:04:59.648181 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:04:59.648181 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:04:59.656339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-86bde6d3-eae4-4df3-8a8b-fe0428b81214 req-535d3437-fbb1-4605-a5d7-6037cecdf826 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:04:59.656817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-86bde6d3-eae4-4df3-8a8b-fe0428b81214 req-535d3437-fbb1-4605-a5d7-6037cecdf826 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:04:59.672726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-86bde6d3-eae4-4df3-8a8b-fe0428b81214 req-535d3437-fbb1-4605-a5d7-6037cecdf826 service nova] Creating event network-vif-plugged:90aaff2d-a52d-47c1-b626-cc9dfb2847d6 for instance 56b05e51-ee51-48cd-a935-dd7600943550 on n-h1-828148-1 Mar 29 03:04:59.678090 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-86bde6d3-eae4-4df3-8a8b-fe0428b81214 req-535d3437-fbb1-4605-a5d7-6037cecdf826 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035364 Mar 29 03:04:59.678664 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2963/6161] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:05:00.616028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:05:00.616632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:05:00.623998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:00.624433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:00.625213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:00.625635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:00.820181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:05:00.828214 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2724da2e-e9ae-4f4a-b6a3-dde8af490055 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1265 microversion: 2.1 time: 0.216334 Mar 29 03:05:00.828747 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3199/6162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:05:00 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:05:01.845354 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:05:01.846056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:05:01.853831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:01.854295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:01.855064 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:01.855512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:02.050876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:05:02.059263 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-baa11b27-dc1e-4505-bdc8-fb8f732caa8c tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1451 microversion: 2.1 time: 0.218016 Mar 29 03:05:02.059825 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2964/6163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:05:01 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:05:02.078399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:05:02.079067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:05:02.086726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:02.087179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:02.087948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:02.088380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:02.286320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:05:02.294339 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9f2be110-9d15-4916-9734-15ef4737653f tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1451 microversion: 2.1 time: 0.219654 Mar 29 03:05:02.294887 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3200/6164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:05:02 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:05:05.027905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-73959a53-839d-4599-9e7d-8f6c4adfec39 req-291062dd-b239-4236-913b-f036bb010558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b05e51-ee51-48cd-a935-dd7600943550", "tag": "90aaff2d-a52d-47c1-b626-cc9dfb2847d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:05:05.029422 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:05:05.029422 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:05:05.038793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-73959a53-839d-4599-9e7d-8f6c4adfec39 req-291062dd-b239-4236-913b-f036bb010558 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:05:05.039429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-73959a53-839d-4599-9e7d-8f6c4adfec39 req-291062dd-b239-4236-913b-f036bb010558 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:05:05.055670 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-73959a53-839d-4599-9e7d-8f6c4adfec39 req-291062dd-b239-4236-913b-f036bb010558 service nova] Creating event network-changed:90aaff2d-a52d-47c1-b626-cc9dfb2847d6 for instance 56b05e51-ee51-48cd-a935-dd7600943550 on n-h1-828148-1 Mar 29 03:05:05.060551 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-73959a53-839d-4599-9e7d-8f6c4adfec39 req-291062dd-b239-4236-913b-f036bb010558 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036299 Mar 29 03:05:05.061226 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2965/6165] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:06:29.708223 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:06:29.712178 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:06:58.306767 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:06:58.307432 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:07:45.295764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1948227601", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1832022428", "security_groups": [{"name": "tempest-secgroup-smoke-874966737"}], "block_device_mapping_v2": [{"uuid": "0a1ea98a-1db6-4386-ab1c-f271c8c3e5f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a7162833-5c49-4ca8-b2f3-2e9afa05be67"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:07:45.307852 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:07:45.308582 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:07:45.675900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] validate_networks() for [('a7162833-5c49-4ca8-b2f3-2e9afa05be67', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:07:46.318285 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56050. Mar 29 03:07:46.323597 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56048. Mar 29 03:07:46.393159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:07:46.393582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:07:46.394051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:07:46.394456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:07:46.394862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:07:46.405279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:46.405719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:46.407106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:46.407530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:46.433249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:07:46.438381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Getting quotas for user 01595d91e0ce417ca6172cca18cf8fcf and project 960976da633c48d0b30476e140fbc13c. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:07:46.526476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:07:46.528640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a1ea98a-1db6-4386-ab1c-f271c8c3e5f4',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:07:46.987147 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63b506b3-1ea4-485f-bd0a-b882a41f0f37 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.695139 Mar 29 03:07:46.987790 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3201/6166] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:07:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:07:46.995823 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:07:47.004144 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:07:47.004144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f11346a7-d913-417e-8fce-00e02e2ea4c1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:47.004144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f11346a7-d913-417e-8fce-00e02e2ea4c1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:47.200905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f11346a7-d913-417e-8fce-00e02e2ea4c1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:47.214583 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f11346a7-d913-417e-8fce-00e02e2ea4c1 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1095 microversion: 2.1 time: 0.220205 Mar 29 03:07:47.215495 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2966/6167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:46 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1095 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:07:48.231515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:48.232136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:48.240210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:48.240592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:48.241401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:48.241840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:48.353771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:48.361375 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e77ae7f3-7be0-4e88-9ae8-3b325483fd53 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1145 microversion: 2.1 time: 0.133605 Mar 29 03:07:48.361945 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3202/6168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:48 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1145 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:49.378269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:49.381495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:49.389430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:49.390106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:49.391142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:49.391575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:49.422142 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56092. Mar 29 03:07:49.432141 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56094. Mar 29 03:07:49.518465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:49.526736 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f741ecf-fd40-455f-959b-e210d8e113c0 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1211 microversion: 2.1 time: 0.152181 Mar 29 03:07:49.527318 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2967/6169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:49 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1211 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:50.545908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:50.546508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:50.558246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:50.558696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:50.559585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:50.560024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:51.252555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:51.260880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6baca854-e8f5-4567-bf08-c273c4a40672 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1278 microversion: 2.1 time: 0.719106 Mar 29 03:07:51.261721 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3203/6170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:50 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1278 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:52.087267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae3d65b-d117-4d4e-8c97-c1d9ad147f27", "tag": "bbbc26c6-c141-4aff-806a-5117310c85d0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:07:52.088908 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:07:52.088908 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:07:52.097862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:52.098314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:52.117278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] Creating event network-changed:bbbc26c6-c141-4aff-806a-5117310c85d0 for instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 on n-h2-828148-1 Mar 29 03:07:52.120792 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:07:52.277970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:52.278586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:52.285949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:52.286423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:52.287190 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:52.287624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:52.635689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:52.644448 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01aba0cf-96b6-419a-ad80-72dd2ae936cf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.369807 Mar 29 03:07:52.644802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3204/6171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:52 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:07:53.128228 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56112. Mar 29 03:07:53.131355 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c6576fae-0597-453c-9c37-9579c84e4139 req-fb7acadd-1595-4019-a688-c128ff201741 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.106712 Mar 29 03:07:53.131960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2968/6172] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:07:53.666566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:53.667107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:53.674920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:53.675362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:53.676124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:53.676550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:54.047554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:54.056130 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-15280859-62fa-4794-9650-3a128bacab76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.393650 Mar 29 03:07:54.056697 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3205/6173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:53 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:55.073884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:55.074624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:55.082879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:55.083595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:55.084096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:55.084537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:55.280553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:55.288817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ec17909f-e9c2-431e-aa7d-efb8993c8d76 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.219054 Mar 29 03:07:55.289347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2969/6174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:55 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:56.306223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:56.306862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:56.314970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:56.315465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:56.316223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:56.316656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:56.592316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:56.592316 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c10fde72-24e0-4156-a3fe-6da6e39e9d7e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.225949 Mar 29 03:07:56.592316 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3206/6175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:56 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:57.589912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:57.590555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:57.598293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:57.598689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:57.599446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:57.599881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:57.799308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:57.807617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5b27780a-fb6d-4501-9daf-90f99b6d1857 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.221428 Mar 29 03:07:57.808174 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2970/6176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:57 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:07:58.825131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:07:58.825739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:07:58.833774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:58.834216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:58.834970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:07:58.835398 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:07:59.034381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:07:59.042520 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-86561523-4360-4db2-ab88-9bf8a2711cfd tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.221374 Mar 29 03:07:59.044943 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3207/6177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:07:58 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:00.059243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:00.059874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:00.067671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:00.069576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:00.069576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:00.069576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:00.268524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:00.276934 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-320c51fc-9104-47a4-9db8-0e106e753caf tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.221328 Mar 29 03:08:00.277506 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2971/6178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:00 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:01.293823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:01.297762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:01.301741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:01.302187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:01.302951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:01.303380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:01.498217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:01.507163 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d43434be-e7c8-4b20-ac6b-626456382bc6 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.216981 Mar 29 03:08:01.507725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3208/6179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:01 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:08:02.523680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:02.524296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:02.531525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:02.531976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:02.532736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:02.533688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:02.727760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:02.735923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8189c4c-c975-4a63-821d-f44a4c242c4e tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.215896 Mar 29 03:08:02.736498 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2972/6180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:02 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:03.542736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-17deb0b8-a2c8-4ff2-ae47-b53b71235999 req-f1fecb1b-7387-48a4-8029-048728d34288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae3d65b-d117-4d4e-8c97-c1d9ad147f27", "name": "network-vif-plugged", "status": "completed", "tag": "bbbc26c6-c141-4aff-806a-5117310c85d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:08:03.545406 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:08:03.545406 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:08:03.553078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-17deb0b8-a2c8-4ff2-ae47-b53b71235999 req-f1fecb1b-7387-48a4-8029-048728d34288 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:03.553521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-17deb0b8-a2c8-4ff2-ae47-b53b71235999 req-f1fecb1b-7387-48a4-8029-048728d34288 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:03.570318 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-17deb0b8-a2c8-4ff2-ae47-b53b71235999 req-f1fecb1b-7387-48a4-8029-048728d34288 service nova] Creating event network-vif-plugged:bbbc26c6-c141-4aff-806a-5117310c85d0 for instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 on n-h2-828148-1 Mar 29 03:08:03.576611 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-17deb0b8-a2c8-4ff2-ae47-b53b71235999 req-f1fecb1b-7387-48a4-8029-048728d34288 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083173 Mar 29 03:08:03.577333 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3209/6181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:08:03.753259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:03.753887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:03.761157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:03.762000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:03.762418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:03.762865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:03.963940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:03.972974 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-70e5ab2f-a369-4c57-8fa1-960146416f4a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1266 microversion: 2.1 time: 0.224019 Mar 29 03:08:03.973416 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2973/6182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:03 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:04.990799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:04.991495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:04.999219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:05.001335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:05.001335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:05.001335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:05.200059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:05.208783 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7fd625de-9f2e-4b60-9fc4-2e366a9e3ca7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1452 microversion: 2.1 time: 0.222651 Mar 29 03:08:05.209348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3210/6183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:04 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:05.225563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:08:05.226361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:08:05.233933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:05.235555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:05.235555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:05.235555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:05.436483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:08:05.444746 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-06cd9e37-3540-4082-95bc-2f7a48543795 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1452 microversion: 2.1 time: 0.223247 Mar 29 03:08:05.445344 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2974/6184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:08:05 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1452 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:08:08.506060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1a41b3a9-e403-499c-baf1-e5d4d434da29 req-ac2ba2a2-fb95-435d-9679-39f6c241c2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae3d65b-d117-4d4e-8c97-c1d9ad147f27", "tag": "bbbc26c6-c141-4aff-806a-5117310c85d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:08:08.507882 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:08:08.507882 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:08:08.516717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1a41b3a9-e403-499c-baf1-e5d4d434da29 req-ac2ba2a2-fb95-435d-9679-39f6c241c2ee service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:08:08.517199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1a41b3a9-e403-499c-baf1-e5d4d434da29 req-ac2ba2a2-fb95-435d-9679-39f6c241c2ee service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:08:08.533020 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1a41b3a9-e403-499c-baf1-e5d4d434da29 req-ac2ba2a2-fb95-435d-9679-39f6c241c2ee service nova] Creating event network-changed:bbbc26c6-c141-4aff-806a-5117310c85d0 for instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 on n-h2-828148-1 Mar 29 03:08:08.538398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1a41b3a9-e403-499c-baf1-e5d4d434da29 req-ac2ba2a2-fb95-435d-9679-39f6c241c2ee service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082287 Mar 29 03:08:08.538969 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3211/6185] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:08:12.055146 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:08:12.055632 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:08:12.197283 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:08:12.197433 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:08:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:09:49.718156 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:09:49.718805 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:09:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:10:24.837903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:24.839060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:24.840689 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:10:24.843170 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:10:24.846985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-57348229-526a-4580-999e-3f1437b4c638 req-10b1a564-7766-48ee-8aed-753bfabe19d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae3d65b-d117-4d4e-8c97-c1d9ad147f27", "tag": "bbbc26c6-c141-4aff-806a-5117310c85d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:10:24.848380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:24.848703 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:10:24.848703 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:10:24.848935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:24.849778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:24.850283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:24.862645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-57348229-526a-4580-999e-3f1437b4c638 req-10b1a564-7766-48ee-8aed-753bfabe19d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:24.863077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-57348229-526a-4580-999e-3f1437b4c638 req-10b1a564-7766-48ee-8aed-753bfabe19d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:24.879154 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-57348229-526a-4580-999e-3f1437b4c638 req-10b1a564-7766-48ee-8aed-753bfabe19d2 service nova] Creating event network-changed:bbbc26c6-c141-4aff-806a-5117310c85d0 for instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 on n-h2-828148-1 Mar 29 03:10:24.885774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-57348229-526a-4580-999e-3f1437b4c638 req-10b1a564-7766-48ee-8aed-753bfabe19d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047578 Mar 29 03:10:24.886549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3212/6186] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:10:24.913303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:10:25.178714 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a927700-100e-46d9-a67d-2c73f0de44d8 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 204 len: 0 microversion: 2.1 time: 0.345162 Mar 29 03:10:25.179600 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2975/6187] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:10:24 2022] DELETE /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:10:25.190787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:25.191573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:25.202814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:25.204448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:25.205338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:25.205774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:25.587500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:25.596533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48acceb3-71d0-4318-aff5-b4393ec6bfcc tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1575 microversion: 2.1 time: 0.411895 Mar 29 03:10:25.602136 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3213/6188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:25 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1575 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:26.615330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:26.616034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:26.623829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:26.624279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:26.625075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:26.625513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:26.819083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:26.827153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d64a8878-9b08-44e6-a901-74c05582264a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1458 microversion: 2.1 time: 0.216051 Mar 29 03:10:26.827898 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2976/6189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:26 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1458 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:27.713394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-46787653-84b0-4c1d-9e44-4d06ad3ffab2 req-cbd0968b-dd18-4ee3-8fc2-fb075c8d22a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae3d65b-d117-4d4e-8c97-c1d9ad147f27", "name": "network-vif-deleted", "tag": "bbbc26c6-c141-4aff-806a-5117310c85d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:10:27.714876 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:10:27.714876 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:10:27.725779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-46787653-84b0-4c1d-9e44-4d06ad3ffab2 req-cbd0968b-dd18-4ee3-8fc2-fb075c8d22a4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:27.727154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-46787653-84b0-4c1d-9e44-4d06ad3ffab2 req-cbd0968b-dd18-4ee3-8fc2-fb075c8d22a4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:27.743994 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-46787653-84b0-4c1d-9e44-4d06ad3ffab2 req-cbd0968b-dd18-4ee3-8fc2-fb075c8d22a4 service nova] Creating event network-vif-deleted:bbbc26c6-c141-4aff-806a-5117310c85d0 for instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 on n-h2-828148-1 Mar 29 03:10:27.749256 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-46787653-84b0-4c1d-9e44-4d06ad3ffab2 req-cbd0968b-dd18-4ee3-8fc2-fb075c8d22a4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039538 Mar 29 03:10:27.749839 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3214/6190] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:10:27.845257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:27.845867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:27.853461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:27.853920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:27.854703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:27.855134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:27.970577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:27.980153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c00c09b-e626-4fee-8975-00ef121a5f05 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1226 microversion: 2.1 time: 0.138442 Mar 29 03:10:27.980719 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2977/6191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:27 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:28.995355 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56264. Mar 29 03:10:28.999511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:29.000203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:29.003136 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56266. Mar 29 03:10:29.008797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:29.010108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:29.010108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:29.010421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:29.076340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:29.076778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:29.077254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid eae3d65b-d117-4d4e-8c97-c1d9ad147f27 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:10:29.215552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:29.223325 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcf4652c-ab8c-49e6-a614-e556c16124ff tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 200 len: 1185 microversion: 2.1 time: 0.229183 Mar 29 03:10:29.223878 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3215/6192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:28 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 1185 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:30.240418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:30.241225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: eae3d65b-d117-4d4e-8c97-c1d9ad147f27] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:30.249046 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:30.249504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:30.250276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:30.250720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:30.299315 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 could not be found. Mar 29 03:10:30.299854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance eae3d65b-d117-4d4e-8c97-c1d9ad147f27 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:10:30.300685 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-15bfb7e1-0b97-403f-beee-4449de0964f2 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27" status: 404 len: 111 microversion: 2.1 time: 0.063949 Mar 29 03:10:30.301251 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2978/6193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:30 2022] GET /compute/v2.1/servers/eae3d65b-d117-4d4e-8c97-c1d9ad147f27 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:10:36.636822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:36.639851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-71316384-ae83-41b4-8c4a-6da3be9e7a88 req-d8cdc165-c748-454a-9284-854efd9ed814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56b05e51-ee51-48cd-a935-dd7600943550", "tag": "90aaff2d-a52d-47c1-b626-cc9dfb2847d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:10:36.640992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:36.642292 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:10:36.642292 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:10:36.656321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:36.658664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-71316384-ae83-41b4-8c4a-6da3be9e7a88 req-d8cdc165-c748-454a-9284-854efd9ed814 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:36.659092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:36.659929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:36.660450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:36.673234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-71316384-ae83-41b4-8c4a-6da3be9e7a88 req-d8cdc165-c748-454a-9284-854efd9ed814 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:36.693708 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-71316384-ae83-41b4-8c4a-6da3be9e7a88 req-d8cdc165-c748-454a-9284-854efd9ed814 service nova] Creating event network-changed:90aaff2d-a52d-47c1-b626-cc9dfb2847d6 for instance 56b05e51-ee51-48cd-a935-dd7600943550 on n-h1-828148-1 Mar 29 03:10:36.698850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-71316384-ae83-41b4-8c4a-6da3be9e7a88 req-d8cdc165-c748-454a-9284-854efd9ed814 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066523 Mar 29 03:10:36.699964 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2979/6194] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:10:36.737940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:10:36.972190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a8fb37c-928c-4685-9fce-a24590199ee7 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 204 len: 0 microversion: 2.1 time: 0.341546 Mar 29 03:10:36.974453 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3216/6195] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:10:36 2022] DELETE /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:10:36.982900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:36.985692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:36.991791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:36.992248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:36.993638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:36.994075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:37.281650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:37.290815 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bc0a93a-5b6b-4e2b-a775-47f0cf4ec13a tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1575 microversion: 2.1 time: 0.312198 Mar 29 03:10:37.291507 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2980/6196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:36 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1575 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:38.308738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:38.309468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:38.316828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:38.317298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:38.318058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:38.318514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:38.587200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:38.595819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46dea137-5314-43de-a185-6ff3d90380c9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1457 microversion: 2.1 time: 0.291142 Mar 29 03:10:38.596687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3217/6197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:38 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1457 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:38.635420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-feae1175-5e9d-4566-8cf1-4bdee927a1c3 req-8bc52783-8bf4-49ee-aa84-c85e6f0949d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56b05e51-ee51-48cd-a935-dd7600943550", "name": "network-vif-deleted", "tag": "90aaff2d-a52d-47c1-b626-cc9dfb2847d6"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:10:38.637203 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:10:38.637203 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:10:38.645530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-feae1175-5e9d-4566-8cf1-4bdee927a1c3 req-8bc52783-8bf4-49ee-aa84-c85e6f0949d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:38.646057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-feae1175-5e9d-4566-8cf1-4bdee927a1c3 req-8bc52783-8bf4-49ee-aa84-c85e6f0949d1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:38.662381 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-feae1175-5e9d-4566-8cf1-4bdee927a1c3 req-8bc52783-8bf4-49ee-aa84-c85e6f0949d1 service nova] Creating event network-vif-deleted:90aaff2d-a52d-47c1-b626-cc9dfb2847d6 for instance 56b05e51-ee51-48cd-a935-dd7600943550 on n-h1-828148-1 Mar 29 03:10:38.667286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-feae1175-5e9d-4566-8cf1-4bdee927a1c3 req-8bc52783-8bf4-49ee-aa84-c85e6f0949d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036784 Mar 29 03:10:38.667942 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2981/6198] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:10:39.612232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:39.612859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:39.620344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:39.620819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:39.621609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:39.622033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:39.689311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:39.689755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:39.690195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lazy-loading 'fault' on Instance uuid 56b05e51-ee51-48cd-a935-dd7600943550 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:10:39.746227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01595d91e0ce417ca6172cca18cf8fcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960976da633c48d0b30476e140fbc13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:10:39.754532 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3fa161a-181f-4ac1-8c74-1a6353721190 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 200 len: 1230 microversion: 2.1 time: 0.146164 Mar 29 03:10:39.755101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3218/6199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:39 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:10:40.772645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:40.773369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: 56b05e51-ee51-48cd-a935-dd7600943550] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:40.781393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:40.781842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:40.782602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:40.783040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:40.830663 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance 56b05e51-ee51-48cd-a935-dd7600943550 could not be found. Mar 29 03:10:40.831253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance 56b05e51-ee51-48cd-a935-dd7600943550 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:10:40.832060 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab92800a-4071-4f90-a264-b9397512acf9 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550" status: 404 len: 111 microversion: 2.1 time: 0.063513 Mar 29 03:10:40.832577 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2982/6200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:40 2022] GET /compute/v2.1/servers/56b05e51-ee51-48cd-a935-dd7600943550 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:10:41.623645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:41.624156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:41.631268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:41.631714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:41.632472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:41.632924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:41.685207 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. Mar 29 03:10:41.685816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:10:41.686639 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0441f878-b690-42de-9bab-37051f415713 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 404 len: 111 microversion: 2.1 time: 0.066665 Mar 29 03:10:41.687184 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3219/6201] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:10:41 2022] DELETE /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:10:41.694989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:41.695604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] [instance: ea1ec3c3-86f1-422c-b178-f219e34754a9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:10:41.703358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:41.703803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:41.704559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:10:41.705029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:10:41.753331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] HTTP exception thrown: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. Mar 29 03:10:41.753923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Returning 404 to user: Instance ea1ec3c3-86f1-422c-b178-f219e34754a9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:10:41.754734 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f260947-0d01-414d-ac6a-237ab601a91d tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9" status: 404 len: 111 microversion: 2.1 time: 0.063375 Mar 29 03:10:41.755263 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2983/6202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:10:41 2022] GET /compute/v2.1/servers/ea1ec3c3-86f1-422c-b178-f219e34754a9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:10:44.471088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e81b7a6-c877-4166-8f22-8c75b01d8742 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] Calling method '.version_select at 0x7f8717ed6040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:10:44.544658 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e81b7a6-c877-4166-8f22-8c75b01d8742 tempest-TestVolumeBootPattern-75936539 tempest-TestVolumeBootPattern-75936539-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832022428" status: 202 len: 0 microversion: 2.1 time: 0.077173 Mar 29 03:10:44.545194 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3220/6203] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Mar 29 03:10:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1832022428 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:11:08.681607 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:11:08.682423 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:11:08.817139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-470709174", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:08.885837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] validate_networks() for None {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:11:09.136470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:11:09.136948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:11:09.137425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:11:09.137841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:11:09.138257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:11:09.146661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:09.147107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:09.147897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:09.148331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:09.167501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Getting quotas for project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:11:09.172717 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Getting quotas for user 5fcf49a443394465ad84f16570c39a0d and project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:11:09.184595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:11:09.186957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:11:09.293583 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6b712cae-e209-4af0-b59f-8d5608a314ab tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617131 Mar 29 03:11:09.294204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2984/6204] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:11:09.304476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7e6b0065-c996-4ae4-832c-a6d1feada717 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:09.305121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7e6b0065-c996-4ae4-832c-a6d1feada717 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:09.380069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7e6b0065-c996-4ae4-832c-a6d1feada717 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:09.397702 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7e6b0065-c996-4ae4-832c-a6d1feada717 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1221 microversion: 2.1 time: 0.089349 Mar 29 03:11:09.397702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3221/6205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:09 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:10.413762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:10.414379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:10.424961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:10.425419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:10.426191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:10.426633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:10.462870 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56462. Mar 29 03:11:10.464072 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56464. Mar 29 03:11:10.553893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:10.561992 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30b0cff5-9bcd-4519-a8ed-0d2705542c72 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1225 microversion: 2.1 time: 0.153040 Mar 29 03:11:10.562546 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2985/6206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:10 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:11.577986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:11.578600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:11.585997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:11.592093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:11.592093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:11.592093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:11.701729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:11.710486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0fec599a-0a81-4d03-a7d7-469732a636ba tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1279 microversion: 2.1 time: 0.136223 Mar 29 03:11:11.711067 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3222/6207] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:11 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:12.729984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:12.729984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:12.735976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:12.736425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:12.737353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:12.737651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:13.329283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:13.338060 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2b07af2-5e7f-4808-b39a-6026694e6262 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.613136 Mar 29 03:11:13.338861 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2986/6208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:12 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:13.760101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3e2e9d1e-9b58-4109-a9e5-abab1e501f8f req-8e0cd5df-5a83-4045-a35b-c2da32820103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488", "tag": "affc132e-4cb2-4f29-8765-6396c019bf39"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:13.761773 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:13.761773 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:11:13.771265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3e2e9d1e-9b58-4109-a9e5-abab1e501f8f req-8e0cd5df-5a83-4045-a35b-c2da32820103 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:13.771719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3e2e9d1e-9b58-4109-a9e5-abab1e501f8f req-8e0cd5df-5a83-4045-a35b-c2da32820103 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:13.789505 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3e2e9d1e-9b58-4109-a9e5-abab1e501f8f req-8e0cd5df-5a83-4045-a35b-c2da32820103 service nova] Creating event network-changed:affc132e-4cb2-4f29-8765-6396c019bf39 for instance d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 on n-h1-828148-1 Mar 29 03:11:13.794384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3e2e9d1e-9b58-4109-a9e5-abab1e501f8f req-8e0cd5df-5a83-4045-a35b-c2da32820103 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038590 Mar 29 03:11:13.794982 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3223/6209] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:14.353905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:14.354547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:14.361810 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:14.362259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:14.363016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:14.363452 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:14.688974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:14.697667 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f330b7f5-18b6-4d7d-88c7-5048cb34d5b5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.347424 Mar 29 03:11:14.698234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2987/6210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:14 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:15.714970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:15.715668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:15.723442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:15.723884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:15.724643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:15.725104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:15.917682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:15.925788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-626aee9a-99e4-4910-8098-a49ab8144f12 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.214928 Mar 29 03:11:15.926348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3224/6211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:15 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:16.942266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:16.942829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:16.951328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:16.951777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:16.952648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:16.953100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:17.153247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:17.161592 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-792350aa-5015-40ed-b2d0-fdf83f738c58 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.223014 Mar 29 03:11:17.162137 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2988/6212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:16 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:18.178489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:18.179106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:18.186401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:18.186853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:18.187618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:18.188061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:18.381611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:18.390294 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-522e6361-a124-4600-bd9e-f36378fe48f0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.215575 Mar 29 03:11:18.395990 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3225/6213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:18 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:19.411712 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:19.412353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:19.420209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:19.428963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:19.428963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:19.428963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:19.615961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:19.624039 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be17c5b5-6a5d-4fd2-b64d-266abd11e142 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.215987 Mar 29 03:11:19.633254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2989/6214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:19 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:20.640521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:20.641225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:20.648665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:20.649142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:20.649907 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:20.650385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:20.844506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:20.852734 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-29e7c28a-71ba-42e8-acfa-ca06180939e4 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.215914 Mar 29 03:11:20.853802 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3226/6215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:20 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:21.811327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-cb65ec5d-f63b-49e4-8fa7-f6b906c1f753 req-434072cb-bd88-42a2-a72d-27341ce34b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488", "name": "network-vif-plugged", "status": "completed", "tag": "affc132e-4cb2-4f29-8765-6396c019bf39"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:21.812947 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:21.812947 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:11:21.821037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cb65ec5d-f63b-49e4-8fa7-f6b906c1f753 req-434072cb-bd88-42a2-a72d-27341ce34b6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:21.821480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-cb65ec5d-f63b-49e4-8fa7-f6b906c1f753 req-434072cb-bd88-42a2-a72d-27341ce34b6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:21.837410 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-cb65ec5d-f63b-49e4-8fa7-f6b906c1f753 req-434072cb-bd88-42a2-a72d-27341ce34b6f service nova] Creating event network-vif-plugged:affc132e-4cb2-4f29-8765-6396c019bf39 for instance d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 on n-h1-828148-1 Mar 29 03:11:21.842229 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-cb65ec5d-f63b-49e4-8fa7-f6b906c1f753 req-434072cb-bd88-42a2-a72d-27341ce34b6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Mar 29 03:11:21.842799 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2990/6216] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:21.870042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:21.870658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:21.878014 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:21.878458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:21.879272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:21.879659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:22.082549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:22.090740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85a536c8-ae4a-4437-9d3e-45cb89708fc8 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.224976 Mar 29 03:11:22.091306 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3227/6217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:21 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:23.108159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:23.108868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:23.116289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:23.116742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:23.117526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:23.117963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:23.317816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:23.326504 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ff3e14db-be53-4fdf-8821-28687215bdfb tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1321 microversion: 2.1 time: 0.222454 Mar 29 03:11:23.327059 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2991/6218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:23 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:24.342738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:24.343371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:24.350965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.351406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.352163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.352593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.547231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:24.555300 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a3dcfac-4eae-48ed-8934-a86c929ada17 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1471 microversion: 2.1 time: 0.216231 Mar 29 03:11:24.555864 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3228/6219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:24 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:24.617387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e014a3ff-c41b-4c02-a888-786141603d45 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '.version_select at 0x7f8725e6cdc0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:24.677076 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e014a3ff-c41b-4c02-a888-786141603d45 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/adcd5d622ceb436b989eaaf7940194f6" status: 200 len: 371 microversion: 2.1 time: 0.107095 Mar 29 03:11:24.677905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2992/6220] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 03:11:24 2022] GET /compute/v2.1/os-quota-sets/adcd5d622ceb436b989eaaf7940194f6 => generated 371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:24.688383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f724f0c6-2dbc-4f28-8443-399dc5504773 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1080375189", "id": 2012382889, "os-flavor-access:is_public": "True"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:24.690041 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:24.690041 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:11:24.786284 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f724f0c6-2dbc-4f28-8443-399dc5504773 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.101536 Mar 29 03:11:24.786928 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3229/6221] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:11:24 2022] POST /compute/v2.1/flavors => generated 438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:24.797442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2012382889"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:24.798493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:24.806681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.807124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.807878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.808356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.874074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8b1cf22fc4b74bc7852089f9d609e8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd5d622ceb436b989eaaf7940194f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:24.886651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1080375189 {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:11:24.887666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.888109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.888915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:24.889348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:24.909845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Getting quotas for project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:11:24.914688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Getting quotas for user 5fcf49a443394465ad84f16570c39a0d and project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:11:24.926537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.compute.api [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] ram quota exceeded for adcd5d622ceb436b989eaaf7940194f6, tried to resize instance. Mar 29 03:11:24.927076 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Mar 29 03:11:24.927671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:11:24.928488 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6e433b0-6fc3-4790-a369-cdac156b5d4b tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488/action" status: 403 len: 118 microversion: 2.1 time: 0.134777 Mar 29 03:11:24.929157 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2993/6222] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:11:24 2022] POST /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488/action => generated 118 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:11:24.937836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cf48d434-a4be-4c59-a967-4e724c8e200e tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:24.938580 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:24.938580 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:11:25.005947 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cf48d434-a4be-4c59-a967-4e724c8e200e tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/2012382889" status: 202 len: 0 microversion: 2.1 time: 0.071731 Mar 29 03:11:25.006509 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3230/6223] 10.222.0.36 () {58 vars in 1160 bytes} [Tue Mar 29 03:11:24 2022] DELETE /compute/v2.1/flavors/2012382889 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:11:25.014138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6acb3c03-e5e8-48a6-87a9-42d5d89d1a6d tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.038064 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6acb3c03-e5e8-48a6-87a9-42d5d89d1a6d tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027389 Mar 29 03:11:25.038597 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2994/6224] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 03:11:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:25.055171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8cd8e793-00f2-4471-b0d9-c29cd7f4930e tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '.version_select at 0x7f8724bf9f70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.122741 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8cd8e793-00f2-4471-b0d9-c29cd7f4930e tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "GET /compute/v2.1/os-quota-sets/adcd5d622ceb436b989eaaf7940194f6" status: 200 len: 371 microversion: 2.1 time: 0.071076 Mar 29 03:11:25.123314 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3231/6225] 10.222.0.36 () {58 vars in 1241 bytes} [Tue Mar 29 03:11:25 2022] GET /compute/v2.1/os-quota-sets/adcd5d622ceb436b989eaaf7940194f6 => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:25.133457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59082c98-f9e4-4b5d-9663-37d4fd6db654 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1322044775", "id": 127641155, "os-flavor-access:is_public": "True"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:25.134974 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:25.134974 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:11:25.235560 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59082c98-f9e4-4b5d-9663-37d4fd6db654 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.105741 Mar 29 03:11:25.236135 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2995/6226] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:11:25 2022] POST /compute/v2.1/flavors => generated 434 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:25.247286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "127641155"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:25.248308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:25.255531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.258429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.258429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.258429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.322947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8b1cf22fc4b74bc7852089f9d609e8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adcd5d622ceb436b989eaaf7940194f6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:25.334682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1322044775 {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:11:25.335688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.336125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.336933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.337362 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.358855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Getting quotas for project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:11:25.363696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Getting quotas for user 5fcf49a443394465ad84f16570c39a0d and project 0c82e508ce2e4e16bccadb11a6398b0e. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:11:25.375103 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] cores quota exceeded for adcd5d622ceb436b989eaaf7940194f6, tried to resize instance. Mar 29 03:11:25.375631 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Mar 29 03:11:25.376213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:11:25.377048 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0cc03eb5-46eb-4a6f-8d9b-7f4f454f6b48 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "POST /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488/action" status: 403 len: 113 microversion: 2.1 time: 0.134293 Mar 29 03:11:25.377600 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3232/6227] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:11:25 2022] POST /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488/action => generated 113 bytes in 135 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:11:25.385876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-70747549-ef38-4418-b340-43f317e96212 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.386589 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:delete failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:25.386589 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:11:25.520974 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-70747549-ef38-4418-b340-43f317e96212 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "DELETE /compute/v2.1/flavors/127641155" status: 202 len: 0 microversion: 2.1 time: 0.138658 Mar 29 03:11:25.521534 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2996/6228] 10.222.0.36 () {58 vars in 1157 bytes} [Tue Mar 29 03:11:25 2022] DELETE /compute/v2.1/flavors/127641155 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:11:25.529977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ff309cc-1318-4d0c-83d7-6550feee89c2 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.554313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ff309cc-1318-4d0c-83d7-6550feee89c2 tempest-ServersAdminNegativeTestJSON-1128031569 tempest-ServersAdminNegativeTestJSON-1128031569-project-admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028396 Mar 29 03:11:25.554854 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3233/6229] 10.222.0.36 () {58 vars in 1145 bytes} [Tue Mar 29 03:11:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:25.571227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.571729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:25.578961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.579413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.580170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.580607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.642334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:11:25.920014 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f78d33cb-34c6-46c8-b0f6-b35ec2167e4a tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 204 len: 0 microversion: 2.1 time: 0.352207 Mar 29 03:11:25.920528 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2997/6230] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:11:25 2022] DELETE /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:11:25.928201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:25.928805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:25.936149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.936584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:25.937369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:25.937794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:26.133149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:26.141840 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8c5a2cb3-1286-4097-8fb5-c497442263b0 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1477 microversion: 2.1 time: 0.217217 Mar 29 03:11:26.142392 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3234/6231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:25 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:27.158668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:27.159369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:27.167122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:27.167577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:27.168339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:27.168778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:27.363837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:27.372101 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba8520a4-9a2e-43a7-9e22-ab227f178708 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1477 microversion: 2.1 time: 0.217578 Mar 29 03:11:27.372669 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2998/6232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:27 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:28.316072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-067c57e9-17c9-4330-a8b3-61e02082bbc7 req-cd4be13c-3ed0-420a-a772-56ab39596f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488", "name": "network-vif-deleted", "tag": "affc132e-4cb2-4f29-8765-6396c019bf39"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:28.317673 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:28.317673 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:11:28.327471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-067c57e9-17c9-4330-a8b3-61e02082bbc7 req-cd4be13c-3ed0-420a-a772-56ab39596f92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:28.328573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-067c57e9-17c9-4330-a8b3-61e02082bbc7 req-cd4be13c-3ed0-420a-a772-56ab39596f92 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:28.345141 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-067c57e9-17c9-4330-a8b3-61e02082bbc7 req-cd4be13c-3ed0-420a-a772-56ab39596f92 service nova] Creating event network-vif-deleted:affc132e-4cb2-4f29-8765-6396c019bf39 for instance d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 on n-h1-828148-1 Mar 29 03:11:28.351113 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-067c57e9-17c9-4330-a8b3-61e02082bbc7 req-cd4be13c-3ed0-420a-a772-56ab39596f92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039045 Mar 29 03:11:28.351848 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3235/6233] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:28.389066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:28.389843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:28.397291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:28.397772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:28.398586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:28.399031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:28.608989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fcf49a443394465ad84f16570c39a0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c82e508ce2e4e16bccadb11a6398b0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:28.617284 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c6c544a-902f-42b1-aa51-7ba20cc890d5 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 200 len: 1435 microversion: 2.1 time: 0.231823 Mar 29 03:11:28.617878 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 2999/6234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:28 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 1435 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:29.635815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:29.636522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] [instance: d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:29.644285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:29.644733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:29.645522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:29.645957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:29.694602 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] HTTP exception thrown: Instance d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 could not be found. Mar 29 03:11:29.695209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] Returning 404 to user: Instance d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:11:29.696035 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3562d1c5-1f6b-4622-9621-8ed1dbb1bb53 tempest-ServersAdminNegativeTestJSON-561991688 tempest-ServersAdminNegativeTestJSON-561991688-project] 10.222.0.36 "GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488" status: 404 len: 111 microversion: 2.1 time: 0.065183 Mar 29 03:11:29.696596 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3236/6235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:29 2022] GET /compute/v2.1/servers/d8b50bbb-ddb7-44f2-8bc9-a44e1fc09488 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:11:32.205435 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:11:32.205965 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:11:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:11:34.492236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-601228495", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "49fbd146-6d2a-4a96-94b4-a0ac41c02c6e"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:34.556428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] validate_networks() for [('49fbd146-6d2a-4a96-94b4-a0ac41c02c6e', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:11:35.125930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:11:35.126358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:11:35.126835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:11:35.127274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:11:35.127687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:11:35.135821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:35.136267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:35.137101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:35.137524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:35.154823 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Getting quotas for project a3bae0afc6ea41fba648be5327f1d755. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:11:35.159866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Getting quotas for user 307bca251c834d198c35d07ce95990f7 and project a3bae0afc6ea41fba648be5327f1d755. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:11:35.171873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:11:35.174145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:11:35.287891 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31c44b99-0e36-4ecf-a4c7-c07664211cec tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914131 Mar 29 03:11:35.288493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3000/6236] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:11:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 03:11:35.299123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70c99fc9-9b5f-4ae2-a017-d43e0ce25708 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:35.299729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70c99fc9-9b5f-4ae2-a017-d43e0ce25708 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:35.371025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70c99fc9-9b5f-4ae2-a017-d43e0ce25708 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:35.378491 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70c99fc9-9b5f-4ae2-a017-d43e0ce25708 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1214 microversion: 2.1 time: 0.083027 Mar 29 03:11:35.379065 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3237/6237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:35 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:36.395028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eec59cf2-99ec-468e-884a-2dbdd3d632ed tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:36.395663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eec59cf2-99ec-468e-884a-2dbdd3d632ed tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:36.463527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eec59cf2-99ec-468e-884a-2dbdd3d632ed tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:36.471429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eec59cf2-99ec-468e-884a-2dbdd3d632ed tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1214 microversion: 2.1 time: 0.080082 Mar 29 03:11:36.474249 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3001/6238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:36 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:37.488785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:37.489423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:37.497810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:37.498252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:37.499008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:37.499437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:37.609502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:37.617690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3eecc1b-d35b-477a-89b8-eeca2e66dc89 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1266 microversion: 2.1 time: 0.132544 Mar 29 03:11:37.618252 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3238/6239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:37 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:38.634789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:38.635409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:38.643302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:38.643769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:38.644742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:38.651027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:39.261859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:39.269831 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ab981a7-3df2-43f4-9db8-e9b2ff907823 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.638739 Mar 29 03:11:39.270391 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3002/6240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:38 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:40.172915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-41036008-493d-4f22-baae-32db35320e6c req-fd48f04a-521a-42f9-ae13-304d3f39c497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:40.172915 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:40.172915 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:11:40.178088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-41036008-493d-4f22-baae-32db35320e6c req-fd48f04a-521a-42f9-ae13-304d3f39c497 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:40.178522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-41036008-493d-4f22-baae-32db35320e6c req-fd48f04a-521a-42f9-ae13-304d3f39c497 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:40.198409 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-41036008-493d-4f22-baae-32db35320e6c req-fd48f04a-521a-42f9-ae13-304d3f39c497 service nova] Creating event network-changed:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h1-828148-1 Mar 29 03:11:40.203780 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-41036008-493d-4f22-baae-32db35320e6c req-fd48f04a-521a-42f9-ae13-304d3f39c497 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039594 Mar 29 03:11:40.207282 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3239/6241] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:40.287253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:40.287896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:40.295291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:40.295836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:40.296609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:40.297071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:40.660574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:40.668822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5787f71d-6040-46df-89c3-27845988c160 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.385761 Mar 29 03:11:40.669675 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3003/6242] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:40 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:41.685902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:41.686592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:41.694039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:41.694475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:41.695226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:41.695653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:41.968869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:41.977211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1e19dc4b-5258-4d0f-84e3-e3094c3231b5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.295403 Mar 29 03:11:41.977764 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3240/6243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:41 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:42.994887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:42.995412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:43.002879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:43.003352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:43.004122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:43.004594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:43.208808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:43.217607 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d7aa934-5b71-4021-b289-6b2a05ac5d45 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.227473 Mar 29 03:11:43.218219 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3004/6244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:42 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:44.235361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:44.235890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:44.243179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:44.243626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:44.244386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:44.244816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:44.438409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:44.446386 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da616d71-034f-4ef6-8a92-f308ed42e45a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.215416 Mar 29 03:11:44.446941 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3241/6245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:44 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:45.463112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:45.463656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:45.471059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:45.471520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:45.472551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:45.473058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:45.674205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:45.683220 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1a0b12eb-338b-4747-9930-16cff04aedd0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.223825 Mar 29 03:11:45.693062 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3005/6246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:45 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:46.699217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:46.699827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:46.707068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:46.707508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:46.708254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:46.708678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:46.902392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:46.911382 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ad956d3f-5745-4aff-adb5-83e7b53c11e4 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.215775 Mar 29 03:11:46.911948 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3242/6247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:46 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:47.907903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-dc382768-fbde-4702-9a35-128f3b8a69b3 req-77590c4a-948a-4b96-876c-fd69af670c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "name": "network-vif-plugged", "status": "completed", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:47.910365 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:11:47.910365 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:11:47.917753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dc382768-fbde-4702-9a35-128f3b8a69b3 req-77590c4a-948a-4b96-876c-fd69af670c40 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:47.918209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dc382768-fbde-4702-9a35-128f3b8a69b3 req-77590c4a-948a-4b96-876c-fd69af670c40 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:47.928111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:47.933307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:47.934122 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-dc382768-fbde-4702-9a35-128f3b8a69b3 req-77590c4a-948a-4b96-876c-fd69af670c40 service nova] Creating event network-vif-plugged:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h1-828148-1 Mar 29 03:11:47.936677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:47.937151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:47.937917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:47.938350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:47.939575 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-dc382768-fbde-4702-9a35-128f3b8a69b3 req-77590c4a-948a-4b96-876c-fd69af670c40 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035420 Mar 29 03:11:47.940241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3006/6248] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:11:48.140030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:48.148236 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed1f5549-e71a-4bd8-9f75-167505179e84 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.223673 Mar 29 03:11:48.148727 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3243/6249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:47 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:11:49.165486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:49.166201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:49.173714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:49.174173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:49.174947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:49.175394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:49.375969 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:49.385373 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0b548d7-8521-446e-b3b3-c03d018bc1f3 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1314 microversion: 2.1 time: 0.223761 Mar 29 03:11:49.392023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3007/6250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:49 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:50.402461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:50.403562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:50.410747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.411192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:50.411950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.412382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:50.612660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:50.620786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85d7f4f1-44df-4ab9-a240-ddd847124787 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1502 microversion: 2.1 time: 0.222008 Mar 29 03:11:50.621365 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3244/6251] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:50 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:50.637308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:11:50.638805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:50.646074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.646530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:50.647296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.647739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:50.714415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:50.727131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Old instance type m1.heat2, new instance type m1.heat {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:11:50.733978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:11:50.734410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:11:50.734895 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:11:50.735312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:11:50.735731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:11:50.912598 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d6b2e2f-7653-499d-a98c-991c0f35dd12 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "POST /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06/action" status: 202 len: 0 microversion: 2.1 time: 0.278974 Mar 29 03:11:50.913379 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3008/6252] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:11:50 2022] POST /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:11:50.921440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:50.922303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:50.929680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.930133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:50.930901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:50.931337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:51.133694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:51.142908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3c9e88cd-dcbd-4cdb-88ce-aaaf6ad32c07 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1511 microversion: 2.1 time: 0.225135 Mar 29 03:11:51.143483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3245/6253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:50 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:52.160705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:52.161579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:52.168801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:52.169288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:52.170062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:52.170506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:52.378565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:52.386764 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4321898d-fadc-40f2-8667-91f792f61884 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1511 microversion: 2.1 time: 0.230167 Mar 29 03:11:52.387349 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3009/6254] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:52 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:11:53.405183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:53.407700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:53.413485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:53.413928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:53.414689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:53.415113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:53.614812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:53.622939 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1780248d-c766-4f74-ab1e-05724f52a29e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1511 microversion: 2.1 time: 0.222056 Mar 29 03:11:53.623507 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3246/6255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:53 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:54.639324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:54.639932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:54.647338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:54.647788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:54.648544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:54.649006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:54.843738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:54.852044 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-430430f0-5399-4bd6-8cdc-eca589633af0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.216379 Mar 29 03:11:54.852594 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3010/6256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:54 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:55.869545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:55.870149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:55.878039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:55.878479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:55.879234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:55.879658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:56.068617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:56.076682 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aa80c5c1-9352-4bae-934a-a895255e4845 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.210820 Mar 29 03:11:56.077267 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3247/6257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:55 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:57.093490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:57.094135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:57.101796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:57.102250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:57.103008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:57.103444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:57.294396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:57.302857 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0f4c3a9-7884-4462-9ccc-d6af33e289bb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.213107 Mar 29 03:11:57.303412 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3011/6258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:57 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:58.320547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:58.321197 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:58.329637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:58.330086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:58.330850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:58.331285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:58.529546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:58.537611 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c9c3c2df-753c-424d-bf0f-20aed0ccbf62 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.220726 Mar 29 03:11:58.538170 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3248/6259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:58 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:11:59.554577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:11:59.555128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:11:59.562312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:59.562766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:59.563520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:11:59.563954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:11:59.855736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:11:59.863707 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60ccc90c-680c-4f18-9e45-12ca8b4906a9 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.312905 Mar 29 03:11:59.864263 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3012/6260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:11:59 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:00.880820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:00.881448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:00.889219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:00.889658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:00.890406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:00.890828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:01.083374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:01.092164 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c654a9a4-0b11-4a4d-85a4-1c986e8622fe tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.214336 Mar 29 03:12:01.092732 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3249/6261] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:00 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:02.109802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:02.110423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:02.117713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:02.118166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:02.118927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:02.119362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:02.312627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:02.320657 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60743c38-9c33-4a65-8733-7e22460160f6 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.215066 Mar 29 03:12:02.321254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3013/6262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:02 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:03.336647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:03.337283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:03.344544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:03.345038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:03.345827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:03.346262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:03.538304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:03.546917 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-616979e1-29bb-4c92-81e3-9798d9cb03b0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.213965 Mar 29 03:12:03.547480 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3250/6263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:03 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:04.563978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:04.564597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:04.572055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:04.572511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:04.573321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:04.573764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:04.770754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:04.778843 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2618e38b-975e-4502-8f63-d609a92eed02 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.218970 Mar 29 03:12:04.779406 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3014/6264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:04 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:05.796658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:05.797301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:05.804615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:05.805094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:05.805858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:05.806289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:06.104274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:06.113537 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5547ccc8-18a4-4be2-876d-f16f29033190 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.321134 Mar 29 03:12:06.114303 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3251/6265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:05 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:07.130606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:07.131227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:07.138438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:07.138888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:07.139691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:07.140125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:07.336258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:07.344712 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a66cf9ab-f964-4ff3-9107-bbf0a2bc9609 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.217771 Mar 29 03:12:07.345292 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3015/6266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:07 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:08.361459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:08.362078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:08.369337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:08.369764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:08.370518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:08.370947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:08.561739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:08.569765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b178c184-b0ea-4d9d-b751-ef38e8770e51 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.211984 Mar 29 03:12:08.570337 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3252/6267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:08 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:09.586378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:09.586997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:09.594263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:09.594722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:09.595488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:09.595924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:09.787190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:09.795171 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5772c84-f68c-43ef-bbec-35cd3403fa9d tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.212504 Mar 29 03:12:09.795736 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3016/6268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:09 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:10.813801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:10.814415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:10.821728 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:10.822168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:10.822925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:10.823358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:11.021152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:11.029238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bf00c4c4-770a-401a-916c-be4fb0064e5a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.220738 Mar 29 03:12:11.029847 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3253/6269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:10 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:12.046741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:12.047296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:12.054649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:12.055098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:12.055860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:12.056296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:12.250814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:12.258873 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1e5b308-ce2c-4d10-9441-c52127810d8b tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.216672 Mar 29 03:12:12.259431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3017/6270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:12 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:13.276098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:13.276703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:13.286112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:13.286578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:13.287343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:13.287772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:13.486104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:13.494198 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f41246d2-0b46-4388-af12-96e092084141 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.221743 Mar 29 03:12:13.494756 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3254/6271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:13 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:14.510986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:14.511599 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:14.518962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:14.519419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:14.520179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:14.520620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:14.717786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:14.726311 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bffea04a-589f-40e1-b7b8-56fb671b4104 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.219029 Mar 29 03:12:14.726874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3018/6272] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:14 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:15.743736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:15.744348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:15.752047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:15.752496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:15.753284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:15.753714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:15.945814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:15.953953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a7c884aa-9eda-46c8-82d7-63bdd42a4b7e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.213876 Mar 29 03:12:15.954517 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3255/6273] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:15 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:16.971034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:16.971680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:16.979326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:16.979784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:16.980552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:16.981036 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:17.325010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:17.333909 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36d90c3b-e50f-494e-ae4e-9a0c218ad03e tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.367100 Mar 29 03:12:17.334473 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3019/6274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:16 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:18.351129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:18.351740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:18.358889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:18.359336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:18.360097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:18.360527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:18.553630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:18.562171 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-06a513f5-d7cb-401a-a567-a7f3d511d57a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.214983 Mar 29 03:12:18.562733 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3256/6275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:18 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:19.578950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:19.579562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:19.586837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:19.587292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:19.588057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:19.588498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:19.783593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:19.791614 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-22ec1fd1-7d3e-401e-9e17-9c4c08c6e43a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.216389 Mar 29 03:12:19.792163 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3020/6276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:19 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:20.808561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:20.809213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:20.816458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:20.816927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:20.817689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:20.818121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:21.044334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:21.053160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c32e0ba-5fcc-4641-9eeb-5a4aff829dc0 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1516 microversion: 2.1 time: 0.248333 Mar 29 03:12:21.053725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3257/6277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:20 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:21.823399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "name": "network-vif-unplugged", "status": "completed", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:21.825037 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:21.825037 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:12:21.833870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:21.834317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:21.850511 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] Creating event network-vif-unplugged:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h2-828148-1 Mar 29 03:12:21.856762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:12:21.867414 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2d6c5c22-bcee-4ec8-a477-1a5ae1378266 req-8ce6844a-902b-4ccc-9a98-c09dcf2db7c1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047715 Mar 29 03:12:21.868084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3021/6278] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:12:22.069872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:22.070495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:22.077741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:22.078183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:22.078951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:22.079381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:22.697268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:22.705862 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e197e084-cbdb-4b6c-a76c-fae815217fe5 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1515 microversion: 2.1 time: 0.639599 Mar 29 03:12:22.706424 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3258/6279] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:22 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1515 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:23.723418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:23.724115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:23.731527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:23.731976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:23.733261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:23.733699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:23.880842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:23.882606 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:23.882606 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:12:23.890665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:23.891099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:23.907707 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] Creating event network-changed:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h2-828148-1 Mar 29 03:12:23.913965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:12:23.925185 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a2f0edcb-5643-4a71-a34a-ff3f5b43bb6b req-1afa52b8-e879-4f88-884b-57035d2751b9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047717 Mar 29 03:12:23.925800 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3259/6280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:12:23.939973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:23.946909 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bec58112-f1fc-438b-a2ee-388e6150637f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1513 microversion: 2.1 time: 0.227757 Mar 29 03:12:23.947868 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3022/6281] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:23 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:24.965772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:24.966468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:24.974243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:24.974681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:24.975439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:24.975866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:25.169634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:25.178270 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9df9cfd8-d211-4e83-97ee-563ad0ed2042 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1513 microversion: 2.1 time: 0.217460 Mar 29 03:12:25.178814 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3260/6282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:24 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:26.195651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:26.196266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:26.204149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:26.204596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:26.205391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:26.205828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:26.395282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:26.403716 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5a56d4b5-f428-4f7b-8970-5181aa16ec75 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1510 microversion: 2.1 time: 0.211564 Mar 29 03:12:26.404185 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3023/6283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:26 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:26.419729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:26.420775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:26.427961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:26.428477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:26.429271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:26.429698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:26.491776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:12:26.621921 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Found an unconfirmed migration during delete, id: 16, status: finished Mar 29 03:12:28.970200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0e9b7b10-3c12-40cc-9fc5-3d923e9abb94 req-d33782a0-1016-4120-a7e3-2be2f5ab18ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "name": "network-vif-plugged", "status": "completed", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:28.972707 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:28.972707 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:12:28.981026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0e9b7b10-3c12-40cc-9fc5-3d923e9abb94 req-d33782a0-1016-4120-a7e3-2be2f5ab18ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:28.981478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0e9b7b10-3c12-40cc-9fc5-3d923e9abb94 req-d33782a0-1016-4120-a7e3-2be2f5ab18ae service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:28.996762 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-0e9b7b10-3c12-40cc-9fc5-3d923e9abb94 req-d33782a0-1016-4120-a7e3-2be2f5ab18ae service nova] Creating event network-vif-plugged:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h2-828148-1 Mar 29 03:12:29.002068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0e9b7b10-3c12-40cc-9fc5-3d923e9abb94 req-d33782a0-1016-4120-a7e3-2be2f5ab18ae service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036467 Mar 29 03:12:29.002641 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3024/6284] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:12:29.149920 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-118ac3be-aae3-4b88-b97c-374669651d87 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 204 len: 0 microversion: 2.1 time: 2.733527 Mar 29 03:12:29.150506 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3261/6285] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:12:26 2022] DELETE /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 0 bytes in 2735 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:12:29.159332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:29.160041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:29.167479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:29.167937 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:29.168744 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:29.169219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:29.368952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:29.377618 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3acd216e-2f59-42d6-8eae-33ce2e1be257 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1502 microversion: 2.1 time: 0.222589 Mar 29 03:12:29.378180 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3025/6286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:29 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:30.395703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:30.396395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:30.405074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:30.406149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:30.406908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:30.407335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:30.825576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:30.834350 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7621ac6b-9063-4447-b735-f0a2ce1d5c0f tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1502 microversion: 2.1 time: 0.442869 Mar 29 03:12:30.834912 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3262/6287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:30 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1502 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:31.550737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-32cbc7a2-3174-4089-911b-49871e87861b req-d28b2d14-27fc-4d87-9012-f0384dbc17a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8528b8e9-e4a0-4f58-b7fa-567978d73a06", "name": "network-vif-deleted", "tag": "8964f3e3-f940-4920-87ef-083e844b409a"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:31.552352 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:31.552352 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:12:31.560692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-32cbc7a2-3174-4089-911b-49871e87861b req-d28b2d14-27fc-4d87-9012-f0384dbc17a2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:31.561189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-32cbc7a2-3174-4089-911b-49871e87861b req-d28b2d14-27fc-4d87-9012-f0384dbc17a2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:31.579386 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-32cbc7a2-3174-4089-911b-49871e87861b req-d28b2d14-27fc-4d87-9012-f0384dbc17a2 service nova] Creating event network-vif-deleted:8964f3e3-f940-4920-87ef-083e844b409a for instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 on n-h2-828148-1 Mar 29 03:12:31.584336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-32cbc7a2-3174-4089-911b-49871e87861b req-d28b2d14-27fc-4d87-9012-f0384dbc17a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 Mar 29 03:12:31.585049 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3026/6288] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:12:31.851414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:31.852181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:31.859600 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:31.860042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:31.860812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:31.861272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:31.932136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:31.932501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:31.932976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lazy-loading 'fault' on Instance uuid 8528b8e9-e4a0-4f58-b7fa-567978d73a06 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:12:32.067461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307bca251c834d198c35d07ce95990f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bae0afc6ea41fba648be5327f1d755', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:32.075964 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b42c74ee-7c89-447b-9a0f-8e681d727bdb tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 200 len: 1304 microversion: 2.1 time: 0.228774 Mar 29 03:12:32.076562 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3263/6289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:31 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 1304 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:33.094471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:33.095174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:33.102870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.103337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.104104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.104548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.153333 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] HTTP exception thrown: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. Mar 29 03:12:33.153927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Returning 404 to user: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:12:33.154735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5ff58ec-45e1-4462-a9b4-52c909c19a78 tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 404 len: 111 microversion: 2.1 time: 0.064900 Mar 29 03:12:33.155857 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3027/6290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:33 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:12:33.171765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:33.172254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:33.179835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.180274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.181055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.181485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.230562 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] HTTP exception thrown: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. Mar 29 03:12:33.231151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Returning 404 to user: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:12:33.231957 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02acdcbf-9a63-4251-9c20-c00ac49069da tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 404 len: 111 microversion: 2.1 time: 0.064043 Mar 29 03:12:33.232489 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3264/6291] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:12:33 2022] DELETE /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:12:33.240168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:33.240784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] [instance: 8528b8e9-e4a0-4f58-b7fa-567978d73a06] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:33.248133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.248591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.249388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:33.249831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:33.298352 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] HTTP exception thrown: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. Mar 29 03:12:33.298952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] Returning 404 to user: Instance 8528b8e9-e4a0-4f58-b7fa-567978d73a06 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:12:33.299765 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d87989ac-d0db-40fe-913f-e77f1964477a tempest-DeleteServersTestJSON-1213775333 tempest-DeleteServersTestJSON-1213775333-project] 10.222.0.36 "GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06" status: 404 len: 111 microversion: 2.1 time: 0.063318 Mar 29 03:12:33.300284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3028/6292] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:33 2022] GET /compute/v2.1/servers/8528b8e9-e4a0-4f58-b7fa-567978d73a06 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:12:37.536467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1740047721", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "7679fc35-3165-4987-b21e-fea73ea138da"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:37.603276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] validate_networks() for [('7679fc35-3165-4987-b21e-fea73ea138da', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:12:38.098644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:12:38.099066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:12:38.099535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:12:38.099940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:12:38.100373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:12:38.108589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:38.109059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:38.109840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:38.110262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:38.127286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Getting quotas for project 4f46ca1c4e7d4e14b41b18454b9eace5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:12:38.132322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Getting quotas for user 2cd5d815878f4d58b812de51063749ac and project 4f46ca1c4e7d4e14b41b18454b9eace5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:12:38.143580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:12:38.145838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:12:38.234687 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:12:39.243804 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 56848. Mar 29 03:12:39.247579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8024d634-aaab-4b60-b1da-869c7fa9b2a3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.829247 Mar 29 03:12:39.248251 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3265/6293] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:12:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:12:39.258490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4c370f8-a956-4976-80ec-0a745bf0ae01 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:39.259107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4c370f8-a956-4976-80ec-0a745bf0ae01 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:39.332308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4c370f8-a956-4976-80ec-0a745bf0ae01 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:39.339689 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4c370f8-a956-4976-80ec-0a745bf0ae01 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1218 microversion: 2.1 time: 0.084773 Mar 29 03:12:39.340242 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3029/6294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:39 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:40.356614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:40.357259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:40.365081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:40.370232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:40.370232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:40.370232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:40.478050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:40.486132 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0ebf6eeb-d98a-4441-a51a-5189b4a6f785 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1222 microversion: 2.1 time: 0.133321 Mar 29 03:12:40.486679 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3266/6295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:40 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:41.503023 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:41.503563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:41.511504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:41.520185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:41.520185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:41.520185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:41.629936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:41.640792 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b4af2696-20c3-4dda-8123-9993f69bc2df tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1288 microversion: 2.1 time: 0.141851 Mar 29 03:12:41.651107 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3030/6296] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:41 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1288 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:42.658002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:42.658605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:42.666645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:42.667108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:42.668008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:42.668444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:43.145697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:43.154736 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ccf5eee-8778-47c5-8242-17f64bbf5781 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.500733 Mar 29 03:12:43.155501 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3267/6297] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:42 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:43.704483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-55ee1902-80f7-471f-9963-285c1651c5a3 req-d3bd1f67-d190-4475-9b6f-d0fc30201d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:43.707069 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:43.707069 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:12:43.715807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-55ee1902-80f7-471f-9963-285c1651c5a3 req-d3bd1f67-d190-4475-9b6f-d0fc30201d58 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:43.717408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-55ee1902-80f7-471f-9963-285c1651c5a3 req-d3bd1f67-d190-4475-9b6f-d0fc30201d58 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:43.733665 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-55ee1902-80f7-471f-9963-285c1651c5a3 req-d3bd1f67-d190-4475-9b6f-d0fc30201d58 service nova] Creating event network-changed:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h2-828148-1 Mar 29 03:12:43.738507 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-55ee1902-80f7-471f-9963-285c1651c5a3 req-d3bd1f67-d190-4475-9b6f-d0fc30201d58 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038570 Mar 29 03:12:43.739125 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3031/6298] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:12:44.171734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:44.172346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:44.180188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:44.180643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:44.181450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:44.181889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:44.543843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:44.552167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ebb6e05-d422-49f0-a076-a26e4204e3be tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.384091 Mar 29 03:12:44.552737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3268/6299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:44 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:45.569682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:45.570397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:45.577799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:45.578258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:45.579033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:45.579515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:45.860994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:45.869145 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4dfe72d-d483-4e5c-bca0-d61946131f6c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.303690 Mar 29 03:12:45.869691 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3032/6300] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:45 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:46.885503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:46.886153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:46.894876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:46.895330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:46.896107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:46.896546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:47.149734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:47.158120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-daa91b5b-1d69-4504-a230-bdbffd96fbfe tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.276339 Mar 29 03:12:47.158682 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3269/6301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:46 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:48.175425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:48.176044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:48.183564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:48.184039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:48.184800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:48.185269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:48.436771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:48.445312 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4203fcf6-ba12-4fa2-a897-ddf742056518 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.273584 Mar 29 03:12:48.446818 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3033/6302] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:48 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:49.201214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-43d44b66-c27e-4767-ae40-d1b5960c006b req-d276918b-08f4-4f34-8dc6-024c5408b678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "name": "network-vif-plugged", "status": "completed", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:49.202819 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:12:49.202819 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:12:49.211444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43d44b66-c27e-4767-ae40-d1b5960c006b req-d276918b-08f4-4f34-8dc6-024c5408b678 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:49.211876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-43d44b66-c27e-4767-ae40-d1b5960c006b req-d276918b-08f4-4f34-8dc6-024c5408b678 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:49.228352 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-43d44b66-c27e-4767-ae40-d1b5960c006b req-d276918b-08f4-4f34-8dc6-024c5408b678 service nova] Creating event network-vif-plugged:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h2-828148-1 Mar 29 03:12:49.233354 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-43d44b66-c27e-4767-ae40-d1b5960c006b req-d276918b-08f4-4f34-8dc6-024c5408b678 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035968 Mar 29 03:12:49.233919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3270/6303] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:12:49.461189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:49.461778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:49.469026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:49.469478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:49.470243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:49.470688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:49.664487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:49.672573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-51356807-b5c5-47d5-9729-b3f8e3ba405c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1318 microversion: 2.1 time: 0.215082 Mar 29 03:12:49.673155 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3034/6304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:49 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:50.689443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:50.690402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:50.697759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:50.698204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:50.698957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:50.699385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:50.897610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:50.905666 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe56dc9b-9b46-42b6-84b1-58d7510fb1bc tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1508 microversion: 2.1 time: 0.220464 Mar 29 03:12:50.906227 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3271/6305] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:50 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:50.921863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:50.922491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:50.930391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:50.930849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:50.931622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:50.932119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.128417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:51.136636 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-865085b3-55b6-43b3-9ac7-c0a43db94418 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1508 microversion: 2.1 time: 0.218325 Mar 29 03:12:51.137225 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3035/6306] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:50 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:51.152975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:51.154070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:51.161853 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.162304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.163065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.163496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.363098 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-173b1dd5-00dc-43e1-97c9-b7fabe84637c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "PUT /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1080 microversion: 2.1 time: 0.213848 Mar 29 03:12:51.363717 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3272/6307] 10.222.0.36 () {60 vars in 1255 bytes} [Tue Mar 29 03:12:51 2022] PUT /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1080 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:51.376999 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:51.377600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:51.385293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.388075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.388075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.388075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.580621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:51.589466 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d60f5dce-88f2-4543-aad1-a78dc6ecf2a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1506 microversion: 2.1 time: 0.216084 Mar 29 03:12:51.590017 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3036/6308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:51 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:51.605050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:51.605660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:51.612821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.613288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.614042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.614468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.813307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:51.822188 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d7e4364-53e3-44c8-8e0b-f291dcc843dd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1506 microversion: 2.1 time: 0.220738 Mar 29 03:12:51.822745 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3273/6309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:51 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:51.838226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:12:51.839212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:51.846748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.847461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.848234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:51.848677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:51.915702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:51.928606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Old instance type m1.heat2, new instance type m1.heat {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:12:51.935598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:12:51.936035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:12:51.936517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:12:51.937040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:12:51.937476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:12:52.174116 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f9f24d6d-767b-480b-a761-32560d89802f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2/action" status: 202 len: 0 microversion: 2.1 time: 0.339454 Mar 29 03:12:52.174700 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3037/6310] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:12:51 2022] POST /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:12:52.183188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:52.183850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:52.191394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:52.191839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:52.192596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:52.193117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:52.390456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:52.399039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9b80a05c-3e15-49e7-9dab-e8eb919da773 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1517 microversion: 2.1 time: 0.219562 Mar 29 03:12:52.399616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3274/6311] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:52 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:53.415411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:53.416026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:53.426312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:53.427907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:53.427907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:53.428215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:53.626553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:53.635550 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4c55147a-fb0a-446e-a5fe-7ba08aafd6e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1517 microversion: 2.1 time: 0.223722 Mar 29 03:12:53.636320 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3038/6312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:53 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1517 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:54.652748 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:54.653629 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:54.661087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:54.661543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:54.662367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:54.662801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:55.120389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:55.128531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f99ceeae-f8f3-49aa-a977-75e671935f32 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1517 microversion: 2.1 time: 0.479480 Mar 29 03:12:55.129127 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3275/6313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:54 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1517 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:56.144913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:56.145529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:56.153429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:56.153892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:56.154652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:56.155092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:56.355806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:56.363889 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23dca863-6944-4b64-92e7-b15be1111674 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.222814 Mar 29 03:12:56.364446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3039/6314] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:56 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:57.382133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:57.382742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:57.391391 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:57.391844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:57.392671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:57.393143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:57.596766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:57.605870 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26d0b28f-e9f9-411b-bdb4-2e674046bdb1 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.227896 Mar 29 03:12:57.606440 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3276/6315] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:57 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:12:58.625791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:58.626407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:58.633710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:58.634123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:58.634886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:58.635604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:58.832558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:12:58.841316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-01176242-25df-4c1a-99df-91d79a2eed4a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.219248 Mar 29 03:12:58.841862 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3040/6316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:58 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:12:59.858357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:12:59.858970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:12:59.866848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:59.867284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:12:59.868033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:12:59.868458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:00.066760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:00.074882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d243a685-a353-49ce-acff-8b6b66907686 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.220327 Mar 29 03:13:00.075444 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3277/6317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:12:59 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:01.092125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:01.092739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:01.100689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:01.101167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:01.101924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:01.102356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:01.296268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:01.304876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c342e628-fe08-4b42-a38e-3b146d230269 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.216446 Mar 29 03:13:01.305432 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3041/6318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:01 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:02.321460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:02.322096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:02.329225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:02.329667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:02.330418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:02.330843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:02.523100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:02.531050 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-81b8c088-434f-421f-ba0c-4f5f9139dd46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.213865 Mar 29 03:13:02.531616 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3278/6319] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:02 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:03.547488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:03.548060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:03.555386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:03.555840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:03.556601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:03.557067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:03.752172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:03.760884 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f92e0e0f-3eb4-4dbe-a04a-9201993739f3 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.217116 Mar 29 03:13:03.761439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3042/6320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:03 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:04.777375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:04.777976 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:04.785633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:04.786071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:04.786844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:04.787270 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:04.988959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:04.997594 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73cbdb87-e85f-4b36-b52c-7021a5b9251f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.223929 Mar 29 03:13:04.998143 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3279/6321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:04 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:06.013396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:06.013945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:06.021268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:06.021722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:06.022485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:06.022918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:06.217437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:06.225945 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3389d859-4dec-4ce9-ba4c-b393cb69b143 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.216238 Mar 29 03:13:06.226518 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3043/6322] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:06 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:07.242765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:07.243385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:07.250682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:07.251128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:07.251891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:07.252326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:07.446491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:07.454640 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a3a19aae-8f90-42bb-9bea-9d405050f31b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.215601 Mar 29 03:13:07.455205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3280/6323] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:07 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:08.470666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:08.471275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:08.479477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:08.479929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:08.480691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:08.481181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:08.684352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:08.692733 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af9101c3-d83a-43bf-baf1-7dc60e00589f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.225733 Mar 29 03:13:08.693327 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3044/6324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:08 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:09.710153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:09.710806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:09.718071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:09.718523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:09.719282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:09.719716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:09.733138 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:13:09.738452 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:13:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 (ip 10.222.0.36) !!! Mar 29 03:13:09.913845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:09.921934 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6ce6e79-e387-4295-80ba-d54ca195d030 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.215469 Mar 29 03:13:09.922502 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3281/6325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:09 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:10.939688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:10.940224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:10.948181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:10.948634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:10.949424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:10.949864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:11.144346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:11.153105 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-94cdc5b4-5de2-4a9a-933e-af238a51a4a5 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.217162 Mar 29 03:13:11.153654 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3045/6326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:10 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:12.170525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:12.171134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:12.178320 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:12.178756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:12.179598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:12.180024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:12.379359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:12.387880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc86c85b-da7a-4dd9-b0ea-ce97fd23147c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1522 microversion: 2.1 time: 0.221022 Mar 29 03:13:12.388432 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3282/6327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:12 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:13.404804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:13.405420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:13.412707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:13.415661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:13.415661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:13.415661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:13.848274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:13.857189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f47b6ca-314b-407f-9539-c5f5831e31da tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1521 microversion: 2.1 time: 0.456103 Mar 29 03:13:13.857752 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3046/6328] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:13 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:13:13.917500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "name": "network-vif-unplugged", "status": "completed", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:13.919087 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:13.919087 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:13:13.927161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:13.928077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:13.943579 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] Creating event network-vif-unplugged:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h1-828148-1 Mar 29 03:13:13.950433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:13:13.961895 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9a656149-bfba-4f99-9edb-014134cec4ee req-fafb1535-7f0d-4c66-97bc-343097a290d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098482 Mar 29 03:13:13.962727 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3283/6329] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:13:14.874702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:14.875324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:14.882851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:14.883301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:14.884084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:14.884519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:15.178351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:15.186642 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca81be6e-6e5b-481c-a5f8-65f6e7aa6f5f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1521 microversion: 2.1 time: 0.315764 Mar 29 03:13:15.189106 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3047/6330] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:14 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:15.990136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:15.992099 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:15.992099 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:13:16.000498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:16.001034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:16.017496 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] Creating event network-changed:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h1-828148-1 Mar 29 03:13:16.023605 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:13:16.033884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6bdb297c-deed-46b3-be8a-52f409ba021b req-70db3656-08f0-40ae-b1f7-4bb812cc3495 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047865 Mar 29 03:13:16.034446 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3284/6331] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:13:16.203515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:16.204134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:16.211789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:16.212259 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:16.213068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:16.213537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:16.605594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:16.614748 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddd63322-1404-463b-8330-f0b3f0ccda5c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1519 microversion: 2.1 time: 0.414823 Mar 29 03:13:16.625592 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3048/6332] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:16 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1519 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:17.633244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:17.633963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:17.641779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:17.642228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:17.642982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:17.643407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:17.841729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:17.850291 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-79ff9c44-8dea-4a0e-ac35-cdca060c1d4f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1519 microversion: 2.1 time: 0.221142 Mar 29 03:13:17.850849 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3285/6333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:17 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:18.868038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:18.868653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:18.875889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:18.876346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:18.877152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:18.877597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:19.080513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:19.089656 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7c588ae1-84cf-46d3-816d-7ae0fe65fc63 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1516 microversion: 2.1 time: 0.225910 Mar 29 03:13:19.090267 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3049/6334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:18 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:19.106184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:19.106720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:19.113882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:19.114323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:19.115079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:19.115488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:19.324009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-caba0d1f-f663-4fb0-b44b-d0fe8c8059c7 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2/action" status: 204 len: 0 microversion: 2.1 time: 0.221638 Mar 29 03:13:19.326725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3286/6335] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:13:19 2022] POST /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2/action => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:13:19.332463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:19.333194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:19.341251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:19.341706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:19.342483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:19.342926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:19.538658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:19.546919 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-58d68560-613b-43b2-9be8-0999dbd18321 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1516 microversion: 2.1 time: 0.218055 Mar 29 03:13:19.547833 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3050/6336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:19 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:20.458237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "name": "network-vif-plugged", "status": "completed", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:20.459795 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:20.459795 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:13:20.468440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:20.468899 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:20.491417 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] Creating event network-vif-plugged:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h1-828148-1 Mar 29 03:13:20.498563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:13:20.509288 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-150c3a78-c39a-4faf-9f63-7c6f535a1a91 req-148523ec-d871-45c5-966b-4bb7552dd73e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106652 Mar 29 03:13:20.509884 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3287/6337] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:13:20.565179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:20.565888 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:20.575384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:20.576417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:20.577261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:20.577790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:20.777518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:20.785644 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bbdb1bc-50fd-4229-85e5-e7163760cda8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1516 microversion: 2.1 time: 0.224393 Mar 29 03:13:20.786200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3051/6338] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:20 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:21.803094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:21.803792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:21.811236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:21.811700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:21.812472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:21.812921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.004669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:22.013460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19fa89c9-268f-437a-b371-e0bd50d68275 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1508 microversion: 2.1 time: 0.214466 Mar 29 03:13:22.014025 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3288/6339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:21 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1508 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:22.029934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:22.030556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:22.037762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.038222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.039000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.039444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.236390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:22.244375 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-025bfbed-4c00-45d4-9f9e-fba40d2ccbed tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1508 microversion: 2.1 time: 0.218141 Mar 29 03:13:22.244950 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3052/6340] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:22 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1508 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:22.260427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:22.261072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:22.268292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.268737 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.269531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.270071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.464810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:22.473449 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1060cbb4-a849-4726-9c08-eeacbbb7db92 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 200 len: 1508 microversion: 2.1 time: 0.217245 Mar 29 03:13:22.474002 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3289/6341] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:22 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:22.489221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:22.489671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:22.497378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.497837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.498610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:22.499058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:22.558583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:13:22.867794 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0de401b1-d78e-4023-9a83-e44a9bac7bae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 204 len: 0 microversion: 2.1 time: 0.381344 Mar 29 03:13:22.868494 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3053/6342] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:13:22 2022] DELETE /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:13:22.928922 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-313149753", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "7679fc35-3165-4987-b21e-fea73ea138da"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:22.993007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] validate_networks() for [('7679fc35-3165-4987-b21e-fea73ea138da', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:13:23.649935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:13:23.650356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:13:23.650852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:13:23.651257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:13:23.651660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:13:23.659858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:23.660292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:23.661103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:23.661527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:23.678618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Getting quotas for project 4f46ca1c4e7d4e14b41b18454b9eace5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:13:23.683968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Getting quotas for user 2cd5d815878f4d58b812de51063749ac and project 4f46ca1c4e7d4e14b41b18454b9eace5. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:13:23.699344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:13:23.701672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:13:23.810739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-12a746d1-7073-44f7-ab1a-fb7aaf984d23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885121 Mar 29 03:13:23.811339 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3290/6343] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:13:23.822236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7385fec2-ea48-4e64-b5bf-a00ba7b40972 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:23.822943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7385fec2-ea48-4e64-b5bf-a00ba7b40972 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:23.904385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7385fec2-ea48-4e64-b5bf-a00ba7b40972 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:23.905135 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7385fec2-ea48-4e64-b5bf-a00ba7b40972 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1217 microversion: 2.1 time: 0.086931 Mar 29 03:13:23.912362 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3054/6344] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:23 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:24.921298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:24.921915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:24.929579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:24.932861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:24.932861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:24.932861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:25.051794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:25.060409 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b6fe3ea-9470-44b6-b105-0413f93da675 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1213 microversion: 2.1 time: 0.142843 Mar 29 03:13:25.070515 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3291/6345] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:24 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:25.310536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-65cff9ee-f3e7-4fed-92ad-80e55a2a1982 req-f26feefa-dfbf-48ad-8bcb-79b942a0400f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37d98c2d-d3eb-4ce9-9679-40bc1d283df2", "name": "network-vif-deleted", "tag": "92bba7a6-9211-47f5-8bc6-dbfe629d60c1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:25.312037 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:25.312037 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:13:25.320498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65cff9ee-f3e7-4fed-92ad-80e55a2a1982 req-f26feefa-dfbf-48ad-8bcb-79b942a0400f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:25.322251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65cff9ee-f3e7-4fed-92ad-80e55a2a1982 req-f26feefa-dfbf-48ad-8bcb-79b942a0400f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:25.340117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-65cff9ee-f3e7-4fed-92ad-80e55a2a1982 req-f26feefa-dfbf-48ad-8bcb-79b942a0400f service nova] Creating event network-vif-deleted:92bba7a6-9211-47f5-8bc6-dbfe629d60c1 for instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 on n-h1-828148-1 Mar 29 03:13:25.345127 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-65cff9ee-f3e7-4fed-92ad-80e55a2a1982 req-f26feefa-dfbf-48ad-8bcb-79b942a0400f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038301 Mar 29 03:13:25.346139 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3055/6346] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:13:26.078730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:26.079366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:26.088370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:26.089083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:26.090111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:26.090718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:26.204716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:26.212946 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80728059-f10d-4852-b0b8-bfc47ea4f295 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1287 microversion: 2.1 time: 0.138020 Mar 29 03:13:26.213516 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3292/6347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:26 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:27.231640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:27.232398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:27.239820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:27.240325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:27.241120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:27.241553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:27.703122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:27.711504 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18524d16-7f08-4d84-9365-eebbbdabc984 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.484108 Mar 29 03:13:27.712125 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3056/6348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:27 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:28.123096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6e1d2a49-1085-4e51-88a0-bb35ca9eefd6 req-a839ab91-828b-447c-a5e0-f60038376198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:28.125897 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:28.125897 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:13:28.129831 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:13:28.135350 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e1d2a49-1085-4e51-88a0-bb35ca9eefd6 req-a839ab91-828b-447c-a5e0-f60038376198 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:28.135778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6e1d2a49-1085-4e51-88a0-bb35ca9eefd6 req-a839ab91-828b-447c-a5e0-f60038376198 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:28.151908 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6e1d2a49-1085-4e51-88a0-bb35ca9eefd6 req-a839ab91-828b-447c-a5e0-f60038376198 service nova] Creating event network-changed:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h1-828148-1 Mar 29 03:13:28.156629 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6e1d2a49-1085-4e51-88a0-bb35ca9eefd6 req-a839ab91-828b-447c-a5e0-f60038376198 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037363 Mar 29 03:13:28.157200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3293/6349] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:13:28.729336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:28.729953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:28.737358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:28.737818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:28.738595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:28.739070 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:29.115592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:29.123952 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eab38c5e-eca0-43c0-99e0-bc801bbdcb23 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.399009 Mar 29 03:13:29.124518 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3057/6350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:28 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:30.142684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:30.143386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:30.151905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:30.152347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:30.153131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:30.153563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:30.186743 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57034. Mar 29 03:13:30.350599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:30.358752 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d88303fa-ce51-4e38-899d-3236cdeab747 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.221064 Mar 29 03:13:30.359319 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3294/6351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:30 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:31.374438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:31.375051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:31.382418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:31.382869 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:31.383660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:31.384095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:31.581013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:31.589403 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-511613ce-4af4-42da-ba8c-63d14ffd6307 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.218652 Mar 29 03:13:31.589960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3058/6352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:31 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:32.606731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:32.607374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:32.614715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:32.615163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:32.615915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:32.616983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:32.815963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:32.824247 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5be6b7d-5289-4d28-9b81-3c93965880db tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.221214 Mar 29 03:13:32.824806 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3295/6353] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:32 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:33.840980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:33.841670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:33.849168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:33.849618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:33.850382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:33.850819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:34.041585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:34.049709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88b87356-f741-420a-85ee-3725a6f2bbae tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.212433 Mar 29 03:13:34.050267 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3059/6354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:33 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:34.439405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b0ec20d2-7e15-41ea-a3d1-992360b1ced6 req-5545d5be-990e-42f2-b901-1804be88ab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "name": "network-vif-plugged", "status": "completed", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:34.440994 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:13:34.440994 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:13:34.449175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b0ec20d2-7e15-41ea-a3d1-992360b1ced6 req-5545d5be-990e-42f2-b901-1804be88ab22 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:34.449614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b0ec20d2-7e15-41ea-a3d1-992360b1ced6 req-5545d5be-990e-42f2-b901-1804be88ab22 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:34.465599 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b0ec20d2-7e15-41ea-a3d1-992360b1ced6 req-5545d5be-990e-42f2-b901-1804be88ab22 service nova] Creating event network-vif-plugged:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h1-828148-1 Mar 29 03:13:34.470216 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b0ec20d2-7e15-41ea-a3d1-992360b1ced6 req-5545d5be-990e-42f2-b901-1804be88ab22 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035079 Mar 29 03:13:34.470775 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3296/6355] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:13:35.066940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:35.067481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:35.076058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:35.076527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:35.077345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:35.077784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:35.270194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:35.278836 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e2c1fc5-ee15-4060-b152-2cde316b9441 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1317 microversion: 2.1 time: 0.215626 Mar 29 03:13:35.279415 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3060/6356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:35 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:36.296063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:36.296757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:36.304995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.305438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.306188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.306614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.501807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:36.509779 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-98fd9af8-cac1-4e2f-bd50-e7ef1e64a0e8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1506 microversion: 2.1 time: 0.217865 Mar 29 03:13:36.510332 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3297/6357] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:36 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1506 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:36.525784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:36.526409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:36.533505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.533959 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.534722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.535193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.729655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:36.737668 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4a170872-4cfe-4427-bfa7-a678dfd6b908 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1506 microversion: 2.1 time: 0.215538 Mar 29 03:13:36.738231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3061/6358] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:36 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:36.753233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:13:36.754213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:36.761383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.761824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.762578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:36.763007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:36.831530 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:36.844034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Old instance type m1.heat2, new instance type m1.heat {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:13:36.851693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:13:36.852111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:13:36.852581 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:13:36.853024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:13:36.853435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:13:37.073551 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bdf3b66f-55c5-48e8-ab86-bca7a403e065 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df/action" status: 202 len: 0 microversion: 2.1 time: 0.323930 Mar 29 03:13:37.074186 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3298/6359] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:13:36 2022] POST /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:13:37.081994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:37.082606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:37.090389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:37.090917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:37.091687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:37.092127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:37.287065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:37.295214 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-93a8adb4-3738-42cb-b8f9-3f0f5eebb47a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1513 microversion: 2.1 time: 0.216834 Mar 29 03:13:37.304612 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3062/6360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:37 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1513 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:38.311531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:38.312184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:38.319732 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:38.320357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:38.321142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:38.321663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:38.524249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:38.533454 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4f47735-6792-459f-88f6-22a9eabff933 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1513 microversion: 2.1 time: 0.225559 Mar 29 03:13:38.534013 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3299/6361] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:38 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:39.551102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:39.551723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:39.559635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:39.560089 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:39.560875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:39.561342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:39.899941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:39.908109 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8d538a19-c56b-4ec2-8520-825b72b628a9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1513 microversion: 2.1 time: 0.360757 Mar 29 03:13:39.908677 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3063/6362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:39 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1513 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:40.925606 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:40.926240 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:40.934081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:40.934456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:40.935247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:40.935674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:41.129718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:41.137755 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-95a3d94b-077a-4e00-b4f9-d0eddb8bbc60 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.215885 Mar 29 03:13:41.138311 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3300/6363] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:40 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:42.154473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:42.155096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:42.162513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:42.163109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:42.163790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:42.164239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:42.362072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:42.370752 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-18395dde-51c6-400b-a959-8b140c771d72 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.220198 Mar 29 03:13:42.371309 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3064/6364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:42 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:43.387711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:43.388353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:43.395757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:43.396199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:43.396984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:43.398072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:43.598102 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:43.606740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f868cbd-7cc7-415a-9bda-aee05410e889 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.222571 Mar 29 03:13:43.607301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3301/6365] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:43 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:44.626635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:44.627249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:44.635158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:44.635608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:44.636371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:44.636805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:44.830068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:44.838724 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-446e2d50-a57a-4889-a1bb-2512e423b268 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.215892 Mar 29 03:13:44.839275 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3065/6366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:44 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:45.855948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:45.856557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:45.863872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:45.864314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:45.865094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:45.865523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:46.058509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:46.066476 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d83f5911-9a8f-4c26-a164-7e8610b3ac5e tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.214280 Mar 29 03:13:46.067036 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3302/6367] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:45 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:47.083362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:47.083975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:47.091325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:47.091775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:47.092546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:47.093020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:47.589275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:47.597510 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-710d905e-6088-495f-8b9a-d3ab2d5f0c48 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.517892 Mar 29 03:13:47.598070 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3066/6368] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:47 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:48.614090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:48.614707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:48.622705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:48.623143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:48.623895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:48.624321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:48.832141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:48.842805 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8dddbf4b-9b13-4dd1-9b74-d55195891061 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.231022 Mar 29 03:13:48.843388 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3303/6369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:48 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:49.860714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:49.861365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:49.869168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:49.869618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:49.870380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:49.870820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:50.063504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:50.071542 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c935902-a51f-43b1-bb47-bbe310e8a2c9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.214522 Mar 29 03:13:50.074234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3067/6370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:49 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:51.088253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:51.088879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:51.096117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:51.096810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:51.097586 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:51.098033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:51.293672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:51.301711 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e4a7801-4a1d-403b-bf52-edf0605d800b tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.217161 Mar 29 03:13:51.302267 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3304/6371] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:51 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:52.319008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:52.319619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:52.327339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:52.327777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:52.328536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:52.329004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:52.524316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:52.532448 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-00aac4a3-f48a-43c1-b7cd-c09c6c65ee7a tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.217240 Mar 29 03:13:52.533052 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3068/6372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:52 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:53.549001 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:53.549541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:53.556764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:53.557230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:53.557982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:53.558405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:53.748425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:53.756456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1801fa7e-18a3-4f43-9aac-2d126cfbcec6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.211233 Mar 29 03:13:53.757043 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3305/6373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:53 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:54.774189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:54.774807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:54.781972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:54.782425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:54.783183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:54.783642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:54.978115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:54.986265 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32de670a-6d25-4a6e-88ac-c478331b356d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.216282 Mar 29 03:13:54.986828 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3069/6374] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:54 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:56.002592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:56.003167 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:56.010426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:56.010865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:56.011613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:56.012033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:56.209558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:56.218163 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-718ebf38-3af6-4326-b167-0e546df6371c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.219261 Mar 29 03:13:56.218725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3306/6375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:55 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:57.235709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:57.236310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:57.244186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:57.244635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:57.245416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:57.245851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:57.442441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:57.450477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f986e01e-f02b-4f36-a339-4dbfa030178c tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.218437 Mar 29 03:13:57.451026 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3070/6376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:57 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:58.466767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:58.467382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:58.475021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:58.475461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:58.476220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:58.476648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:58.672121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:58.681442 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-933b840e-8c3c-4ced-badf-bfc571db7322 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.217850 Mar 29 03:13:58.681571 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3307/6377] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:58 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:13:59.698624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:13:59.699235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:13:59.706500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:59.706948 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:59.707702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:13:59.708136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:13:59.902478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:13:59.910525 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5bb6102b-ca48-435f-b349-a8ee4e97b27f tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.216016 Mar 29 03:13:59.911074 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3071/6378] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:13:59 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:00.927329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:00.927939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:00.935298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:00.935684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:00.936482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:00.936943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:01.127580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:01.136231 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42c81dce-ada0-4544-b5cf-8917acbf7e50 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.212761 Mar 29 03:14:01.136804 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3308/6379] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:00 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:02.153547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:02.154171 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:02.161545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:02.169661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:02.169661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:02.169661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:02.357255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:02.365427 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2dcd040e-c970-4f80-9ca1-c30b39ceeae9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.215667 Mar 29 03:14:02.365995 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3072/6380] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:02 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:03.382124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:03.382778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:03.389974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:03.390414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:03.391165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:03.391593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:03.587986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:03.595980 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8cf39053-d5d4-4bb6-97e1-8c1f0a8dcb66 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.217559 Mar 29 03:14:03.596796 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3309/6381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:03 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:04.613011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:04.613648 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:04.621462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:04.621927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:04.622701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:04.623152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:04.824616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:04.832725 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8cb0d9ae-8c86-4046-822e-9cdd0f714368 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.223501 Mar 29 03:14:04.833344 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3073/6382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:04 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:05.849146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:05.849752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:05.856969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:05.857410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:05.858157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:05.858627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:06.047915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:06.056482 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8da31248-7aa0-419c-9995-e35836a19b09 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.211263 Mar 29 03:14:06.057077 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3310/6383] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:05 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:07.073689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:07.074309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:07.081604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:07.082056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:07.082822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:07.083266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:07.331320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:07.340240 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a460768c-6b2d-45ca-b47c-6259a261f84d tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1518 microversion: 2.1 time: 0.270750 Mar 29 03:14:07.340911 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3074/6384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:07 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1518 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:08.358380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:08.358989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:08.366522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:08.366966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:08.367730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:08.368152 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:08.582836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "name": "network-vif-unplugged", "status": "completed", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:08.584392 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:08.584392 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:14:08.593668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:08.594121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:08.614827 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] Creating event network-vif-unplugged:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h2-828148-1 Mar 29 03:14:08.617939 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] Instance 74719c6b-1745-4a83-9417-53a3ba26e3df is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:14:08.628517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d6fded74-2aef-4758-9e47-feec109c17f8 req-06acbec7-7f37-4d3a-81ee-885e20f912a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103331 Mar 29 03:14:08.629334 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3075/6385] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:14:08.669352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:08.678778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8f399608-ad51-4572-8b5a-214a8ad37bc4 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1517 microversion: 2.1 time: 0.324023 Mar 29 03:14:08.679399 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3311/6386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:08 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:09.696664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:09.697404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:09.704799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:09.705278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:09.706047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:09.706488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:09.905816 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:09.914726 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f947f614-cc04-4566-abc8-8c9cc113db46 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1517 microversion: 2.1 time: 0.222147 Mar 29 03:14:09.915285 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3076/6387] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:09 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:10.656071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:10.657604 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:10.657604 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:14:10.665893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:10.666336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:10.682988 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] Creating event network-changed:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h2-828148-1 Mar 29 03:14:10.689377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] Instance 74719c6b-1745-4a83-9417-53a3ba26e3df is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:14:10.700367 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1ea876d5-42e5-4851-8371-ba0f6411efaf req-90929944-46fb-4fd6-ae67-ac2f9c174d38 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047975 Mar 29 03:14:10.701013 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3312/6388] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:10.933435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:10.934058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:10.937768 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:14:10.938345 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:14:10.943554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:10.943981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:10.944770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:10.945236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:11.425285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:11.435122 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e8f98e4-a528-458d-93f4-5281d94a5277 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1515 microversion: 2.1 time: 0.507334 Mar 29 03:14:11.435905 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3077/6389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:10 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1515 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:12.453099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:12.453799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:12.461291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.461782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:12.462565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.462992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:12.662681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:12.671272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e60f87dc-2931-41c5-ade5-3eda49bfcdb9 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1512 microversion: 2.1 time: 0.222376 Mar 29 03:14:12.671832 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3313/6390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:12 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:12.687247 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:12.687792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:12.698266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.698730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:12.699502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.699938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:12.725631 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57144. Mar 29 03:14:12.726930 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57142. Mar 29 03:14:12.931682 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a29f1f8-ad97-4700-bdb3-40c4f24f5652 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "POST /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df/action" status: 204 len: 0 microversion: 2.1 time: 0.247712 Mar 29 03:14:12.932236 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3078/6391] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:14:12 2022] POST /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df/action => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:14:12.940300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:12.940956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:12.948184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.948619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:12.949412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:12.949838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:13.149547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:13.157684 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b46f8165-6262-4bde-939c-89df29f1c7cd tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1512 microversion: 2.1 time: 0.221169 Mar 29 03:14:13.158241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3314/6392] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:12 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:14.175420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:14.176122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:14.183512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:14.183953 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:14.184723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:14.185195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:14.390646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:14.399545 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29236c67-65aa-4161-ba14-eccd35e2c367 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1512 microversion: 2.1 time: 0.228252 Mar 29 03:14:14.400114 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3079/6393] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:14 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:15.416547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:15.417187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:15.424329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.424776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.425565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.425997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.597739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-3ad7e2b8-d637-4733-9bf2-9dc0507f775d req-90791361-dec2-4531-b2d6-910edeaa2f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "name": "network-vif-plugged", "status": "completed", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:15.599286 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:15.599286 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:14:15.607375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3ad7e2b8-d637-4733-9bf2-9dc0507f775d req-90791361-dec2-4531-b2d6-910edeaa2f65 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.610131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-3ad7e2b8-d637-4733-9bf2-9dc0507f775d req-90791361-dec2-4531-b2d6-910edeaa2f65 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.624174 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-3ad7e2b8-d637-4733-9bf2-9dc0507f775d req-90791361-dec2-4531-b2d6-910edeaa2f65 service nova] Creating event network-vif-plugged:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h2-828148-1 Mar 29 03:14:15.628896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:15.629885 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-3ad7e2b8-d637-4733-9bf2-9dc0507f775d req-90791361-dec2-4531-b2d6-910edeaa2f65 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Mar 29 03:14:15.631395 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3080/6394] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:15.640211 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3610e5a3-e9a6-4595-83bb-de498b8df8c8 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1504 microversion: 2.1 time: 0.227411 Mar 29 03:14:15.640797 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3315/6395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:15 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:15.656539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:15.657287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:15.665381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.665837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.666608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.667042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.864553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:15.873301 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30fcc5d9-cac0-40e9-ad56-39bb6fd98608 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1504 microversion: 2.1 time: 0.220718 Mar 29 03:14:15.873867 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3081/6396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:15 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:15.890265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:15.890875 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:15.898603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.899048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:15.899818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:15.900254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.099163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:16.107772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b19410c4-7a41-4bb3-b6bd-6f75c537d371 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1504 microversion: 2.1 time: 0.221143 Mar 29 03:14:16.108326 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3316/6397] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:15 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:16.124292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:16.124794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:16.131913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.132367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.133157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.133591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.194506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:14:16.526703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cda0f519-31cb-4ad2-aa3a-9509d6288c14 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 204 len: 0 microversion: 2.1 time: 0.405624 Mar 29 03:14:16.527206 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3082/6398] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:14:16 2022] DELETE /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:14:16.545392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:16.545917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:16.556768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.557244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.558004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.558435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.618819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:14:16.752122 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.compute.api [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Instance is already in deleting state, ignoring this request Mar 29 03:14:16.752932 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5bf5191-5fae-441d-927c-b34d39ace0fa tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "DELETE /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 204 len: 0 microversion: 2.1 time: 0.211541 Mar 29 03:14:16.753490 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3317/6399] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:14:16 2022] DELETE /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:14:16.762520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:16.763224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:16.770421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.770873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.771637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:16.772080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:16.978484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:16.984316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c0375c11-10f8-42ea-ac66-79116f6211e6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1510 microversion: 2.1 time: 0.225962 Mar 29 03:14:16.984893 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3083/6400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:16 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:18.001357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:18.001971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:18.009258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:18.009703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:18.010470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:18.010897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:18.500290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd5d815878f4d58b812de51063749ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f46ca1c4e7d4e14b41b18454b9eace5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:18.508952 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8128485d-60b4-4d81-8114-2933447d7d74 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 200 len: 1510 microversion: 2.1 time: 0.511283 Mar 29 03:14:18.509523 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3318/6401] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:17 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 1510 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:18.872639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7d3f5d79-68ae-4f0e-a549-e8d7636eb123 req-cfa4afb9-9a33-486c-8d75-6795559bd40e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74719c6b-1745-4a83-9417-53a3ba26e3df", "name": "network-vif-deleted", "tag": "cae7113b-b684-42ee-9b06-e8526ef12b1c"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:18.874155 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:18.874155 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:14:18.884667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7d3f5d79-68ae-4f0e-a549-e8d7636eb123 req-cfa4afb9-9a33-486c-8d75-6795559bd40e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:18.885093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7d3f5d79-68ae-4f0e-a549-e8d7636eb123 req-cfa4afb9-9a33-486c-8d75-6795559bd40e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:18.900443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7d3f5d79-68ae-4f0e-a549-e8d7636eb123 req-cfa4afb9-9a33-486c-8d75-6795559bd40e service nova] Creating event network-vif-deleted:cae7113b-b684-42ee-9b06-e8526ef12b1c for instance 74719c6b-1745-4a83-9417-53a3ba26e3df on n-h2-828148-1 Mar 29 03:14:18.905195 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7d3f5d79-68ae-4f0e-a549-e8d7636eb123 req-cfa4afb9-9a33-486c-8d75-6795559bd40e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036191 Mar 29 03:14:18.905759 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3084/6402] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:19.525796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:19.526334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 74719c6b-1745-4a83-9417-53a3ba26e3df] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:19.533504 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.533940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.534703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.535125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.584148 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] HTTP exception thrown: Instance 74719c6b-1745-4a83-9417-53a3ba26e3df could not be found. Mar 29 03:14:19.584725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Returning 404 to user: Instance 74719c6b-1745-4a83-9417-53a3ba26e3df could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:14:19.585554 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a07fe915-18a9-4417-8efa-0fe9501977b0 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df" status: 404 len: 111 microversion: 2.1 time: 0.063735 Mar 29 03:14:19.586093 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3319/6403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:19 2022] GET /compute/v2.1/servers/74719c6b-1745-4a83-9417-53a3ba26e3df => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:14:19.594751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:19.595346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:19.603154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.603615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.604389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.604861 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.654294 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] HTTP exception thrown: Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 could not be found. Mar 29 03:14:19.654905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Returning 404 to user: Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:14:19.655737 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b542f4da-901a-423a-9dda-4010f6c85425 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "DELETE /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 404 len: 111 microversion: 2.1 time: 0.065219 Mar 29 03:14:19.656283 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3085/6404] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:14:19 2022] DELETE /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:14:19.664185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:19.664784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] [instance: 37d98c2d-d3eb-4ce9-9679-40bc1d283df2] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:19.671937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.672381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.673173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:19.673604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:19.723101 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] HTTP exception thrown: Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 could not be found. Mar 29 03:14:19.723692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] Returning 404 to user: Instance 37d98c2d-d3eb-4ce9-9679-40bc1d283df2 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:14:19.724502 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-41f7400f-0f35-4f71-8d17-3a19603259b6 tempest-ServerDiskConfigTestJSON-138606410 tempest-ServerDiskConfigTestJSON-138606410-project] 10.222.0.36 "GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2" status: 404 len: 111 microversion: 2.1 time: 0.064089 Mar 29 03:14:19.725081 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3320/6405] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:19 2022] GET /compute/v2.1/servers/37d98c2d-d3eb-4ce9-9679-40bc1d283df2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 03:14:29.722294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: .version_select at 0x7f8717cec670>, body: {"keypair": {"name": "tempest-keypair-1656503787"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:29.744688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:14:29.750724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:14:29.970489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:14:29.976258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:14:29.990244 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab723190-ffbc-4de7-a9e0-4939fef86c37 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.392212 Mar 29 03:14:29.990849 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3086/6406] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:14:29 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:32.790636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-457535441", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c35080c-aadd-4a7b-8411-10552cc83e04"}], "security_groups": [{"name": "tempest-securitygroup--534510013"}], "key_name": "tempest-keypair-1656503787", "user_data": "}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:33.014385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] validate_networks() for [('3c35080c-aadd-4a7b-8411-10552cc83e04', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:14:33.628857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:14:33.629293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:14:33.629928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:14:33.630332 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:14:33.630871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:14:33.639340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:33.639772 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:33.640553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:33.641035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:33.659406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:14:33.665172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:14:33.676968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:14:33.679271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:14:33.789425 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d7818770-a916-45d3-80bf-f93c853381f7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.002204 Mar 29 03:14:33.790695 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3321/6407] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:14:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:14:33.799855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b310b6a6-edc4-427a-b5b8-a94ad1ec53da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:33.800580 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b310b6a6-edc4-427a-b5b8-a94ad1ec53da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:33.882911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b310b6a6-edc4-427a-b5b8-a94ad1ec53da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:33.890570 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b310b6a6-edc4-427a-b5b8-a94ad1ec53da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1238 microversion: 2.1 time: 0.094475 Mar 29 03:14:33.891231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3087/6408] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:33 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:34.907509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:34.908112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:34.916012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:34.916454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:34.917234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:34.917657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:35.033745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:35.042363 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8759078-8312-4f21-b018-63fb6953ad5f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1242 microversion: 2.1 time: 0.138692 Mar 29 03:14:35.042918 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3322/6409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:34 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1242 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:36.059651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:36.060275 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:36.067983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:36.068445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:36.069258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:36.069699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:36.188775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:36.197946 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31db4dfe-87bf-4f89-b2fe-96dfacac78e3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1308 microversion: 2.1 time: 0.142052 Mar 29 03:14:36.198522 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3088/6410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:36 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:37.215393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:37.215928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:37.224519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:37.225235 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:37.226233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:37.226873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:37.700702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:37.709058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8524f378-10e9-4364-9141-9437c8454aa1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.497354 Mar 29 03:14:37.709624 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3323/6411] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:37 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:38.294917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-80c22f30-436c-4d9d-a5f3-f5282f6773cc req-0872ed83-7184-4f96-b709-b1206267046f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:38.296934 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:38.296934 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:14:38.305271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-80c22f30-436c-4d9d-a5f3-f5282f6773cc req-0872ed83-7184-4f96-b709-b1206267046f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:38.305720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-80c22f30-436c-4d9d-a5f3-f5282f6773cc req-0872ed83-7184-4f96-b709-b1206267046f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:38.324701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-80c22f30-436c-4d9d-a5f3-f5282f6773cc req-0872ed83-7184-4f96-b709-b1206267046f service nova] Creating event network-changed:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h2-828148-1 Mar 29 03:14:38.330091 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-80c22f30-436c-4d9d-a5f3-f5282f6773cc req-0872ed83-7184-4f96-b709-b1206267046f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039983 Mar 29 03:14:38.330687 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3089/6412] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:38.725511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:38.726157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:38.733623 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:38.734071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:38.734833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:38.735265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:39.001673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:39.010905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04567fd2-7b71-46b1-87ea-ae16b39aaa1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.289270 Mar 29 03:14:39.011980 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3324/6413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:38 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:40.029062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:40.029768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:40.037255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:40.037710 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:40.038477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:40.038918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:40.247293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:40.255587 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ae6f8b6-5af5-4edc-8ebf-334982feb3a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.230648 Mar 29 03:14:40.256157 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3090/6414] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:40 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:41.272626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:41.273763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:41.281417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:41.281871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:41.282644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:41.283078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:41.481784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:41.490634 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d1a3b5f-1130-4f56-ad70-14bb5ae75b6c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.221566 Mar 29 03:14:41.491225 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3325/6415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:41 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:42.507872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:42.508390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:42.515715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:42.516169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:42.516964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:42.517406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:42.708224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:42.716316 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-21944e33-6d90-46f9-86f1-4057f747de12 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.212727 Mar 29 03:14:42.716885 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3091/6416] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:42 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:43.707438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-547ade13-7458-43df-85d2-4d75d48bec69 req-9d28c3d1-b929-460b-82a2-1fc350c5ac8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "name": "network-vif-plugged", "status": "completed", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:43.709673 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:43.709673 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:14:43.718758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-547ade13-7458-43df-85d2-4d75d48bec69 req-9d28c3d1-b929-460b-82a2-1fc350c5ac8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:43.719286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-547ade13-7458-43df-85d2-4d75d48bec69 req-9d28c3d1-b929-460b-82a2-1fc350c5ac8d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:43.732955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:43.733581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:43.736496 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-547ade13-7458-43df-85d2-4d75d48bec69 req-9d28c3d1-b929-460b-82a2-1fc350c5ac8d service nova] Creating event network-vif-plugged:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h2-828148-1 Mar 29 03:14:43.741378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:43.741750 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-547ade13-7458-43df-85d2-4d75d48bec69 req-9d28c3d1-b929-460b-82a2-1fc350c5ac8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 Mar 29 03:14:43.741864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:43.742586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:43.742813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3326/6417] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:43.743352 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:43.955110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:43.964421 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ae9366f6-0484-4172-97dd-5a4723b9c054 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1363 microversion: 2.1 time: 0.235027 Mar 29 03:14:43.965089 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3092/6418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:43 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:14:44.982766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:44.983448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:44.990998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:44.991479 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:44.992731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:44.993260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:45.204103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:45.213173 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5cf41e3-93fe-4e7c-bc18-b5c108ba4753 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1550 microversion: 2.1 time: 0.234691 Mar 29 03:14:45.213736 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3327/6419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:44 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1550 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:14:45.229991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:45.230481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:45.237773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:45.238172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:45.238947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:45.239401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:45.381365 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-308e9deb-58b1-4003-8e1a-9e42ebdc54e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155492 Mar 29 03:14:45.381986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3093/6420] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:14:45 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:46.966547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:46.967161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:46.969709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e8103127-855c-46eb-8f7e-384e6a9095a9 req-6e44ea2b-fa9e-4e0d-9d50-eb704f65dd88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:46.971634 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:14:46.971634 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:14:46.977353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:46.984095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:46.984095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:46.984095 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:46.984364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8103127-855c-46eb-8f7e-384e6a9095a9 req-6e44ea2b-fa9e-4e0d-9d50-eb704f65dd88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:46.984364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e8103127-855c-46eb-8f7e-384e6a9095a9 req-6e44ea2b-fa9e-4e0d-9d50-eb704f65dd88 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:47.001299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e8103127-855c-46eb-8f7e-384e6a9095a9 req-6e44ea2b-fa9e-4e0d-9d50-eb704f65dd88 service nova] Creating event network-changed:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h2-828148-1 Mar 29 03:14:47.007033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e8103127-855c-46eb-8f7e-384e6a9095a9 req-6e44ea2b-fa9e-4e0d-9d50-eb704f65dd88 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041717 Mar 29 03:14:47.008363 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3094/6421] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:14:47.318310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:47.327560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99ccae95-5f1f-46ae-a6b1-b456113ee4c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1550 microversion: 2.1 time: 0.364693 Mar 29 03:14:47.328224 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3328/6422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:46 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1550 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:47.344333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:47.345068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:47.352984 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:47.353522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:47.354307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:47.354751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:47.562880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:47.571761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-88913452-540e-40c6-80a9-461ebe77b579 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1550 microversion: 2.1 time: 0.231427 Mar 29 03:14:47.572436 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3095/6423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:47 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1550 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:48.590604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:48.591366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:48.599375 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:48.599816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:48.600570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:48.601676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.159443 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:49.167740 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a6b25f7a-48b2-40c3-bf58-65f766767c6d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1668 microversion: 2.1 time: 0.581266 Mar 29 03:14:49.168311 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3329/6424] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:48 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1668 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:49.183266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:49.184099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:49.191654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.206414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.206414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.206414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.393950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:49.402070 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3fb8ac3a-04a0-45c2-9926-30e98262b7b1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1668 microversion: 2.1 time: 0.222432 Mar 29 03:14:49.402633 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3096/6425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:49 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:49.420731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:14:49.421708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:49.429394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.429869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.430625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.431051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.498228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:49.510815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Old instance type m1.heat2, new instance type m1.heat {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:14:49.517645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:14:49.518062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:14:49.518552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:14:49.518958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:14:49.519361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:14:49.703666 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bf18586-53f3-4e9a-bb1e-ed5ca6857dbc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/action" status: 202 len: 0 microversion: 2.1 time: 0.286574 Mar 29 03:14:49.704284 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3330/6426] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:14:49 2022] POST /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:14:49.712316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:49.712995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:49.720145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.720880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.721665 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:49.722108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:49.972985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:49.981753 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f51614a9-b3a8-436b-86cb-9e92824c5ca9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1677 microversion: 2.1 time: 0.273182 Mar 29 03:14:49.982312 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3097/6427] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:49 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:50.999493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:51.000205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:51.008100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:51.008545 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:51.009403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:51.009885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:51.208857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:51.217056 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b0f9b97-c5a9-445e-bf0c-6682d184c3a7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1677 microversion: 2.1 time: 0.221397 Mar 29 03:14:51.217621 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3331/6428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:50 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:52.234931 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:52.235545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:52.243373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:52.243838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:52.244609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:52.245084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:52.555311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:52.563450 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e0f1cec-3883-418e-ae30-2b1f723f8ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1677 microversion: 2.1 time: 0.332195 Mar 29 03:14:52.564014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3098/6429] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:52 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1677 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:53.580459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:53.581090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:53.588983 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:53.589427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:53.590176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:53.590608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:53.785345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:53.793402 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-40fdc601-7067-4a3a-87dc-65d5b9c1fd95 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.216657 Mar 29 03:14:53.793954 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3332/6430] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:53 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:54.810210 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:54.810822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:54.818075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:54.818532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:54.819298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:54.819740 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:55.016537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:55.025197 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b2fcb857-7fb0-4465-ab69-29ec9874e62f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.218684 Mar 29 03:14:55.025754 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3099/6431] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:54 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:56.041903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:56.042480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:56.049726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:56.050168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:56.050924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:56.051353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:56.246269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:56.254360 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2d6729e6-012e-4169-a21f-de36e7029602 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.216694 Mar 29 03:14:56.254918 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3333/6432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:56 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:57.271170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:57.271794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:57.279145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:57.279601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:57.280370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:57.280812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:57.472441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:57.481204 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7892c0d-25cb-4c77-951c-3dd7da95e8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.213556 Mar 29 03:14:57.481761 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3100/6433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:57 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:58.498454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:58.499097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:58.506412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:58.506851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:58.507607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:58.508596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:58.703401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:58.711515 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-318d1b70-aef0-4217-a81e-bce9ef787069 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.217055 Mar 29 03:14:58.712074 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3334/6434] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:58 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:14:59.728564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:14:59.729208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:14:59.736489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:59.736979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:59.737745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:14:59.738184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:14:59.931392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:14:59.939395 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ea99071-8176-471b-8759-dde6531124ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.214525 Mar 29 03:14:59.939956 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3101/6435] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:14:59 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:00.957116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:00.957657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:00.965636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:00.966089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:00.966825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:00.967252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:01.161103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:01.169203 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3cb16c58-b153-4e6b-a9b2-6ad8454aa6d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.215985 Mar 29 03:15:01.169751 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3335/6436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:00 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:02.186505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:02.187097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:02.194521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:02.194965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:02.195724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:02.196158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:02.399131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:02.407305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-734204de-3bb3-48f2-9490-4e321737c119 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.224597 Mar 29 03:15:02.413115 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3102/6437] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:02 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:03.424961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:03.425579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:03.434813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:03.435253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:03.436005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:03.436432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:03.629991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:03.638580 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-85a4ed0d-f8b7-4407-9bac-f8798fe926bd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.217500 Mar 29 03:15:03.639249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3336/6438] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:03 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:04.655576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:04.656186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:04.663494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:04.664561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:04.665349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:04.665782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:04.859362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:04.867421 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5fbcbb41-3eed-41cd-bdd7-0da19e54d148 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.215553 Mar 29 03:15:04.867973 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3103/6439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:04 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:05.883888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:05.884498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:05.898083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:05.899022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:05.899797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:05.900228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:06.102880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:06.110844 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f680bb00-82d0-4bd0-ace9-5c4ca82cb3f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.230698 Mar 29 03:15:06.111391 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3337/6440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:05 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:07.128258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:07.128902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:07.136723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:07.137202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:07.137971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:07.138414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:07.330639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:07.339291 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ebb6de6-2c0e-4b21-bce0-77c556f64309 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.214757 Mar 29 03:15:07.339849 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3104/6441] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:07 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:08.357472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:08.358081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:08.365280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:08.365719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:08.366472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:08.366896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:08.560869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:08.568981 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b066782d-e749-4c43-9ce5-7fccc4d3a10f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.215156 Mar 29 03:15:08.569544 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3338/6442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:08 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:09.586095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:09.586755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:09.593905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:09.594366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:09.595137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:09.595831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:09.799026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:09.807509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d0f8dcb4-26d8-4bf7-a8fd-b54631264e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1682 microversion: 2.1 time: 0.225052 Mar 29 03:15:09.808084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3105/6443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:09 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1682 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:10.623456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "name": "network-vif-unplugged", "status": "completed", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:10.624711 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:10.624711 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:15:10.633077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:10.634158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:10.650726 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] Creating event network-vif-unplugged:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h1-828148-1 Mar 29 03:15:10.657086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:15:10.668267 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f9fa3dd8-e664-4a90-af05-58f3608a4449 req-34ee1657-9e28-4851-b0a9-0a521e7c9164 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048938 Mar 29 03:15:10.669246 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3339/6444] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:10.824616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:10.825260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:10.833018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:10.833621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:10.834790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:10.835815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:11.342112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:11.350400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fc2d0553-4a5b-4668-9db5-fb80ff02af78 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1681 microversion: 2.1 time: 0.530314 Mar 29 03:15:11.350954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3106/6445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:10 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1681 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:12.367832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:12.368529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:12.375766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:12.376206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:12.376994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:12.377420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:12.579338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:12.587620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d88274ff-5937-4d7a-a47c-9ef85fa8edef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1681 microversion: 2.1 time: 0.223887 Mar 29 03:15:12.588253 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3340/6446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:12 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:12.682076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:12.683607 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:12.683607 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:15:12.691862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:12.692317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:12.710616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] Creating event network-changed:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h1-828148-1 Mar 29 03:15:12.717151 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:15:12.727922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-00b41ea7-0f10-44c5-8c93-56df17c1137a req-76896aae-ee56-460b-8860-ec05e1e5e742 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050001 Mar 29 03:15:12.728497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3107/6447] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:13.604892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:13.605510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:13.612807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:13.613299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:13.614074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:13.614509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:13.815145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:13.823265 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ddca2545-4ddf-4d89-900f-8be072da5ada tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1679 microversion: 2.1 time: 0.222191 Mar 29 03:15:13.823827 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3341/6448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:13 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:14.841481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:14.842236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:14.849831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:14.850279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:14.851037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:14.851473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:15.046750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:15.054744 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7760702-ab0c-4280-acea-377c17d31f90 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1679 microversion: 2.1 time: 0.217409 Mar 29 03:15:15.055813 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3108/6449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:14 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:16.072590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:16.073228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:16.080430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.080938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.081696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.082130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.273721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:16.282319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e7129e7-7b0f-43de-b0c4-3527ae331a3c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1676 microversion: 2.1 time: 0.213974 Mar 29 03:15:16.282872 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3342/6450] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:16 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:16.298440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:16.298978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:16.306772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.307225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.307986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.308421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.647056 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e434f3bc-e0e7-406d-99b8-4b0d3a3289b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/action" status: 204 len: 0 microversion: 2.1 time: 0.352065 Mar 29 03:15:16.647900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3109/6451] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:15:16 2022] POST /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9/action => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:15:16.655991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:16.656798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:16.665569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.666012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.666786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:16.667214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:16.918551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:16.926813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4e2f9154-821a-4daa-b143-c19475af0cf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1676 microversion: 2.1 time: 0.274732 Mar 29 03:15:16.930725 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3343/6452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:16 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1676 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:17.945700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:17.946402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:17.953742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:17.954200 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:17.954965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:17.955402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:18.150623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:18.158589 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a0d367e-e840-47ff-8cd1-0ae922ba3ab7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1676 microversion: 2.1 time: 0.217240 Mar 29 03:15:18.159133 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3110/6453] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:17 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:19.014641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1866ac2a-f0c1-4a62-84e5-8fac22e825d1 req-f17385e9-870e-44fb-b7cb-5ac286b599d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "name": "network-vif-plugged", "status": "completed", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:19.017067 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:19.017067 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:15:19.024397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1866ac2a-f0c1-4a62-84e5-8fac22e825d1 req-f17385e9-870e-44fb-b7cb-5ac286b599d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.024851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1866ac2a-f0c1-4a62-84e5-8fac22e825d1 req-f17385e9-870e-44fb-b7cb-5ac286b599d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.041104 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1866ac2a-f0c1-4a62-84e5-8fac22e825d1 req-f17385e9-870e-44fb-b7cb-5ac286b599d2 service nova] Creating event network-vif-plugged:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h1-828148-1 Mar 29 03:15:19.046018 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1866ac2a-f0c1-4a62-84e5-8fac22e825d1 req-f17385e9-870e-44fb-b7cb-5ac286b599d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034877 Mar 29 03:15:19.046581 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3344/6454] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:19.176586 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:19.177233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:19.185149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.185602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.186367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.186801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.377546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:19.385595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fac3be0e-44cf-465e-b52f-8e48410a4d0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1668 microversion: 2.1 time: 0.212650 Mar 29 03:15:19.386137 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3111/6455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:19 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:19.402565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:19.403258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:19.410555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.416156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.416156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.416156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.606003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:19.614486 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-60e9ef94-b7c6-4b07-b655-3173e8f91ec3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1668 microversion: 2.1 time: 0.216452 Mar 29 03:15:19.615058 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3345/6456] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:19 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1668 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:19.630425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:19.631237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:19.638414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.638862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.639616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.640048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.838201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:19.846489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-053d0015-508b-4845-ab55-a498e48ff4d1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1668 microversion: 2.1 time: 0.219740 Mar 29 03:15:19.847039 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3112/6457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:19 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:19.861959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:19.862462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:19.869551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.870002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.870762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:19.871193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:19.930333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:15:20.259610 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d068ce49-82c2-4c39-9465-01aeb6432cd7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 204 len: 0 microversion: 2.1 time: 0.400897 Mar 29 03:15:20.260226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3346/6458] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:15:19 2022] DELETE /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:15:20.268803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:20.269436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:20.276520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:20.277014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:20.277771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:20.278207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:20.475436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:20.484052 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e78b199a-372a-40f6-8412-d304f8a515eb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1674 microversion: 2.1 time: 0.218800 Mar 29 03:15:20.484607 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3113/6459] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:20 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:21.502315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:21.503020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:21.510376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:21.510831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:21.511594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:21.512027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:21.717103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:21.725577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5839f16-fb17-4209-8412-6cabbba92c00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1674 microversion: 2.1 time: 0.227457 Mar 29 03:15:21.726142 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3347/6460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:21 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:22.743178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:22.743790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:22.751040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:22.751496 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:22.752375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:22.752818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:22.932296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:22.941959 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d02f8c24-14c5-4e78-bc4a-24042798d220 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 200 len: 1607 microversion: 2.1 time: 0.202557 Mar 29 03:15:22.942844 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3114/6461] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:22 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 1607 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:23.310271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-89281165-5831-49a6-8b88-078fab55c58a req-f51dee98-771a-4e7a-8833-3b32f43dab17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d74f971e-17ac-403b-b5d5-8d384a8984e9", "name": "network-vif-deleted", "tag": "33a879d1-3887-4f60-823e-b38db7dbf1d0"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:23.312401 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:23.312401 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:15:23.321321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-89281165-5831-49a6-8b88-078fab55c58a req-f51dee98-771a-4e7a-8833-3b32f43dab17 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:23.321757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-89281165-5831-49a6-8b88-078fab55c58a req-f51dee98-771a-4e7a-8833-3b32f43dab17 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:23.337584 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-89281165-5831-49a6-8b88-078fab55c58a req-f51dee98-771a-4e7a-8833-3b32f43dab17 service nova] Creating event network-vif-deleted:33a879d1-3887-4f60-823e-b38db7dbf1d0 for instance d74f971e-17ac-403b-b5d5-8d384a8984e9 on n-h1-828148-1 Mar 29 03:15:23.342329 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-89281165-5831-49a6-8b88-078fab55c58a req-f51dee98-771a-4e7a-8833-3b32f43dab17 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035881 Mar 29 03:15:23.342965 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3348/6462] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:23.960332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:23.961086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:23.968494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:23.969074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:23.969922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:23.970805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:24.020927 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. Mar 29 03:15:24.021543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:15:24.022382 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be813139-2805-4dcc-9ea5-7072fc1fcd4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 404 len: 111 microversion: 2.1 time: 0.066716 Mar 29 03:15:24.022954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3115/6463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:23 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:15:24.035382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:24.036107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:24.043671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:24.044115 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:24.044896 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:24.045583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:24.094422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. Mar 29 03:15:24.095269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:15:24.096087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cbe26505-3079-45f6-8bd3-fe9878249407 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 404 len: 111 microversion: 2.1 time: 0.064996 Mar 29 03:15:24.096637 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3349/6464] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:24 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:15:24.148157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-61230768", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "3c35080c-aadd-4a7b-8411-10552cc83e04"}], "security_groups": [{"name": "tempest-securitygroup--534510013"}], "key_name": "tempest-keypair-1656503787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:24.264784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] validate_networks() for [('3c35080c-aadd-4a7b-8411-10552cc83e04', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:15:24.967626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:15:24.968207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:15:24.968515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:15:24.968972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:15:24.969387 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:15:24.977820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:24.978265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:24.979048 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:24.979479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:24.995989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:15:25.001104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:15:25.013012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:15:25.015251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:15:25.128429 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a0ff0ae9-4708-44cd-a481-374a02bd69da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983800 Mar 29 03:15:25.128991 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3116/6465] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:15:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:15:25.139330 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9702fb1d-60d4-496a-b677-a002877caa7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:25.140017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9702fb1d-60d4-496a-b677-a002877caa7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:25.210536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9702fb1d-60d4-496a-b677-a002877caa7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:25.218468 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9702fb1d-60d4-496a-b677-a002877caa7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1237 microversion: 2.1 time: 0.082911 Mar 29 03:15:25.219018 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3350/6466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:25 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:26.235684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:26.236212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:26.243839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:26.244487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:26.245289 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:26.245781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:26.356583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:26.364746 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b73003a-a048-493f-8bc1-dfe53d3ae0f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1233 microversion: 2.1 time: 0.132857 Mar 29 03:15:26.365340 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3117/6467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:26 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1233 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:27.382477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:27.383574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:27.391245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:27.391682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:27.392434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:27.392880 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:27.509767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:27.517989 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-064192a8-bc36-434e-869f-7f9857dc6638 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1295 microversion: 2.1 time: 0.139226 Mar 29 03:15:27.518553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3351/6468] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:27 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1295 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:15:28.535466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:28.536010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:28.543844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:28.544304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:28.545102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:28.545540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:29.076575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:29.084650 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7749dc1-de92-4894-82b3-26d6b4d8b960 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.553012 Mar 29 03:15:29.085375 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3118/6469] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:28 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:29.275785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f3290232-18cb-48f8-ac12-79674d34c8ea req-2d53d787-1256-40bd-b022-f1f1a5a5f961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:29.277370 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:29.277370 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:15:29.281436 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:15:29.286999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f3290232-18cb-48f8-ac12-79674d34c8ea req-2d53d787-1256-40bd-b022-f1f1a5a5f961 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:29.287492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f3290232-18cb-48f8-ac12-79674d34c8ea req-2d53d787-1256-40bd-b022-f1f1a5a5f961 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:29.305977 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f3290232-18cb-48f8-ac12-79674d34c8ea req-2d53d787-1256-40bd-b022-f1f1a5a5f961 service nova] Creating event network-changed:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h1-828148-1 Mar 29 03:15:29.311456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f3290232-18cb-48f8-ac12-79674d34c8ea req-2d53d787-1256-40bd-b022-f1f1a5a5f961 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040465 Mar 29 03:15:29.312075 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3352/6470] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:30.102540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:30.103164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:30.110388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:30.110846 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:30.111621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:30.112068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:30.387532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:30.395608 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cceb8413-016e-47aa-9a20-bd0d42fc89f3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.297437 Mar 29 03:15:30.396167 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3119/6471] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:30 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:31.413645 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:31.414945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:31.427142 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57458. Mar 29 03:15:31.431111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:31.431554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:31.432314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:31.432742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:31.627407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:31.636120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-574ee0c4-b78b-4bee-86d4-607d3a809b0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.226618 Mar 29 03:15:31.636674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3353/6472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:31 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:32.653929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:32.654574 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:32.662044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:32.662523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:32.663286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:32.663727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:32.860148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:32.868926 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bec195af-ddcb-4f41-971f-6a070c6c0b2d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.218671 Mar 29 03:15:32.869509 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3120/6473] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:32 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:33.886061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:33.886680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:33.893921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:33.894368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:33.895121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:33.895548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:34.197833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:34.205773 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3147deb7-6bb1-4ceb-84c9-3bb47218ae67 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.324057 Mar 29 03:15:34.206323 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3354/6474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:33 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:35.015782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-f814b714-fdd1-4573-88dd-f6898a3635bb req-92a13b7a-51ef-40ca-a7a8-7b37307316fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "name": "network-vif-plugged", "status": "completed", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:35.017386 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:35.017386 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:15:35.026130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f814b714-fdd1-4573-88dd-f6898a3635bb req-92a13b7a-51ef-40ca-a7a8-7b37307316fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:35.026585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-f814b714-fdd1-4573-88dd-f6898a3635bb req-92a13b7a-51ef-40ca-a7a8-7b37307316fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:35.042186 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-f814b714-fdd1-4573-88dd-f6898a3635bb req-92a13b7a-51ef-40ca-a7a8-7b37307316fe service nova] Creating event network-vif-plugged:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h1-828148-1 Mar 29 03:15:35.047121 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-f814b714-fdd1-4573-88dd-f6898a3635bb req-92a13b7a-51ef-40ca-a7a8-7b37307316fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035136 Mar 29 03:15:35.048394 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3121/6475] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:15:35.222918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:35.223525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:35.230589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:35.231028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:35.231781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:35.232201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:35.424289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:35.433069 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cddf8747-7575-4092-bbbf-e7f5b52bccef tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.214035 Mar 29 03:15:35.433629 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3355/6476] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:35 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:36.451782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:36.452531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:36.460398 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:36.460909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:36.462192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:36.462636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:36.664622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:36.673443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e8b9268f-ad86-4fc6-bab7-80d07b9f24b9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1362 microversion: 2.1 time: 0.226084 Mar 29 03:15:36.674371 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3122/6477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:36 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:37.691013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:37.691624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:37.699063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:37.699509 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:37.700266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:37.700696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:37.893049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:37.901109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-376018b8-03cf-44ba-82df-707688011b8f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1549 microversion: 2.1 time: 0.213775 Mar 29 03:15:37.901663 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3356/6478] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:37 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1549 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:37.917924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:37.918584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:37.925940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:37.926395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:37.927189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:37.927626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:38.073537 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-79d5aaf7-b80f-4975-95f4-e005c641762b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159827 Mar 29 03:15:38.074141 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3123/6479] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:15:37 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:39.780425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ad70f0e-b528-4782-a01f-06b9ce013fd0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:39.782043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-57ce2b02-b377-43ec-bb7b-22f07fb1f706 req-33332772-d78d-4324-90f5-610292c8a889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:15:39.783533 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:15:39.783533 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:15:39.789080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ad70f0e-b528-4782-a01f-06b9ce013fd0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:39.789963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ad70f0e-b528-4782-a01f-06b9ce013fd0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:39.792951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57ce2b02-b377-43ec-bb7b-22f07fb1f706 req-33332772-d78d-4324-90f5-610292c8a889 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:39.793651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-57ce2b02-b377-43ec-bb7b-22f07fb1f706 req-33332772-d78d-4324-90f5-610292c8a889 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:39.812750 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-57ce2b02-b377-43ec-bb7b-22f07fb1f706 req-33332772-d78d-4324-90f5-610292c8a889 service nova] Creating event network-changed:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h1-828148-1 Mar 29 03:15:39.818039 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-57ce2b02-b377-43ec-bb7b-22f07fb1f706 req-33332772-d78d-4324-90f5-610292c8a889 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039641 Mar 29 03:15:39.819410 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3124/6480] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:15:39.854402 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ad70f0e-b528-4782-a01f-06b9ce013fd0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 03:15:40.050455 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ad70f0e-b528-4782-a01f-06b9ce013fd0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action" status: 202 len: 0 microversion: 2.1 time: 0.273674 Mar 29 03:15:40.051241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3357/6481] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:15:39 2022] POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:15:40.060346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:40.061150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:40.069510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:40.070056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:40.071423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:40.072027 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:40.411239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:40.420458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-87294712-45a3-4d0b-9af5-f2dce6d3a7ea tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1559 microversion: 2.1 time: 0.364359 Mar 29 03:15:40.421517 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3125/6482] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:40 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1559 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:41.439307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:41.440045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:41.448396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:41.448864 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:41.449630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:41.450064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:41.644135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:41.652995 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ca28007-c38f-4c19-8f50-1e03750d5a11 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217908 Mar 29 03:15:41.653554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3358/6483] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:41 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:42.670207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:42.670850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:42.678546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:42.679001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:42.679774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:42.680375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:42.871446 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:42.879564 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62018dee-52e3-413e-9bc9-52820cadc2ed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.213061 Mar 29 03:15:42.880118 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3126/6484] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:42 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:43.930656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:43.931266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:43.938642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:43.939022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:43.939784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:43.940264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:44.139020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:44.147135 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-346a1139-6914-4998-802a-77d19f31c697 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.220747 Mar 29 03:15:44.147692 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3359/6485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:43 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:45.164913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:45.165627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:45.172886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:45.173341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:45.174100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:45.174536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:45.371130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:45.379221 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0cf4da38-6a52-4850-83ac-e05ee3cfb855 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.218513 Mar 29 03:15:45.379775 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3127/6486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:45 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:46.396112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:46.396729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:46.403984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:46.404425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:46.405202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:46.405626 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:46.608885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:46.617057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b3783591-4797-4f48-93f0-f154ceab86c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.224573 Mar 29 03:15:46.617624 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3360/6487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:46 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:47.633649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:47.634786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:47.642321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:47.642780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:47.643559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:47.644006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:47.838787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:47.847268 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29d4324f-b9d5-47f7-93f6-04e05b7d8b48 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217284 Mar 29 03:15:47.847827 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3128/6488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:47 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:48.863373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:48.863901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:48.871099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:48.871541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:48.872294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:48.872718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:49.076260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:49.084613 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-adbc0fa2-507f-4f98-930a-1fcdcf1739e0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.225010 Mar 29 03:15:49.085405 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3361/6489] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:48 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:50.102377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:50.103668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:50.110991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:50.111453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:50.112264 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:50.112709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:50.307147 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:50.315257 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c805781-8138-4349-83be-2148bb328c63 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.216610 Mar 29 03:15:50.315820 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3129/6490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:50 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:51.331211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:51.331824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:51.339008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:51.339453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:51.340218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:51.340646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:51.537861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:51.546618 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8673353-a425-415a-a467-5a277d680aa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.219095 Mar 29 03:15:51.547179 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3362/6491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:51 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:52.563956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:52.564581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:52.572100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:52.572553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:52.573966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:52.574401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:52.778296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:52.786398 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce363191-20fc-418c-8f60-cd84ce138dc0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.226161 Mar 29 03:15:52.786954 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3130/6492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:52 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:53.803721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:53.804340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:53.812065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:53.812522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:53.813328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:53.813761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:54.008031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:54.016812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c87ea55b-ab4b-430c-9ba8-050349b5c432 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.216829 Mar 29 03:15:54.017402 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3363/6493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:53 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:55.033817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:55.034361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:55.041603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:55.042573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:55.043339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:55.043782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:55.239546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:55.247617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-be6b4cea-d888-49e8-888f-2cfb2179bbcc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217594 Mar 29 03:15:55.248184 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3131/6494] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:55 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:56.265069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:56.265717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:56.273051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:56.273503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:56.274265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:56.274707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:56.466365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:56.474882 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb37ca8a-bd59-4d1f-a14c-32dbf706a711 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.214037 Mar 29 03:15:56.475455 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3364/6495] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:56 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:57.491216 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:57.491832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:57.499288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:57.499743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:57.500516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:57.500983 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:57.690658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:57.698803 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2affd588-a165-41ea-9759-6dc182aff91e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.211253 Mar 29 03:15:57.699354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3132/6496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:57 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:58.715253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:58.715897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:58.723445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:58.723891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:58.724693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:58.725148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:58.920651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:15:58.928666 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6743800d-62c9-46c8-b7bd-09093217d903 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217156 Mar 29 03:15:58.929314 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3365/6497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:58 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:15:59.945375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:15:59.945930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:15:59.953721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:59.954170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:15:59.954928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:15:59.955364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:00.153206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:00.161746 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f45bcb3-44db-455f-9abc-efce586b76da tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.220125 Mar 29 03:16:00.162304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3133/6498] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:15:59 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:01.179308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:01.179918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:01.187317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:01.187756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:01.188501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:01.188955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:01.384051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:01.392708 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-44f02251-f748-418f-b449-1f64a6e367f5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217098 Mar 29 03:16:01.393288 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3366/6499] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:01 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:02.409353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:02.409978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:02.417486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:02.417949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:02.418726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:02.419176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:02.611413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:02.619655 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-adc6e81d-5114-45de-8f1e-80be5f1bf31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.214067 Mar 29 03:16:02.620223 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3134/6500] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:02 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:03.637449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:03.638072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:03.645430 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:03.645883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:03.646657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:03.647093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:03.839104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:03.847577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ac4485e-d5d1-41c0-a5ab-4ce70e9e6096 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.214655 Mar 29 03:16:03.848143 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3367/6501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:03 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:04.864245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:04.865721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:04.872898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:04.873466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:04.874253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:04.874697 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:05.068887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:05.077674 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-54f55277-5d3b-4352-83ac-2f616182c864 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.217105 Mar 29 03:16:05.078232 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3135/6502] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:04 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:06.094690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:06.095299 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:06.102574 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.103017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.103778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.104210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.303878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:06.313123 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc1d9d7b-432a-423b-8b81-0868d7f6edd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1654 microversion: 2.1 time: 0.222333 Mar 29 03:16:06.313687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3368/6503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:06 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1654 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:06.329202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:06.330188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:06.337282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.337734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.339170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.339170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.410037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:06.422423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Old instance type m1.heat2, new instance type m1.heat {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:16:06.429349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:16:06.429773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:16:06.430250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:16:06.430659 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:16:06.431069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:16:06.616534 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62f75058-65fd-43d8-9da5-ee5173ad1d32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action" status: 202 len: 0 microversion: 2.1 time: 0.290956 Mar 29 03:16:06.617411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3136/6504] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:16:06 2022] POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:16:06.625110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:06.625724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:06.633028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.633476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.634250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:06.634679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:06.832954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:06.842005 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-45134344-42e5-42d1-90af-9d0ec98200cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.220590 Mar 29 03:16:06.842561 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3369/6505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:06 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:07.860055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:07.860669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:07.868287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:07.868745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:07.869543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:07.869980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:08.072525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:08.081487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cf854fa3-5b2e-48d4-b7cf-6d0ec3d40ba7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.225182 Mar 29 03:16:08.082061 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3137/6506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:07 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:09.099565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:09.100177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:09.107773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:09.108226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:09.109023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:09.109455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:09.302965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:09.311836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-62c873bf-c8fe-47e5-ba17-d00fe68df530 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1677 microversion: 2.1 time: 0.215981 Mar 29 03:16:09.312401 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3370/6507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:09 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:10.331669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:10.332315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:10.339614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:10.340075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:10.340876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:10.341322 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:10.540550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:10.548774 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8ea43249-5100-4f81-8e58-d8e97ef8a68c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1682 microversion: 2.1 time: 0.220807 Mar 29 03:16:10.549352 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3138/6508] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:10 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:11.569604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:11.570188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:11.577848 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:11.579652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:11.579652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:11.579652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:11.786923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:11.795228 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3075299-439e-4143-a7a7-ec31f29e623d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1682 microversion: 2.1 time: 0.229357 Mar 29 03:16:11.795776 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3371/6509] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:11 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:12.426116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "name": "network-vif-unplugged", "status": "completed", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:12.427662 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:12.427662 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:16:12.436788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:12.437274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:12.461973 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] Creating event network-vif-unplugged:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h2-828148-1 Mar 29 03:16:12.468950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:16:12.479735 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9bba25e2-e920-410f-80d9-fcd20e64835c req-58ccb504-6616-4464-94bd-2b09c536810f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057333 Mar 29 03:16:12.480347 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3139/6510] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:16:12.811499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:12.812120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:12.820048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:12.820742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:12.821829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:12.822271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:13.191321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:13.200065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87afafed-f63b-4568-8a33-e2236b11096a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1681 microversion: 2.1 time: 0.391621 Mar 29 03:16:13.200636 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3372/6511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:12 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1681 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:14.218812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:14.219837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:14.227515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:14.233059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:14.233059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:14.233059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:14.427640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:14.435942 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce9d65f9-6057-45b7-a870-9204d2254ffd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1681 microversion: 2.1 time: 0.222025 Mar 29 03:16:14.439463 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3140/6512] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:14 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:14.493134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:14.494635 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:14.494635 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:16:14.503158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:14.503589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:14.520115 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] Creating event network-changed:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h2-828148-1 Mar 29 03:16:14.526202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:16:14.537813 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f1d8ce50-387b-45eb-bbdf-214b00c6865d req-3c052ca7-152e-4ffc-bc12-1072cedd4f69 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048338 Mar 29 03:16:14.542759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3373/6513] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:16:15.451887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:15.452500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:15.459694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:15.460177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:15.460963 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:15.461401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:15.658565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:15.666919 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5ac184f-7e88-4604-895d-505a114c64f8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1679 microversion: 2.1 time: 0.218798 Mar 29 03:16:15.667493 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3141/6514] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:15 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:16.686043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:16.686740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:16.694312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:16.694756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:16.695523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:16.695955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:16.890677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:16.898914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-aff3aeb0-58d1-4468-b8c9-32b3a3dfadae tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1675 microversion: 2.1 time: 0.217607 Mar 29 03:16:16.899479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3374/6515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:16 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:16.915169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:16.921557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:16.923569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:16.924035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:16.924815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:16.925306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:17.119721 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e1f627eb-025e-4f58-842d-96e8682307bb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action" status: 204 len: 0 microversion: 2.1 time: 0.208072 Mar 29 03:16:17.120354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3142/6516] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:16:16 2022] POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:16:17.128365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:17.129997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:17.136482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:17.137017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:17.137791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:17.138226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:17.337194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:17.346402 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8ae5d023-b9c4-4a0e-9701-6a02b67237e8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1675 microversion: 2.1 time: 0.221715 Mar 29 03:16:17.347051 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3375/6517] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:17 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:18.261924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "name": "network-vif-plugged", "status": "completed", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:18.267560 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:18.267560 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:16:18.271972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:18.272425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:18.288875 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] Creating event network-vif-plugged:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h2-828148-1 Mar 29 03:16:18.295822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:16:18.306347 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-bc94f877-6c58-4e7a-9dad-5bff02e244fe req-94de027a-6f2d-45f9-ad35-1a56f7646192 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048939 Mar 29 03:16:18.306953 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3143/6518] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:16:18.364746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:18.366073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:18.374007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:18.376611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:18.376611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:18.376611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:18.575541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:18.583878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3a9c300d-d269-4156-90f9-ed9add4851a1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1675 microversion: 2.1 time: 0.224174 Mar 29 03:16:18.584443 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3376/6519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:18 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:19.602204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:19.602831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:19.611004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:19.611473 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:19.612248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:19.612692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:19.813366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:19.821517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09d839a6-a2db-4c13-94d4-7e67917ad1cc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1654 microversion: 2.1 time: 0.223523 Mar 29 03:16:19.822078 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3144/6520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:19 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1654 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:19.837246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:19.837862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:19.846217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:19.846669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:19.847435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:19.847869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:20.040259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:20.048979 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8bac358-f365-477d-91f5-d5cdafd94d2b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1654 microversion: 2.1 time: 0.215323 Mar 29 03:16:20.049540 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3377/6521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:19 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1654 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:20.064849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6a54bbe3-d450-4707-8f3f-d0b5f67d4ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:20.072009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a54bbe3-d450-4707-8f3f-d0b5f67d4ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:20.072461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6a54bbe3-d450-4707-8f3f-d0b5f67d4ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:20.128011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6a54bbe3-d450-4707-8f3f-d0b5f67d4ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Going to try to start instance {{(pid=103514) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 03:16:20.330477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6a54bbe3-d450-4707-8f3f-d0b5f67d4ef9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action" status: 202 len: 0 microversion: 2.1 time: 0.269162 Mar 29 03:16:20.331070 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3145/6522] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:16:20 2022] POST /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:16:20.339036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:20.339699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:20.347826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:20.348272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:20.349119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:20.349553 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:20.551319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:20.560695 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e088c190-2906-4bff-a664-d36d4631362a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1663 microversion: 2.1 time: 0.225356 Mar 29 03:16:20.561298 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3378/6523] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:20 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1663 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:21.577790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:21.578486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:21.585884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:21.586335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:21.587091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:21.587525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:21.784116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:21.792267 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47391a46-8998-416c-a4d0-156a0af82705 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1663 microversion: 2.1 time: 0.218576 Mar 29 03:16:21.793438 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3146/6524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:21 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:22.810781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:22.811390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:22.818753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:22.819194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:22.819945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:22.820368 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:23.017614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:23.025739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-59366d2d-da75-4cd7-b77a-3d79632738c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1667 microversion: 2.1 time: 0.219291 Mar 29 03:16:23.026290 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3379/6525] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:22 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:23.041944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:23.042428 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:23.050133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:23.050585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:23.051347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:23.051784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:23.111067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:16:23.429170 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ddf4317d-8b23-46a9-ae87-79f5419d357c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 204 len: 0 microversion: 2.1 time: 0.390397 Mar 29 03:16:23.429756 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3147/6526] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:16:23 2022] DELETE /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:16:23.437920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:23.438567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:23.445842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:23.446286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:23.447040 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:23.447468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:23.642802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:23.650959 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e83bfb99-7700-40ca-899f-09f3dabe7896 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1673 microversion: 2.1 time: 0.216752 Mar 29 03:16:23.651512 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3380/6527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:23 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1673 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:24.670238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:24.670928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:24.678514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:24.679125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:24.679904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:24.680344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:24.883332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:24.892444 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-61931706-f591-4e1d-aa40-c4ae242dc9c9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1673 microversion: 2.1 time: 0.226818 Mar 29 03:16:24.893095 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3148/6528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:24 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:25.909745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:25.910346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:25.918177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:25.918565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:25.919389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:25.919815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:26.095972 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:26.104066 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-11c6f42b-1545-4936-8a2d-b839c27ca46b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 200 len: 1606 microversion: 2.1 time: 0.198054 Mar 29 03:16:26.104623 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3381/6529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:25 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 1606 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:26.284942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-c5140061-cdc6-4291-a018-2cdd1bb251f5 req-7e9046eb-588e-4498-ae97-2d95bb9adc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f0cc3d-ee23-4794-9a72-c582d739aedf", "name": "network-vif-deleted", "tag": "a65023f9-4363-434f-81dd-0e03bb58dfdc"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:26.286438 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:26.286438 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:16:26.295192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c5140061-cdc6-4291-a018-2cdd1bb251f5 req-7e9046eb-588e-4498-ae97-2d95bb9adc6b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:26.295646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-c5140061-cdc6-4291-a018-2cdd1bb251f5 req-7e9046eb-588e-4498-ae97-2d95bb9adc6b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:26.311142 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-c5140061-cdc6-4291-a018-2cdd1bb251f5 req-7e9046eb-588e-4498-ae97-2d95bb9adc6b service nova] Creating event network-vif-deleted:a65023f9-4363-434f-81dd-0e03bb58dfdc for instance a6f0cc3d-ee23-4794-9a72-c582d739aedf on n-h2-828148-1 Mar 29 03:16:26.315922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-c5140061-cdc6-4291-a018-2cdd1bb251f5 req-7e9046eb-588e-4498-ae97-2d95bb9adc6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034561 Mar 29 03:16:26.316537 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3149/6530] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:16:27.122399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:27.123022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:27.130377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:27.130829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:27.131607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:27.132042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:27.180765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. Mar 29 03:16:27.181307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:16:27.182141 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c80e4989-6d08-401b-bffc-ed3ebe34d0a8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 404 len: 111 microversion: 2.1 time: 0.064151 Mar 29 03:16:27.182694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3382/6531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:27 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:16:27.203459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:27.204166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:27.211513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:27.211965 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:27.212732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:27.213202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:27.263770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. Mar 29 03:16:27.264373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:16:27.265242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32063030-df01-4d6d-9906-ee67a3f24e00 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 404 len: 111 microversion: 2.1 time: 0.066002 Mar 29 03:16:27.265801 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3150/6532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:27 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:16:27.316380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-568432215", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "3c35080c-aadd-4a7b-8411-10552cc83e04"}], "security_groups": [{"name": "tempest-securitygroup--534510013"}], "key_name": "tempest-keypair-1656503787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:27.430945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] validate_networks() for [('3c35080c-aadd-4a7b-8411-10552cc83e04', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:16:28.022476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:16:28.022910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:16:28.023422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:16:28.023834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:16:28.024252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:16:28.033211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:28.033656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:28.034452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:28.034886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:28.051658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:16:28.056746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:16:28.068455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:16:28.070755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:16:28.173401 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc717637-26e0-4901-a984-a016ddf868e9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860861 Mar 29 03:16:28.174126 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3383/6533] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:16:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:16:28.184277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-152705a2-7df2-41b1-8250-ddb4e0ba4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:28.184934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-152705a2-7df2-41b1-8250-ddb4e0ba4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:28.255566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-152705a2-7df2-41b1-8250-ddb4e0ba4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:28.267088 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-152705a2-7df2-41b1-8250-ddb4e0ba4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1238 microversion: 2.1 time: 0.086847 Mar 29 03:16:28.267657 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3151/6534] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:28 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:29.283806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:29.284425 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:29.291730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:29.292176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:29.293536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:29.293974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:29.413558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:29.421610 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-13ad91f6-9ff0-426e-8524-ef3179e686a3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1234 microversion: 2.1 time: 0.141528 Mar 29 03:16:29.422155 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3384/6535] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:29 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1234 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:29.775379 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:16:29.775588 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:16:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:16:30.442344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:30.442344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:30.448700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:30.449190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:30.449982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:30.450731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:30.572497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:30.581102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3e89753c-98c0-4610-b04f-9ff396e97247 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1296 microversion: 2.1 time: 0.144855 Mar 29 03:16:30.582097 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3152/6536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:30 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:31.600031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:31.600649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:31.603938 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:16:31.609384 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:31.609865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:31.610662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:31.611097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:31.809921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:31.817980 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c21354c2-45f6-47b1-91fa-3a4189e68fc1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.221803 Mar 29 03:16:31.818531 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3385/6537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:31 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:32.215557 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:16:32.216053 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:16:32.315532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-e715a9ad-5d5e-4061-a9d2-9f298aaad7c6 req-9230e3bc-1100-45ea-892e-6995cdeb1359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:32.319953 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:32.319953 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:16:32.329570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e715a9ad-5d5e-4061-a9d2-9f298aaad7c6 req-9230e3bc-1100-45ea-892e-6995cdeb1359 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:32.330951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-e715a9ad-5d5e-4061-a9d2-9f298aaad7c6 req-9230e3bc-1100-45ea-892e-6995cdeb1359 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:32.352535 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-e715a9ad-5d5e-4061-a9d2-9f298aaad7c6 req-9230e3bc-1100-45ea-892e-6995cdeb1359 service nova] Creating event network-changed:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:16:32.359159 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-e715a9ad-5d5e-4061-a9d2-9f298aaad7c6 req-9230e3bc-1100-45ea-892e-6995cdeb1359 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047976 Mar 29 03:16:32.360045 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3153/6538] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:16:32.835277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:32.835892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:32.845930 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:32.846382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:32.847163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:32.847597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:32.903644 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57650. Mar 29 03:16:33.046650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:33.054962 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2a35fa59-c217-4680-92c9-e0041ce06adc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.223420 Mar 29 03:16:33.055644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3386/6539] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:32 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:34.073504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:34.074199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:34.081588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:34.082041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:34.082797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:34.083241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:34.443314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:34.451800 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9693092a-edf5-440a-95c8-138d41e12d65 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.382010 Mar 29 03:16:34.451985 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3154/6540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:34 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:35.468355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:35.469262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:35.476526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:35.477029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:35.477773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:35.478222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:35.671929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:35.680685 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6533dea9-74c7-4dac-a41b-ba2d13200ba0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.215487 Mar 29 03:16:35.681022 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3387/6541] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:35 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:36.697809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:36.698495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:36.706339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:36.706797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:36.707587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:36.708009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:36.901593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:36.909608 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1bcd79fe-4f95-46d5-95b3-e8fe4a6e9e0a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.215531 Mar 29 03:16:36.910160 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3155/6542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:36 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:37.927379 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:37.928002 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:37.935900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:37.936342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:37.937122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:37.937552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:38.133381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:38.141973 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70415f6a-b862-440f-b707-7312872101ec tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.218361 Mar 29 03:16:38.142527 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3388/6543] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:37 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:39.158831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:39.159441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:39.166528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:39.166981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:39.167759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:39.168196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:39.344604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6efe4769-b20d-4c03-89b6-4fb0635cbdd1 req-d01b0511-b84b-4e11-85f8-ee8196abe911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-plugged", "status": "completed", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:39.346326 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:39.346326 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:16:39.354687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6efe4769-b20d-4c03-89b6-4fb0635cbdd1 req-d01b0511-b84b-4e11-85f8-ee8196abe911 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:39.355165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6efe4769-b20d-4c03-89b6-4fb0635cbdd1 req-d01b0511-b84b-4e11-85f8-ee8196abe911 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:39.365693 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:39.371237 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6efe4769-b20d-4c03-89b6-4fb0635cbdd1 req-d01b0511-b84b-4e11-85f8-ee8196abe911 service nova] Creating event network-vif-plugged:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:16:39.374129 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5ddc110-4f9b-4d93-a201-5e343a5ffed7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.218968 Mar 29 03:16:39.374695 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3156/6544] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:39 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:39.376169 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6efe4769-b20d-4c03-89b6-4fb0635cbdd1 req-d01b0511-b84b-4e11-85f8-ee8196abe911 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039282 Mar 29 03:16:39.376750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3389/6545] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:16:40.391535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:40.392154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:40.399328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:40.399780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:40.400540 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:40.401009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:40.597778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:40.605837 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d8d75c97-90f7-40f5-9c1a-ed33cd935ddf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1363 microversion: 2.1 time: 0.217958 Mar 29 03:16:40.606387 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3157/6546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:40 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:41.623336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:41.623962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:41.631544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:41.631994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:41.632759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:41.633301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:41.828717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:41.836798 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-525d324a-faaa-470e-b96f-db439967f4ee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1550 microversion: 2.1 time: 0.218283 Mar 29 03:16:41.837379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3390/6547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:41 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1550 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:41.854009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:41.854516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:41.862320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:41.862773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:41.863548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:41.863996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:42.007892 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cd600391-fef6-45d9-8a17-6b9ab755b58f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157472 Mar 29 03:16:42.008535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3158/6548] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:16:41 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:16:43.638154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:43.639135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:43.649869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:43.650323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:43.650825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2e746c49-02f3-4c94-9513-2d08bd153590 req-1ab5e204-8cca-4871-8fec-d5481838314f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:16:43.651266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:43.651536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:43.652328 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:16:43.652328 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:16:43.672436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2e746c49-02f3-4c94-9513-2d08bd153590 req-1ab5e204-8cca-4871-8fec-d5481838314f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:43.672913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2e746c49-02f3-4c94-9513-2d08bd153590 req-1ab5e204-8cca-4871-8fec-d5481838314f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:43.703963 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2e746c49-02f3-4c94-9513-2d08bd153590 req-1ab5e204-8cca-4871-8fec-d5481838314f service nova] Creating event network-changed:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:16:43.709140 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2e746c49-02f3-4c94-9513-2d08bd153590 req-1ab5e204-8cca-4871-8fec-d5481838314f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061826 Mar 29 03:16:43.710321 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3159/6549] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:16:43.731968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:43.749656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:16:43.757820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:16:43.758166 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:16:43.758929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:16:43.759548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:16:43.760068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:16:44.036278 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d8f1f1c-eea6-45f9-abe2-cf2526ff4725 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/action" status: 202 len: 0 microversion: 2.1 time: 0.402741 Mar 29 03:16:44.037196 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3391/6550] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:16:43 2022] POST /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:16:44.045478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:44.052653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:44.060876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:44.061392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:44.062457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:44.062907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:44.413067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:44.422877 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da8b4422-d8ab-4af6-852b-18343aced374 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1559 microversion: 2.1 time: 0.381508 Mar 29 03:16:44.423760 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3160/6551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:44 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1559 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:45.439901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:45.440429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:45.447611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:45.448055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:45.448805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:45.449259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:45.765264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:45.773398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8f7d007-e33c-4ce5-acb1-87a3d8f9bf28 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1677 microversion: 2.1 time: 0.337420 Mar 29 03:16:45.773957 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3392/6552] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:45 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1677 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:46.790899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:46.791516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:46.798870 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:46.799325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:46.800110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:46.800537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:47.113172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:47.121799 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03695cab-0e5e-4e25-a057-3fa455db8971 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1677 microversion: 2.1 time: 0.334061 Mar 29 03:16:47.122355 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3161/6553] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:46 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1677 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:48.139058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:48.139670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:48.147075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:48.147522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:48.148290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:48.148725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:48.347005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:48.355059 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc012181-74bf-40c0-8f07-fb94e35ac1b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.220219 Mar 29 03:16:48.355609 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3393/6554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:48 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:49.372192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:49.372809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:49.380029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:49.380480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:49.381282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:49.381726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:49.578477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:49.586597 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f2f8dec8-10b6-4a0b-b8d7-3035c508cff3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.218032 Mar 29 03:16:49.587099 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3162/6555] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:49 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:50.604318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:50.604949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:50.612153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:50.612596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:50.613381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:50.613807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:50.810710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:50.818850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ddfd839-ec85-4a9e-9d9e-004d099d4989 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.218295 Mar 29 03:16:50.819410 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3394/6556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:50 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:51.835831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:51.836450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:51.844968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:51.845425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:51.846204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:51.846654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:52.050942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:52.059209 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16e37318-b791-4d91-ad2e-15ba01c253e7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.227147 Mar 29 03:16:52.059737 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3163/6557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:51 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:53.075374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:53.075990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:53.083552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:53.083996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:53.084763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:53.085333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:53.296136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:53.304144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3e826d3-912e-4d32-b213-3042fc1d7e76 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.232476 Mar 29 03:16:53.304700 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3395/6558] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:53 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:54.321019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:54.321635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:54.328891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:54.329357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:54.330120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:54.330563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:54.520873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:54.529477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d1e98fd-82e4-4542-b23e-3158a150859a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.212212 Mar 29 03:16:54.530039 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3164/6559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:54 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:55.546858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:55.547399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:55.554628 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:55.555068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:55.555820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:55.556251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:55.751886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:55.760031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80061c00-a6bb-4c78-b715-243c869a9ecf tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.217468 Mar 29 03:16:55.760581 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3396/6560] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:55 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:56.776973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:56.777591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:56.784809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:56.785286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:56.786047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:56.786484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:56.980594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:56.988622 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98739870-9fe2-4f16-b0f0-09281b83a88e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.215357 Mar 29 03:16:56.989205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3165/6561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:56 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:58.006042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:58.006583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:58.014453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:58.014901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:58.015656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:58.016083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:58.212104 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:58.220503 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-de51c0e8-011b-407b-9642-31344a119ed8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.218272 Mar 29 03:16:58.221095 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3397/6562] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:58 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:16:59.237295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:16:59.237907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:16:59.245134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:59.245589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:59.246351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:16:59.246789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:16:59.441493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:16:59.450269 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6e3f0c30-6ea4-42b4-acc4-877d02fe9eed tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.216634 Mar 29 03:16:59.450822 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3166/6563] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:16:59 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:00.467900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:00.468891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:00.476010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:00.479865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:00.479865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:00.479865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:00.673722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:00.682474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c5f09b90-6d52-4ae6-bf70-750c34c359f1 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.218411 Mar 29 03:17:00.682573 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3398/6564] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:00 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:01.699174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:01.699787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:01.706986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:01.707432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:01.708188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:01.708623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:01.898371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:01.906898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f7d9ceb-6b9f-4f1e-b919-773f17f7ffdc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.211484 Mar 29 03:17:01.907458 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3167/6565] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:01 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:02.924030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:02.924647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:02.932032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:02.932427 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:02.934024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:02.934140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:03.128609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:03.136786 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68aca225-dfee-4583-ae66-92803d96d03a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.216670 Mar 29 03:17:03.137377 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3399/6566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:02 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:04.154519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:04.155170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:04.162365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:04.162820 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:04.163588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:04.164030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:04.357974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:04.365958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce6e0f3c-c0f5-4e72-a4a3-96e3618bd150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.215957 Mar 29 03:17:04.366521 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3168/6567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:04 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:05.384110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:05.384752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:05.392631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:05.393112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:05.393870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:05.394301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:05.590423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:05.598768 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f054923a-cf9f-4f89-b6b2-0e751eec7226 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.218287 Mar 29 03:17:05.599266 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3400/6568] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:05 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:06.615371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:06.615936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:06.623189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:06.623639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:06.624402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:06.624855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:06.820328 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:06.828890 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03a2d56f-1333-4d4b-a492-b9017fefea03 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.217232 Mar 29 03:17:06.829444 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3169/6569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:06 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:07.846154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:07.846758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:07.854008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:07.854449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:07.855198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:07.856111 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:08.050476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:08.058667 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e54edad6-00d7-4850-a3ea-a0349c3eee92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.216476 Mar 29 03:17:08.059229 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3401/6570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:07 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:09.075915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:09.076641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:09.083887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:09.084334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:09.085121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:09.085556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:09.279307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:09.287393 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38b96028-941b-4ec0-9dbd-1a31ba977533 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.215602 Mar 29 03:17:09.287948 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3170/6571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:09 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:10.304205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:10.304821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:10.312036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:10.312485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:10.313292 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:10.313729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:10.508198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:10.517061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-abf09290-b17f-4ce4-b115-d179d0c10929 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.216474 Mar 29 03:17:10.517711 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3402/6572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:10 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:11.534365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:11.534987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:11.542320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:11.542783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:11.543552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:11.543993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:11.739881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:11.748494 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f3a1338e-e6f8-498a-8c90-064c46d5bb98 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.217851 Mar 29 03:17:11.749087 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3171/6573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:11 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:12.765939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:12.766548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:12.773794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:12.774239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:12.774994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:12.775424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:12.970721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:12.978789 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d53e0a6f-7345-457f-ba6d-a45e4cab7fcd tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.217308 Mar 29 03:17:12.979350 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3403/6574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:12 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:13.996057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:13.996606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:14.000529 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:17:14.001131 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:17:14.005988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:14.006456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:14.007227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:14.007674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:14.218764 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:14.227163 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-847fb9ee-efc3-4fbb-9eab-b06fae432185 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1682 microversion: 2.1 time: 0.234817 Mar 29 03:17:14.227727 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3172/6575] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:13 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1682 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:15.188012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-unplugged", "status": "completed", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:15.189619 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:15.189619 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:17:15.197567 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:15.198007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:15.214553 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] Creating event network-vif-unplugged:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h2-828148-1 Mar 29 03:17:15.221692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] Instance 95d20c61-afe8-49fc-932e-bc4d501440ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:17:15.232105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8dbf6c10-fc32-4dfa-a090-d81dcffa895e req-67ac4bd8-aa89-44e2-be0c-bb2be44ff4ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047713 Mar 29 03:17:15.232684 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3404/6576] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:15.244567 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:15.249136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:15.258551 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57758. Mar 29 03:17:15.265418 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 57756. Mar 29 03:17:15.269734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:15.270199 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:15.270998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:15.271425 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:15.493807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:15.502648 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-edd70f9e-20f5-4e61-93de-36944671223d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1681 microversion: 2.1 time: 0.261704 Mar 29 03:17:15.503783 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3173/6577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:15 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:16.521849 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:16.522557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:16.530065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:16.530448 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:16.531214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:16.531647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:16.871397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:16.880391 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6af8cb85-56b4-4c25-bc9d-390cbbdf7cad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1681 microversion: 2.1 time: 0.363012 Mar 29 03:17:16.880983 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3405/6578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:16 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1681 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:17.245168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:17.246695 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:17.246695 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:17:17.254779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:17.255230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:17.271578 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] Creating event network-changed:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h2-828148-1 Mar 29 03:17:17.277786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] Instance 95d20c61-afe8-49fc-932e-bc4d501440ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:17:17.288737 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-69f416e8-2f75-4e43-aff1-3772aa943e42 req-f96f03d2-5751-4518-bb60-3e7ae1b7f828 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047175 Mar 29 03:17:17.289337 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3174/6579] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:17.896611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:17.897249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:17.904872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:17.905324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:17.906101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:17.906533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:18.252503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:18.260624 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23306ea8-b710-461b-927d-2bed27929fee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1679 microversion: 2.1 time: 0.367696 Mar 29 03:17:18.261426 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3406/6580] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:17 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1679 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:19.278562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:19.279257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:19.286773 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.287228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.287986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.288432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.486241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:19.494305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8258c7ec-6191-4f44-9b00-01c0dedcc0b7 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1676 microversion: 2.1 time: 0.219901 Mar 29 03:17:19.494861 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3175/6581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:19 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:19.510828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:19.511361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:19.518587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.519031 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.519786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.520210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.587093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.587534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.588321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:19.588751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:19.609173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:17:19.614257 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:17:20.059252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17554100-ff55-4ca5-baa4-0dc4b8d76b4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/action" status: 202 len: 0 microversion: 2.1 time: 0.551821 Mar 29 03:17:20.059840 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3407/6582] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:17:19 2022] POST /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:17:20.067785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:20.068403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:20.075625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:20.076082 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:20.076887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:20.077333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:20.287703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:20.295866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-571d0345-fe95-4563-99d4-6fd97bddbb32 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.231781 Mar 29 03:17:20.296629 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3176/6583] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:20 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:21.314442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:21.315056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:21.322639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:21.323087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:21.323852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:21.324514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:21.527563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:21.536132 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-983de04f-1a2a-4c28-b091-84479030a441 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.226482 Mar 29 03:17:21.536688 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3408/6584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:21 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:22.538625 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-plugged", "status": "completed", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:22.540131 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:22.540131 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:17:22.550235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:22.550676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:22.553700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:22.554308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:22.562363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:22.562799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:22.563546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:22.563970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:22.568141 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] Creating event network-vif-plugged:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h2-828148-1 Mar 29 03:17:22.574509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] Instance 95d20c61-afe8-49fc-932e-bc4d501440ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:17:22.585559 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-88982868-c801-41c5-b32d-774a243a4f18 req-6ebec985-1764-4a24-98ed-dc01354cd7f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050592 Mar 29 03:17:22.586281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3177/6585] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:22.869613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:22.880039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c62483ef-f1f3-4d35-9964-c754b76a80be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.329927 Mar 29 03:17:22.884963 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3409/6586] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:22 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:23.902500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:23.903262 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:23.910747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:23.911191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:23.911960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:23.912440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:24.048336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-unplugged", "status": "completed", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:24.049956 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:24.049956 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:17:24.058739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:24.059175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:24.084258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] Creating event network-vif-unplugged:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:17:24.090693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] Instance 95d20c61-afe8-49fc-932e-bc4d501440ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:17:24.102308 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3a691edf-a347-4c9c-97d3-4f4bad5cd03c req-1f2b4f1b-2c2b-42cc-8dba-8141098b8ebd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058639 Mar 29 03:17:24.103063 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3410/6587] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:17:24.180498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:24.189286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d84eaf9-bc72-4175-afa3-300291806e7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.290848 Mar 29 03:17:24.190054 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3178/6588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:23 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:25.207432 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:25.208160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:25.215932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:25.216370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:25.217225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:25.217654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:25.415663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:25.423940 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c94977ff-d3b2-4a75-a031-19f60467609e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.220759 Mar 29 03:17:25.440348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3411/6589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:25 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:26.123738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:26.125238 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:26.125238 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:17:26.133276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:26.133719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:26.149545 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] Creating event network-changed:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:17:26.156196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] Instance 95d20c61-afe8-49fc-932e-bc4d501440ca is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:17:26.166569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b38ff4cc-4501-454a-b56c-5a88513c93be req-f110e366-22e5-4ae6-8941-9cc19003f7ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046481 Mar 29 03:17:26.167129 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3179/6590] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:26.441109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:26.442076 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:26.449660 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:26.450692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:26.451575 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:26.452112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:26.762304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:26.771727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-69166dd8-4683-4c24-996a-5a043e1c8238 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.334204 Mar 29 03:17:26.780883 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3412/6591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:26 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:27.789484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:27.790208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:27.798150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:27.798607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:27.799370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:27.799808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:27.994190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:28.002854 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6812d176-a3f1-42db-824e-86a5af63740b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1675 microversion: 2.1 time: 0.217503 Mar 29 03:17:28.003415 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3180/6592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:27 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:29.019859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:29.020386 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:29.027759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.030340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.030340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.030340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.220815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:29.228921 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ac86c3d5-d070-41f2-b7b7-30b8979fdaa4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1668 microversion: 2.1 time: 0.212903 Mar 29 03:17:29.229488 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3413/6593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:29 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1668 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:29.245249 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:29.245866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:29.253589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.254050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.254808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.255250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.454534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:29.462763 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9eae995-01bc-4836-af34-9ce4364796aa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1668 microversion: 2.1 time: 0.221109 Mar 29 03:17:29.463339 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3181/6594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:29 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1668 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:29.478745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:29.479357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:29.487032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.487480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.488239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.488672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.684419 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:29.692961 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cec98f95-d230-47c4-8c9f-c464ab875e88 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1668 microversion: 2.1 time: 0.217782 Mar 29 03:17:29.693536 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3414/6595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:29 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:29.708875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:29.709381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:29.716997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.717454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.718524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:29.718968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:29.778964 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:17:30.102014 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8b37ab7-f211-48a9-842f-2a56ce26f8b3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 204 len: 0 microversion: 2.1 time: 0.396555 Mar 29 03:17:30.102608 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3182/6596] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:17:29 2022] DELETE /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:17:30.110591 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:30.116312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:30.118534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:30.118977 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:30.119734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:30.120162 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:30.315630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:30.323878 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ccbe2ff0-8596-40d8-8a9d-4a249ac27785 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1674 microversion: 2.1 time: 0.216951 Mar 29 03:17:30.324462 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3415/6597] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:30 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:31.342340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:31.343325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:31.351631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:31.352083 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:31.352857 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:31.353301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:31.555745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:31.564098 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-72f492a2-b3a6-49a5-9a05-7e526fc4edd2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1674 microversion: 2.1 time: 0.226724 Mar 29 03:17:31.564665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3183/6598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:31 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:31.701741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4d689708-b62e-48f0-802c-d34a3cac0d56 req-3b946d9a-f149-4107-997a-bd34005c5cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-plugged", "status": "completed", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:31.703244 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:31.703244 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:17:31.711734 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4d689708-b62e-48f0-802c-d34a3cac0d56 req-3b946d9a-f149-4107-997a-bd34005c5cda service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:31.712168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4d689708-b62e-48f0-802c-d34a3cac0d56 req-3b946d9a-f149-4107-997a-bd34005c5cda service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:31.729810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4d689708-b62e-48f0-802c-d34a3cac0d56 req-3b946d9a-f149-4107-997a-bd34005c5cda service nova] Creating event network-vif-plugged:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:17:31.734872 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4d689708-b62e-48f0-802c-d34a3cac0d56 req-3b946d9a-f149-4107-997a-bd34005c5cda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Mar 29 03:17:31.735628 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3416/6599] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:32.615448 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:32.879486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:32.888939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c338cd85-6e59-4107-ad34-fc173bade31d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1607 microversion: 2.1 time: 0.310632 Mar 29 03:17:32.889617 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3184/6600] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:32 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1607 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:33.179603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-0b6ccf44-2bab-4d0f-a34a-d810a23e3675 req-3d21ff9e-a69f-48ca-950e-c970fded89e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d20c61-afe8-49fc-932e-bc4d501440ca", "name": "network-vif-deleted", "tag": "ad6e7ace-b84e-49f8-90c4-c092c30b5ab5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:33.181355 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:33.181355 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:17:33.190344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0b6ccf44-2bab-4d0f-a34a-d810a23e3675 req-3d21ff9e-a69f-48ca-950e-c970fded89e5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:33.203672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-0b6ccf44-2bab-4d0f-a34a-d810a23e3675 req-3d21ff9e-a69f-48ca-950e-c970fded89e5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:33.206529 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-0b6ccf44-2bab-4d0f-a34a-d810a23e3675 req-3d21ff9e-a69f-48ca-950e-c970fded89e5 service nova] Creating event network-vif-deleted:ad6e7ace-b84e-49f8-90c4-c092c30b5ab5 for instance 95d20c61-afe8-49fc-932e-bc4d501440ca on n-h1-828148-1 Mar 29 03:17:33.211144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-0b6ccf44-2bab-4d0f-a34a-d810a23e3675 req-3d21ff9e-a69f-48ca-950e-c970fded89e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035842 Mar 29 03:17:33.211927 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3417/6601] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:17:33.906363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:33.906997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:33.914952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:33.915623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:33.916674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:33.917179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:34.002917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:34.003708 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:34.004514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lazy-loading 'fault' on Instance uuid 95d20c61-afe8-49fc-932e-bc4d501440ca {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:17:34.167001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:34.175693 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-55be31a5-2b74-4156-878a-732d3b067a7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 200 len: 1328 microversion: 2.1 time: 0.273093 Mar 29 03:17:34.176264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3185/6602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:33 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 1328 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:35.196163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:35.196925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:35.204981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:35.205428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:35.206191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:35.206621 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:35.255387 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. Mar 29 03:17:35.255975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:17:35.256779 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9651d4a5-57ed-4563-83b3-f4a8a04f7d9c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 404 len: 111 microversion: 2.1 time: 0.064745 Mar 29 03:17:35.257333 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3418/6603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:35 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:17:35.276444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:35.277093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:35.284279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:35.284736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:35.285536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:35.285975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:35.337445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. Mar 29 03:17:35.338043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:17:35.338863 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d2813da-9ade-4938-b5af-41e89478abc6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 404 len: 111 microversion: 2.1 time: 0.066088 Mar 29 03:17:35.339390 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3186/6604] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:35 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:17:35.388928 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-746469262", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "3c35080c-aadd-4a7b-8411-10552cc83e04"}], "security_groups": [{"name": "tempest-securitygroup--534510013"}], "key_name": "tempest-keypair-1656503787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:35.501410 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] validate_networks() for [('3c35080c-aadd-4a7b-8411-10552cc83e04', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:17:36.129522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:17:36.129969 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:17:36.130439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:17:36.130840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:17:36.131245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:17:36.139931 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:36.140364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:36.141185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:36.141615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:36.158651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:17:36.163696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:17:36.175144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:17:36.177406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:17:36.280737 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0cb5f5ae-7b2c-4e28-948d-9ab85db5df4d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.895469 Mar 29 03:17:36.281734 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3419/6605] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:17:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:17:36.291524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5ea23b71-b037-424a-9011-34f9833b941f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:36.292143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5ea23b71-b037-424a-9011-34f9833b941f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:36.362173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5ea23b71-b037-424a-9011-34f9833b941f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:36.369685 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5ea23b71-b037-424a-9011-34f9833b941f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1238 microversion: 2.1 time: 0.081913 Mar 29 03:17:36.370253 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3187/6606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:36 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:37.388168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:37.388825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:37.396054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:37.397024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:37.397412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:37.397843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:37.517378 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:37.521484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d0889858-0b4a-4f6b-9e5d-1682bd6fbf0e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1242 microversion: 2.1 time: 0.137806 Mar 29 03:17:37.522037 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3420/6607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:37 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:38.538149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:38.539481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:38.548098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:38.548674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:38.549575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:38.550077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:38.667122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:38.675443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e8d9720-c3c8-4e0a-9ad1-ed233c706224 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1308 microversion: 2.1 time: 0.140903 Mar 29 03:17:38.676067 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3188/6608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:38 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:39.693309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:39.693920 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:39.701143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:39.701589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:39.702351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:39.702785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:40.072551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:40.081155 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd855483-6078-4dec-aac6-1fab94b7fb10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.391493 Mar 29 03:17:40.081786 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3421/6609] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:39 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:40.579609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7a0baaf4-8534-4a3d-ba9c-3c139730fcff req-0647ab6a-8536-4166-a4a6-383eed5ee25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:40.584275 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:40.584275 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:17:40.590420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7a0baaf4-8534-4a3d-ba9c-3c139730fcff req-0647ab6a-8536-4166-a4a6-383eed5ee25e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:40.590923 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7a0baaf4-8534-4a3d-ba9c-3c139730fcff req-0647ab6a-8536-4166-a4a6-383eed5ee25e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:40.608230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7a0baaf4-8534-4a3d-ba9c-3c139730fcff req-0647ab6a-8536-4166-a4a6-383eed5ee25e service nova] Creating event network-changed:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:17:40.617789 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7a0baaf4-8534-4a3d-ba9c-3c139730fcff req-0647ab6a-8536-4166-a4a6-383eed5ee25e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036860 Mar 29 03:17:40.617789 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3189/6610] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:41.099099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:41.099729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:41.107531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:41.107974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:41.108729 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:41.109186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:41.300669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:41.308772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e8c3369-fdf5-4220-a1b6-90f945d4ed4f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.213438 Mar 29 03:17:41.309362 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3422/6611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:41 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:42.326384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:42.327091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:42.334455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:42.334913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:42.335678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:42.336120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:42.599359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:42.608093 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d253ebb-55b3-4d95-b910-da329a0b585a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.285853 Mar 29 03:17:42.608655 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3190/6612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:42 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:43.628365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:43.629774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:43.639653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:43.640267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:43.641226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:43.641805 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:43.851674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:43.860414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cb80e7b6-cd22-49e2-bcdf-3bdf9c48c997 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.239248 Mar 29 03:17:43.860996 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3423/6613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:43 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:44.877573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:44.878185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:44.885359 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:44.885809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:44.886569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:44.887003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:45.084637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:45.093471 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-49fc61c3-46a3-4c7e-8451-a2fcd04b0900 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.219647 Mar 29 03:17:45.094023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3191/6614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:44 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:45.719807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c8ffb497-41aa-449a-8515-0a6c0167742a req-be8109d1-bf6f-41b6-8d66-e8fe977fc6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-plugged", "status": "completed", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:45.721462 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:45.721462 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:17:45.729447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8ffb497-41aa-449a-8515-0a6c0167742a req-be8109d1-bf6f-41b6-8d66-e8fe977fc6d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:45.729884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c8ffb497-41aa-449a-8515-0a6c0167742a req-be8109d1-bf6f-41b6-8d66-e8fe977fc6d3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:45.745718 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c8ffb497-41aa-449a-8515-0a6c0167742a req-be8109d1-bf6f-41b6-8d66-e8fe977fc6d3 service nova] Creating event network-vif-plugged:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:17:45.750668 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c8ffb497-41aa-449a-8515-0a6c0167742a req-be8109d1-bf6f-41b6-8d66-e8fe977fc6d3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035366 Mar 29 03:17:45.751223 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3424/6615] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:46.110653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:46.111285 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:46.118681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:46.119145 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:46.119920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:46.120373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:46.311571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:46.319672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-95f6f1dc-35dc-4816-82e1-c66ccdb64b49 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.212882 Mar 29 03:17:46.320227 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3192/6616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:46 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:47.337736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:47.338431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:47.346720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:47.347160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:47.347990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:47.348417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:47.616120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:47.624734 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5cc317d9-bce6-4f0e-af08-dae02aa84ffc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1363 microversion: 2.1 time: 0.291065 Mar 29 03:17:47.625313 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3425/6617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:47 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:48.641928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:48.642549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:48.649802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:48.650256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:48.651014 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:48.651449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:48.891670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:48.899674 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dc394eee-c20b-4ec0-8dff-d11f468efdfe tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1550 microversion: 2.1 time: 0.261402 Mar 29 03:17:48.900226 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3193/6618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:48 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1550 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:48.916674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:48.917201 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:48.924316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:48.924760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:48.925558 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:48.925989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:49.071926 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ce3cb443-67c1-4774-be8b-699632452d10 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158836 Mar 29 03:17:49.072521 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3426/6619] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:17:48 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:50.695103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4c84cae1-1b41-4a63-bbaa-1250b4689dab req-e3c56061-5e78-442e-bc50-c0f070f89ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:50.696601 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:17:50.696601 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:17:50.706508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4c84cae1-1b41-4a63-bbaa-1250b4689dab req-e3c56061-5e78-442e-bc50-c0f070f89ac0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:50.706949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4c84cae1-1b41-4a63-bbaa-1250b4689dab req-e3c56061-5e78-442e-bc50-c0f070f89ac0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:50.724318 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4c84cae1-1b41-4a63-bbaa-1250b4689dab req-e3c56061-5e78-442e-bc50-c0f070f89ac0 service nova] Creating event network-changed:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:17:50.729290 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4c84cae1-1b41-4a63-bbaa-1250b4689dab req-e3c56061-5e78-442e-bc50-c0f070f89ac0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037647 Mar 29 03:17:50.732081 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3194/6620] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:17:53.622525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:17:53.623070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:53.630318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:53.630757 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:53.631522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:53.631947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:53.827975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:17:53.835938 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ac61773-6b8d-4835-a769-c494ff6f4ab8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1668 microversion: 2.1 time: 0.217597 Mar 29 03:17:53.836492 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3427/6621] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:17:53 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1668 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:17:53.852793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56bd64c6-ba71-4c14-a0dd-b29de5c4af07"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:17:53.854005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:17:53.861381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:53.861841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:53.862609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:17:53.863050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:17:54.603573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db5e7440-23ac-4630-a3b5-6087cc53dcd8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754785 Mar 29 03:17:54.604246 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3195/6622] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 03:17:53 2022] POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:03.442546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:03.443499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:03.451624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:03.452072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:03.452828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:03.453288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:03.519508 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:03.531321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Old instance type m1.heat2, new instance type m1.heat {{(pid=103513) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:18:03.538568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:18:03.538986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:18:03.539456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:18:03.539860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:18:03.540268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:18:03.775304 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-938da1d5-6dbc-4d3a-9fe8-738267e49b92 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/action" status: 202 len: 0 microversion: 2.1 time: 0.333364 Mar 29 03:18:03.775304 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3428/6623] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:18:03 2022] POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:18:03.785734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:03.785734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:03.796460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:03.796460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:03.796460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:03.796460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:04.001626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:04.010617 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0d280e6f-0938-42db-9b7f-6ca43989f78b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1723 microversion: 2.1 time: 0.233376 Mar 29 03:18:04.011172 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3196/6624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:03 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:05.027497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:05.028608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:05.036122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:05.036590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:05.037385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:05.037821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:05.236355 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:05.244907 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a8a04134-523b-4ba2-8d44-c165e3241af5 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1723 microversion: 2.1 time: 0.221223 Mar 29 03:18:05.245471 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3429/6625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:05 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:06.262016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:06.262711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:06.270349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:06.270800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:06.271566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:06.272000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:06.475765 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:06.485079 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9eb0bb86-a83b-48e7-b91f-c7729b8b9687 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1723 microversion: 2.1 time: 0.226671 Mar 29 03:18:06.485668 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3197/6626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:06 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:07.503027 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:07.503649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:07.511300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:07.511764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:07.512539 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:07.513009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:07.714971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:07.723977 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd4194ee-726f-460e-851b-96afeaf4a5ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.224699 Mar 29 03:18:07.724528 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3430/6627] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:07 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:08.741985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:08.742606 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:08.750246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:08.750701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:08.751472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:08.751910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:09.098392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:09.107541 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8a41c5d3-9a26-4beb-8050-bb66c8931fd6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.369263 Mar 29 03:18:09.108105 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3198/6628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:08 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:10.124900 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:10.125519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:10.132709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:10.133191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:10.133955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:10.134380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:10.328668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:10.337283 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-34568b97-8ae1-4d84-ab7d-1bb9f790e006 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.216587 Mar 29 03:18:10.337839 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3431/6629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:10 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:11.354365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:11.354980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:11.363808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:11.364380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:11.365182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:11.365623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:11.569641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:11.578684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dd3111cd-b794-4b02-99cb-2bd53e1d6ab0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.227950 Mar 29 03:18:11.579234 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3199/6630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:11 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:12.069680 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:18:12.069841 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:18:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:18:12.596345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:12.596984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:12.604371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:12.604820 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:12.605641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:12.606680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:12.803255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:12.811799 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f8be9c9-ccba-4cee-88c2-92aac9a67bee tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.219560 Mar 29 03:18:12.812342 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3432/6631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:12 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:13.828944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:13.829559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:13.836862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:13.837321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:13.838076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:13.838514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:14.030153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:14.038754 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7f824cb-4995-47fa-93e4-0a444a12e66b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.213569 Mar 29 03:18:14.039305 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3200/6632] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:13 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:15.056198 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:15.056766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:15.064535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:15.065020 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:15.065782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:15.066212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:15.259798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:15.268405 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b3412f2-7eb4-47a2-ba04-968288db5a7a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.215933 Mar 29 03:18:15.268985 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3433/6633] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:15 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:16.284616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:16.285267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:16.292675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:16.293169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:16.294078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:16.294520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:16.499593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:16.508821 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-238629f0-3a1b-4a70-8110-7bccdb57caf4 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.227849 Mar 29 03:18:16.509435 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3201/6634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:16 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:17.533611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:17.534246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:17.541481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:17.541925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:17.542676 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:17.543097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:17.733936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:17.742421 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-70eae1de-39bd-4d62-b9c4-8c0f397164fa tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.212553 Mar 29 03:18:17.742981 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3434/6635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:17 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:18.759237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:18.759853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:18.767465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:18.772637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:18.772637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:18.772637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:18.964363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:18.973918 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9c040ec4-6c39-4f2a-a1e8-7b2297ddc803 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.218333 Mar 29 03:18:18.974464 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3202/6636] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:18 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:19.991122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:19.991670 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:19.998876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:19.999319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:20.000136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:20.000564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:20.195818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:20.205006 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d2ec4e9-e0d0-47ce-8745-478b4b969836 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1728 microversion: 2.1 time: 0.217718 Mar 29 03:18:20.205567 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3435/6637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:19 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:21.000564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-unplugged", "status": "completed", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:21.002261 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:21.002261 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:18:21.010881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:21.011843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:21.027549 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] Creating event network-vif-unplugged:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h2-828148-1 Mar 29 03:18:21.033755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:18:21.044958 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-04745c85-02d3-42b7-aaaf-facbd14fa0a4 req-ac801fed-3e05-4fd9-a670-79a5371daddf service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048658 Mar 29 03:18:21.045525 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3203/6638] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:21.222329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:21.222935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:21.230859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:21.232124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:21.233179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:21.233836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:21.786453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:21.792073 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c19c9cb6-8021-4e74-8196-67d57f4aa5d0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1727 microversion: 2.1 time: 0.573432 Mar 29 03:18:21.792645 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3436/6639] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:21 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1727 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:22.810887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:22.811589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:22.820004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:22.820466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:22.821269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:22.821713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:23.013818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:23.022608 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-32fd2674-f39b-4cc7-9ef2-0f4a4619287f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1727 microversion: 2.1 time: 0.216713 Mar 29 03:18:23.023189 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3204/6640] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:22 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:23.057579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:23.059067 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:23.059067 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:18:23.067168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:23.067685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:23.083478 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] Creating event network-changed:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h2-828148-1 Mar 29 03:18:23.089717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:18:23.100880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3619f88c-7fac-47a1-be58-8710ca18727a req-d6c3e2cc-a1a2-40ac-80af-aa857944aa04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046922 Mar 29 03:18:23.101466 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3437/6641] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:24.039368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:24.040617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:24.049148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:24.049604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:24.050376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:24.050813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:24.259298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:24.269133 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7128a9b-d919-4614-9667-068a4206340d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.233427 Mar 29 03:18:24.269710 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3205/6642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:24 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:18:25.287098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:25.287793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:25.295264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:25.295706 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:25.296464 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:25.296926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:25.491359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:25.500528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-facf3739-d7e4-4efb-9152-1d3a2208e823 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.217608 Mar 29 03:18:25.501123 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3438/6643] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:25 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:26.518219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:26.518864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:26.526181 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:26.526642 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:26.527419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:26.527863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:26.724639 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:26.733392 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7451b5c3-c746-4470-bfe6-702179f4580c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.218941 Mar 29 03:18:26.733946 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3206/6644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:26 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:27.750759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:27.751377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:27.758684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:27.759135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:27.759892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:27.760323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:27.959799 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:27.969540 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-50402dec-631f-4e12-a91a-52cca97b3510 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.222457 Mar 29 03:18:27.970106 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3439/6645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:27 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:28.986961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:28.987516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:28.994881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:28.995332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:28.996095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:28.996526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:29.191598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:29.200631 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03dd40c6-e192-42cf-a10a-0d9e1cec5d57 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.216963 Mar 29 03:18:29.201209 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3207/6646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:28 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:30.217751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:30.218366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:30.225542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:30.225988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:30.226754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:30.227189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:30.419622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:30.433658 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ce4d9aa-6aaa-4a92-aac3-7f138423a1c2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.219811 Mar 29 03:18:30.434231 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3440/6647] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:30 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:31.450908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:31.451534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:31.459052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:31.459522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:31.460301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:31.460759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:31.662915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:31.672117 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41a0c794-d6c3-4b24-9384-e3da687893cb tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1725 microversion: 2.1 time: 0.225459 Mar 29 03:18:31.673040 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3208/6648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:31 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:32.686867 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:18:32.690173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:32.690782 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:32.698124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:32.698407 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:32.699168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:32.699593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:32.898236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:32.917757 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b29e550a-8f97-4694-bd3f-f4359e886ed6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1722 microversion: 2.1 time: 0.232229 Mar 29 03:18:32.921000 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3441/6649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:32 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:32.934994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:32.935537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:32.942981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:32.943460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:32.944261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:32.944698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:33.013402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:33.013848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:33.014636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:33.015071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:33.035288 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:18:33.040291 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Getting quotas for user 298a913587524ac5901c134897fa6736 and project 9abaff75da344fe69ea623f2e5af0259. Resources: {'cores', 'ram'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:18:33.437887 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3dc5b4bd-7e92-4c7c-9190-80a838d687b0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/action" status: 202 len: 0 microversion: 2.1 time: 0.506346 Mar 29 03:18:33.438545 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3209/6650] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:18:32 2022] POST /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:18:33.446438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:33.447050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:33.455053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:33.455499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:33.456275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:33.456705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:33.695183 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58018. Mar 29 03:18:33.887513 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:33.898676 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19a75002-48f2-45a3-ad00-5d7f9f356631 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.453780 Mar 29 03:18:33.898676 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3442/6651] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:33 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:34.911987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-plugged", "status": "completed", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:34.914274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:34.914672 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:34.914672 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:18:34.914833 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:34.921709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:34.922131 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:34.922246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:34.922585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:34.922898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:34.923640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:34.940104 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] Creating event network-vif-plugged:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h2-828148-1 Mar 29 03:18:34.947066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:18:34.958173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-5e33921e-596f-4bd1-9907-5a75d9f785e9 req-5ded4e93-b69e-4fe4-b489-76fe9f075dce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101840 Mar 29 03:18:34.958767 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3210/6652] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:35.132741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:35.141395 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e63a9c99-cada-494b-bca9-e238c3153150 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.232505 Mar 29 03:18:35.141951 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3443/6653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:34 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:18:36.159029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:36.159736 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:36.167226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:36.167679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:36.168971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:36.169418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:36.369078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:36.377713 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0da2d4a9-5d08-458e-a120-4bbd974044be tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.222800 Mar 29 03:18:36.378361 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3211/6654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:36 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:37.395214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:37.395895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:37.403312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:37.403751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:37.404500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:37.404951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:37.602339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:37.612381 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7874b923-ad0e-4730-ad7d-1585aba49f54 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.220363 Mar 29 03:18:37.612550 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3444/6655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:37 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:38.524148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-unplugged", "status": "completed", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:38.525711 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:38.525711 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:18:38.534589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:38.535041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:38.551539 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] Creating event network-vif-unplugged:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:18:38.557792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103514) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:18:38.568490 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-07c82b0a-d9e6-4e58-bd4b-3d5937317e6b req-99d582f7-8514-4982-9220-c3cea7cc7a59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047998 Mar 29 03:18:38.569105 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3212/6656] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:38.629650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:38.631061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:38.639272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:38.639817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:38.640704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:38.641228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:39.185682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:39.194255 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-498f275b-d9af-4804-8f69-122abad67efc tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.568980 Mar 29 03:18:39.194810 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3445/6657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:38 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:40.211356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:40.212059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:40.219702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:40.220155 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:40.220946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:40.221383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:40.427733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:40.437228 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e39e860-0212-4673-83c0-988cc019ee7e tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.230028 Mar 29 03:18:40.437902 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3213/6658] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:40 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:40.582325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:40.583853 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:40.583853 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:18:40.592283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:40.592722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:40.609975 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] Creating event network-changed:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:18:40.616736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:18:40.628884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c13f8c21-170e-4a0d-8ab9-02053d6ce0ab req-16365216-9b02-4fe2-aede-1c21ef61480c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049942 Mar 29 03:18:40.631735 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3446/6659] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:41.454485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:41.455803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:41.463514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:41.463977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:41.466041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:41.466041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:41.689284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:41.698273 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa31935e-ab80-4e15-9304-16e6ebe75531 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.248470 Mar 29 03:18:41.698837 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3214/6660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:41 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:42.716727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:42.717463 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:42.725042 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:42.725495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:42.726258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:42.726696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:42.924978 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:42.933821 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-99c0c045-c150-456e-9a5f-be19b209d894 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.221508 Mar 29 03:18:42.934937 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3447/6661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:42 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:43.951449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:43.952608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:43.960204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:43.960660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:43.961464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:43.961906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:44.155677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:44.164245 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cfbc72be-2eca-4897-a861-6dfe220412db tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.216502 Mar 29 03:18:44.164747 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3215/6662] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:43 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:45.180671 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:45.181307 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:45.188466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:45.188941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:45.189691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:45.190120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:45.382745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:45.391812 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ebbe7971-0dd9-480a-9e15-60e3cf2775ad tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.214771 Mar 29 03:18:45.392483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3448/6663] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:45 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:46.410097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:46.410711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:46.418186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:46.418634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:46.419391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:46.420393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:46.715892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:46.725610 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6f6c26c-8194-4a8d-820e-aae8b9dde1a9 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.319445 Mar 29 03:18:46.726158 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3216/6664] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:46 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:47.742644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:47.743268 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:47.751147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:47.751599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:47.752366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:47.752802 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:47.948025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:47.956791 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e4b5e994-ec86-4d18-88c9-5b5d80a7488c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.217869 Mar 29 03:18:47.957379 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3449/6665] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:47 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:48.974091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:48.974643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:48.981803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:48.982307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:48.983066 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:48.983507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:49.178897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:49.188068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7304ac1-dee4-45c0-866b-af3902a9bf1d tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.217927 Mar 29 03:18:49.188622 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3217/6666] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:48 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:50.205522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:50.206052 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:50.213244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:50.213690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:50.214483 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:50.214911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:50.553580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:50.562966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75e21f64-56f1-4228-8d16-f01a940757c0 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1721 microversion: 2.1 time: 0.361745 Mar 29 03:18:50.573813 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3450/6667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:50 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:51.579286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:51.579905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:51.587215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:51.587674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:51.588441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:51.588915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:51.810307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:51.819441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9846693d-35ff-444f-8139-7274405a2af2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1714 microversion: 2.1 time: 0.243814 Mar 29 03:18:51.831853 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3218/6668] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:51 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1714 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:51.837502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:51.839194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:51.848336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:51.849092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:51.849877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:51.850325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.074421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-288f37da-13e2-4bc3-ae25-b7c607d479c5 req-4c6e8aeb-a0e8-4108-b92a-5db982bf21f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-plugged", "status": "completed", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:52.076258 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:52.076258 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:18:52.085757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-288f37da-13e2-4bc3-ae25-b7c607d479c5 req-4c6e8aeb-a0e8-4108-b92a-5db982bf21f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.086334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-288f37da-13e2-4bc3-ae25-b7c607d479c5 req-4c6e8aeb-a0e8-4108-b92a-5db982bf21f1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.102450 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-288f37da-13e2-4bc3-ae25-b7c607d479c5 req-4c6e8aeb-a0e8-4108-b92a-5db982bf21f1 service nova] Creating event network-vif-plugged:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:18:52.107408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-288f37da-13e2-4bc3-ae25-b7c607d479c5 req-4c6e8aeb-a0e8-4108-b92a-5db982bf21f1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036835 Mar 29 03:18:52.108474 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3219/6669] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:18:52.175511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:52.184605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a51d9f16-039e-410b-a7a4-9408a68936f6 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1714 microversion: 2.1 time: 0.351122 Mar 29 03:18:52.185783 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3451/6670] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:51 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1714 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:52.205514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:52.206494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:52.214383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.214842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.215679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.216545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.417940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:52.427527 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b3ec3d3-7dc5-43e3-8f6f-9dd2584d9d17 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1714 microversion: 2.1 time: 0.227075 Mar 29 03:18:52.428498 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3220/6671] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:52 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1714 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:52.444142 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:52.444873 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:52.452012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.452457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.453287 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.453768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.516753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:18:52.824797 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3096cec-2575-42f1-be85-4592c2576308 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 204 len: 0 microversion: 2.1 time: 0.384084 Mar 29 03:18:52.825486 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3452/6672] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:18:52 2022] DELETE /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:18:52.833654 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:52.834282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:52.841891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.842353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:52.843123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:52.844054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:53.041421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:53.050754 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78aa66ac-4e9c-42d2-bba6-82d33c213925 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1720 microversion: 2.1 time: 0.220819 Mar 29 03:18:53.051320 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3221/6673] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:52 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:54.069682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:54.070383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:54.077679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:54.078121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:54.078879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:54.079312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:54.276147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:54.285347 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4ee9aa10-ff1d-41f7-bc8d-ee04bb323303 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1720 microversion: 2.1 time: 0.219713 Mar 29 03:18:54.285914 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3453/6674] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:54 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1720 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:55.302573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:55.303109 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:55.310374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:55.310847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:55.311591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:55.312520 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:55.507908 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:55.516710 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-36453008-9ea6-4f42-ad50-8b373c984a9f tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1720 microversion: 2.1 time: 0.217925 Mar 29 03:18:55.517304 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3222/6675] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:55 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:56.108154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-35ad6d37-4fed-460f-958f-ef54f5c1193e req-d462fd19-1bd7-4e74-b6b2-f4e872074f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65ed37f-fd4c-4586-b9d4-1e4c9a578441", "name": "network-vif-deleted", "tag": "14b2c091-22bb-4936-9734-94b5d532d174"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:18:56.111326 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:18:56.111326 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:18:56.119846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-35ad6d37-4fed-460f-958f-ef54f5c1193e req-d462fd19-1bd7-4e74-b6b2-f4e872074f3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:56.124570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-35ad6d37-4fed-460f-958f-ef54f5c1193e req-d462fd19-1bd7-4e74-b6b2-f4e872074f3f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:56.136288 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-35ad6d37-4fed-460f-958f-ef54f5c1193e req-d462fd19-1bd7-4e74-b6b2-f4e872074f3f service nova] Creating event network-vif-deleted:14b2c091-22bb-4936-9734-94b5d532d174 for instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 on n-h1-828148-1 Mar 29 03:18:56.141748 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-35ad6d37-4fed-460f-958f-ef54f5c1193e req-d462fd19-1bd7-4e74-b6b2-f4e872074f3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037208 Mar 29 03:18:56.142465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3454/6676] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:18:56.533957 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:56.534630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:56.541905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:56.542363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:56.543138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:56.547519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:56.689271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298a913587524ac5901c134897fa6736', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9abaff75da344fe69ea623f2e5af0259', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:18:56.701431 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d6d4f3c-6076-4164-bbeb-2861bcccfb1a tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 200 len: 1369 microversion: 2.1 time: 0.168169 Mar 29 03:18:56.701431 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3223/6677] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:56 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:18:57.717118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:57.717846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:57.726217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:57.726713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:57.727471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:57.727883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:57.778653 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. Mar 29 03:18:57.779241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:18:57.780058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e697dae6-f426-4465-a970-487403b4f268 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 404 len: 111 microversion: 2.1 time: 0.067337 Mar 29 03:18:57.780590 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3455/6678] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:18:57 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:18:57.868337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:18:57.869374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:18:57.876598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:57.877096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:57.877867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:18:57.878309 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:18:57.924501 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. Mar 29 03:18:57.925135 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:18:57.925961 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-90e143cc-7567-4b1a-805e-5288d5fe3b7c tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061492 Mar 29 03:18:57.926513 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3224/6679] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:18:57 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441/os-volume_attachments => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.487066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.487598 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.494852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.495298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.496054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.496482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.545442 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. Mar 29 03:19:00.546039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.547467 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f63f5ed4-7c6e-4b71-b48a-ddafede9e53b tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 404 len: 111 microversion: 2.1 time: 0.064888 Mar 29 03:19:00.548003 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3456/6680] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:00 2022] DELETE /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.555781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.556397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d65ed37f-fd4c-4586-b9d4-1e4c9a578441] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.563661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.564117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.564910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.565364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.619616 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. Mar 29 03:19:00.620234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d65ed37f-fd4c-4586-b9d4-1e4c9a578441 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.621282 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ca5b3f32-8c1d-49f0-92de-cd5c66fc4ea8 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441" status: 404 len: 111 microversion: 2.1 time: 0.069170 Mar 29 03:19:00.622066 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3225/6681] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:00 2022] GET /compute/v2.1/servers/d65ed37f-fd4c-4586-b9d4-1e4c9a578441 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.629664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.630169 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.638364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.638819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.639599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.640563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.699905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. Mar 29 03:19:00.699905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.699905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f693c1c-0f26-4815-bb55-1e94aef54879 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 404 len: 111 microversion: 2.1 time: 0.066104 Mar 29 03:19:00.699905 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3457/6682] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:00 2022] DELETE /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.700604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.701409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: 95d20c61-afe8-49fc-932e-bc4d501440ca] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.709590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.710055 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.710891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.711340 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.760937 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. Mar 29 03:19:00.761553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance 95d20c61-afe8-49fc-932e-bc4d501440ca could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.762392 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a96500e-2ef9-42c7-a86d-907777945381 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca" status: 404 len: 111 microversion: 2.1 time: 0.065542 Mar 29 03:19:00.763152 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3226/6683] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:00 2022] GET /compute/v2.1/servers/95d20c61-afe8-49fc-932e-bc4d501440ca => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 03:19:00.771191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.771696 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.778935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.779383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.780146 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.781208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.830083 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. Mar 29 03:19:00.830688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.831518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-03fe1f4b-08b7-493e-bae7-8e82150e82c3 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 404 len: 111 microversion: 2.1 time: 0.063994 Mar 29 03:19:00.832254 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3458/6684] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:00 2022] DELETE /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.839921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.840660 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: a6f0cc3d-ee23-4794-9a72-c582d739aedf] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.849051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.849504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.850268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.850706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.899352 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. Mar 29 03:19:00.899879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance a6f0cc3d-ee23-4794-9a72-c582d739aedf could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.900703 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9edab4c2-3094-4c5c-a503-d503d4e67ec2 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf" status: 404 len: 111 microversion: 2.1 time: 0.064590 Mar 29 03:19:00.901268 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3227/6685] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:00 2022] GET /compute/v2.1/servers/a6f0cc3d-ee23-4794-9a72-c582d739aedf => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.910054 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.910560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.917844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.918293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.919064 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.919501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.973836 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. Mar 29 03:19:00.974359 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:00.975185 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-53f96c4a-0d9a-488b-ae4f-0eaf3f2e2a26 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 404 len: 111 microversion: 2.1 time: 0.069489 Mar 29 03:19:00.975734 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3459/6686] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:00 2022] DELETE /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:00.983522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:00.984168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] [instance: d74f971e-17ac-403b-b5d5-8d384a8984e9] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:00.991516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.991973 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:00.992737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:00.993276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:01.041761 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] HTTP exception thrown: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. Mar 29 03:19:01.042357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Returning 404 to user: Instance d74f971e-17ac-403b-b5d5-8d384a8984e9 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:01.043170 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-401b5081-5c05-4276-9263-b00871843962 tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9" status: 404 len: 111 microversion: 2.1 time: 0.063323 Mar 29 03:19:01.043696 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3228/6687] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:00 2022] GET /compute/v2.1/servers/d74f971e-17ac-403b-b5d5-8d384a8984e9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:01.051662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6d9e6efe-c2d5-40f4-8e3a-148d0962f8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] Calling method '.version_select at 0x7f8724d60a60>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:01.121286 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6d9e6efe-c2d5-40f4-8e3a-148d0962f8ff tempest-ServerActionsTestJSON-471630696 tempest-ServerActionsTestJSON-471630696-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656503787" status: 202 len: 0 microversion: 2.1 time: 0.073033 Mar 29 03:19:01.123280 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3460/6688] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Mar 29 03:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1656503787 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:19:11.228926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-914540392", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "c8432210-a238-4c4e-bb99-1717c2a54591"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:11.297988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] validate_networks() for [('c8432210-a238-4c4e-bb99-1717c2a54591', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:19:11.816856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:19:11.817290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:19:11.817766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:19:11.818177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:19:11.818617 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:19:11.826757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:11.827195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:11.827985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:11.828415 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:11.845517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Getting quotas for project 770f5e7aa287416299e1c66dd53f726a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:19:11.850614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Getting quotas for user d379e9177d65401d976e97195e54bafc and project 770f5e7aa287416299e1c66dd53f726a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:19:11.862622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:19:11.864855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:19:11.964378 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-86a02861-5fda-4be4-90e9-335e601162bd tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851954 Mar 29 03:19:11.964974 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3229/6689] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:19:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:19:11.975519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5ff2f89e-6764-4fbc-9a7c-3da8977b83e2 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:11.976108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5ff2f89e-6764-4fbc-9a7c-3da8977b83e2 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:12.046010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5ff2f89e-6764-4fbc-9a7c-3da8977b83e2 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:12.054293 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5ff2f89e-6764-4fbc-9a7c-3da8977b83e2 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1216 microversion: 2.1 time: 0.082567 Mar 29 03:19:12.054839 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3461/6690] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:11 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:13.070935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:13.071609 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:13.078954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:13.079413 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:13.082439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:13.082439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:13.192543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:13.200640 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ba1232b5-1f19-416b-ad50-6117a246c96a tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1220 microversion: 2.1 time: 0.133485 Mar 29 03:19:13.201231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3230/6691] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:13 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:14.216711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:14.218962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:14.226369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:14.226831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:14.227738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:14.228168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:14.373649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:14.382450 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0d1ef792-972a-4924-964b-1dce72124fca tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1286 microversion: 2.1 time: 0.169674 Mar 29 03:19:14.383019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3462/6692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:14 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:15.399640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:15.400252 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:15.407680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:15.408132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:15.408971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:15.409367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:15.607186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:15.616016 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e7ab63e-e359-45ab-a561-3e5c7c47d2ef tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.220430 Mar 29 03:19:15.616786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3231/6693] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:15 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:16.484904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-95044858-8ec7-49c7-aa21-11c12985456d req-49d4d763-62f0-4234-bc2c-0743af38d858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8873e1d5-db8f-49dc-b087-94e510a84116", "tag": "ba47fdcf-aac0-42dc-b0b3-4f541706afe4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:16.487161 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:16.487161 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:19:16.496470 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-95044858-8ec7-49c7-aa21-11c12985456d req-49d4d763-62f0-4234-bc2c-0743af38d858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:16.496644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-95044858-8ec7-49c7-aa21-11c12985456d req-49d4d763-62f0-4234-bc2c-0743af38d858 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:16.512683 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-95044858-8ec7-49c7-aa21-11c12985456d req-49d4d763-62f0-4234-bc2c-0743af38d858 service nova] Creating event network-changed:ba47fdcf-aac0-42dc-b0b3-4f541706afe4 for instance 8873e1d5-db8f-49dc-b087-94e510a84116 on n-h1-828148-1 Mar 29 03:19:16.518021 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-95044858-8ec7-49c7-aa21-11c12985456d req-49d4d763-62f0-4234-bc2c-0743af38d858 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095141 Mar 29 03:19:16.518628 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3463/6694] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:16.633556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:16.634142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:16.642072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:16.642621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:16.643341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:16.643787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:16.842683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:16.850929 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9752ab92-c204-46b9-97c2-4c8a2b7d9b54 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.221219 Mar 29 03:19:16.851500 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3232/6695] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:16 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:17.867828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:17.868527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:17.875832 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:17.876271 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:17.877053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:17.877481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:18.250740 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:18.258750 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-714fa056-ccd8-48ca-ad63-44ba3b04e5d7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.395010 Mar 29 03:19:18.267889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3464/6696] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:17 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:19.275830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:19.276445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:19.284410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:19.284882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:19.285651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:19.286090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:19.479696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:19.487904 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9854097b-8c4d-461f-a536-14210433df28 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.215761 Mar 29 03:19:19.488468 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3233/6697] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:19 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:20.504435 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:20.505080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:20.512452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:20.513053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:20.519046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:20.519046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:20.817698 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:20.825661 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ec7b78f-bf0d-44de-81b4-f8d1b8befdab tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.324987 Mar 29 03:19:20.826212 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3465/6698] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:20 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:21.842930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:21.843542 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:21.850769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:21.851221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:21.852005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:21.852440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:22.051998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:22.060058 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a4985292-2f47-4308-a64b-4423e143b37d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.221168 Mar 29 03:19:22.060637 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3234/6699] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:21 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:23.076771 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:23.077433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:23.085486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:23.085932 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:23.086694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:23.087121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:23.280018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:23.288114 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26802a48-0140-44c4-9df7-b5b8e2f8e0b1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.215147 Mar 29 03:19:23.288674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3466/6700] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:23 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:19:24.157626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1ac09a4a-8833-4ed8-ad2c-71489639d50f req-e1a88952-6e3b-48e2-b28b-13e0c400c669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8873e1d5-db8f-49dc-b087-94e510a84116", "name": "network-vif-plugged", "status": "completed", "tag": "ba47fdcf-aac0-42dc-b0b3-4f541706afe4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:24.159728 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:24.159728 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:19:24.167389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ac09a4a-8833-4ed8-ad2c-71489639d50f req-e1a88952-6e3b-48e2-b28b-13e0c400c669 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:24.167832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ac09a4a-8833-4ed8-ad2c-71489639d50f req-e1a88952-6e3b-48e2-b28b-13e0c400c669 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:24.183179 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1ac09a4a-8833-4ed8-ad2c-71489639d50f req-e1a88952-6e3b-48e2-b28b-13e0c400c669 service nova] Creating event network-vif-plugged:ba47fdcf-aac0-42dc-b0b3-4f541706afe4 for instance 8873e1d5-db8f-49dc-b087-94e510a84116 on n-h1-828148-1 Mar 29 03:19:24.188430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1ac09a4a-8833-4ed8-ad2c-71489639d50f req-e1a88952-6e3b-48e2-b28b-13e0c400c669 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Mar 29 03:19:24.189028 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3235/6701] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:24.304797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:24.305452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:24.313313 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:24.313762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:24.314521 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:24.314948 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:24.509831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:24.521210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4af467d8-3025-4332-a47b-76da8b47a0df tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.220401 Mar 29 03:19:24.521769 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3467/6702] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:24 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:25.538592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:25.539301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:25.546814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:25.547277 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:25.548043 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:25.548490 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:25.747996 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:25.756718 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e5060614-1bc6-4c17-ad6a-b8f37704542e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1316 microversion: 2.1 time: 0.222153 Mar 29 03:19:25.757310 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3236/6703] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:25 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:26.773866 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:26.774471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:26.782576 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:26.783026 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:26.783814 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:26.784234 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:26.980783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:26.988873 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3dd8e23-477c-48e9-b29e-d246f6928ab8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.218706 Mar 29 03:19:26.989438 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3468/6704] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:26 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:27.045634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1078776625", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "c8432210-a238-4c4e-bb99-1717c2a54591"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:27.108732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] validate_networks() for [('c8432210-a238-4c4e-bb99-1717c2a54591', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:19:27.728517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:19:27.729009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:19:27.729491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:19:27.729905 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:19:27.730318 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:19:27.739504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:27.739962 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:27.740769 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:27.741243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:27.758703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Getting quotas for project 770f5e7aa287416299e1c66dd53f726a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:19:27.763840 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Getting quotas for user d379e9177d65401d976e97195e54bafc and project 770f5e7aa287416299e1c66dd53f726a. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:19:27.775379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:19:27.777690 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:19:27.895944 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2b9ea04b-6576-4465-b5d8-bf214b39e674 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853863 Mar 29 03:19:27.896659 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3237/6705] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:19:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 29 03:19:27.906374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d8d9e502-3ca4-47dc-92c0-804f1e2c9964 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:27.906999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d8d9e502-3ca4-47dc-92c0-804f1e2c9964 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:27.976144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d8d9e502-3ca4-47dc-92c0-804f1e2c9964 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:27.983460 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d8d9e502-3ca4-47dc-92c0-804f1e2c9964 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1217 microversion: 2.1 time: 0.080774 Mar 29 03:19:27.984621 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3469/6706] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:27 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:29.001561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:29.002185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:29.009641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:29.010091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:29.010855 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:29.011293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:29.123526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:29.132157 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c709bbf-bf20-4831-80c0-fe1d5a62402f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1213 microversion: 2.1 time: 0.135029 Mar 29 03:19:29.132715 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3238/6707] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:28 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1213 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:30.149109 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:30.149746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:30.158281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:30.158730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:30.159518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:30.159951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:30.297878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:30.306095 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7404b2a8-72f5-4bb9-94d0-97a7e2943fa8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1275 microversion: 2.1 time: 0.160669 Mar 29 03:19:30.306660 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3470/6708] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:30 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:31.323489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:31.324139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:31.331749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:31.332203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:31.333075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:31.333516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:31.536519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:31.545038 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ea1dc90-82e6-468d-9246-b5daadc6c81b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.225194 Mar 29 03:19:31.545615 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3239/6709] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:31 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:32.055141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-1cf46fd4-996e-43f0-b9c2-bdf745180ae6 req-3cd4bdcf-cd4e-4dac-adeb-3c02d96b3c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "735c74d9-df1f-4ad9-abd6-d01c0c789dfa", "tag": "cac652ec-8167-4e35-b4b5-b6912dfc3b12"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:32.056745 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:32.056745 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:19:32.064856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1cf46fd4-996e-43f0-b9c2-bdf745180ae6 req-3cd4bdcf-cd4e-4dac-adeb-3c02d96b3c08 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:32.065302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-1cf46fd4-996e-43f0-b9c2-bdf745180ae6 req-3cd4bdcf-cd4e-4dac-adeb-3c02d96b3c08 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:32.081343 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-1cf46fd4-996e-43f0-b9c2-bdf745180ae6 req-3cd4bdcf-cd4e-4dac-adeb-3c02d96b3c08 service nova] Creating event network-changed:cac652ec-8167-4e35-b4b5-b6912dfc3b12 for instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa on n-h2-828148-1 Mar 29 03:19:32.085996 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-1cf46fd4-996e-43f0-b9c2-bdf745180ae6 req-3cd4bdcf-cd4e-4dac-adeb-3c02d96b3c08 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Mar 29 03:19:32.086651 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3471/6710] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:32.561467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:32.562253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:32.570330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:32.570776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:32.571862 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:32.572299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:32.771724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:32.780143 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9672d90e-e078-4030-91f0-5139df6525e9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.222409 Mar 29 03:19:32.780707 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3240/6711] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:32 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:33.794287 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:19:33.798449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:33.799147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:33.806773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:33.807218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:33.808007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:33.808437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:34.068300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:34.076427 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2be2b386-722b-4154-b886-64b1fed0b320 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.283420 Mar 29 03:19:34.077017 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3472/6712] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:33 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:35.093325 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:35.093949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:35.101321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:35.101781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:35.102548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:35.102990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:35.296792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:35.305465 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7587108f-b27a-4a85-b1e1-3be655a551b7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.216059 Mar 29 03:19:35.306020 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3241/6713] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:35 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:36.322532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:36.323145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:36.332339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:36.332784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:36.333573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:36.334003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:36.369591 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58274. Mar 29 03:19:36.529851 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:36.540694 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4d465a09-65ab-4885-b813-af2fc24c3769 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.221799 Mar 29 03:19:36.541286 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3473/6714] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:36 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:37.147260 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-87486786-bfcd-415e-8ac6-a70ab9b59ccf req-9c7b7c46-a552-480e-b554-7276a89e91fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735c74d9-df1f-4ad9-abd6-d01c0c789dfa", "name": "network-vif-plugged", "status": "completed", "tag": "cac652ec-8167-4e35-b4b5-b6912dfc3b12"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:37.148819 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:37.148819 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:19:37.157644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-87486786-bfcd-415e-8ac6-a70ab9b59ccf req-9c7b7c46-a552-480e-b554-7276a89e91fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:37.158095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-87486786-bfcd-415e-8ac6-a70ab9b59ccf req-9c7b7c46-a552-480e-b554-7276a89e91fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:37.174485 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-87486786-bfcd-415e-8ac6-a70ab9b59ccf req-9c7b7c46-a552-480e-b554-7276a89e91fe service nova] Creating event network-vif-plugged:cac652ec-8167-4e35-b4b5-b6912dfc3b12 for instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa on n-h2-828148-1 Mar 29 03:19:37.179352 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-87486786-bfcd-415e-8ac6-a70ab9b59ccf req-9c7b7c46-a552-480e-b554-7276a89e91fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Mar 29 03:19:37.183741 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3242/6715] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:37.557035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:37.557587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:37.564910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:37.565353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:37.566110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:37.566538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:37.757308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:37.765414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea1fdf55-4380-42b2-a194-5e19c854d62d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1317 microversion: 2.1 time: 0.212163 Mar 29 03:19:37.766614 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3474/6716] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:37 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1317 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:38.783497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:38.784211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:38.791795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:38.792256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:38.793138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:38.793584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:38.998422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:39.006532 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2ba60058-38c1-466d-9472-bc16b8a639a1 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1506 microversion: 2.1 time: 0.227801 Mar 29 03:19:39.007092 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3243/6717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:38 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:39.022472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:39.022955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:39.030072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:39.030510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:39.031265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:39.032246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:39.091322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:19:39.370066 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc45b726-f874-4449-bda0-910a7e3f689b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "DELETE /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 204 len: 0 microversion: 2.1 time: 0.350918 Mar 29 03:19:39.370673 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3475/6718] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:39 2022] DELETE /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:19:39.378458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:39.379050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:39.386480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:39.386929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:39.387691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:39.388123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:39.587138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:39.596111 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eb2cedf5-9a70-4799-8a7a-e646458666b9 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1512 microversion: 2.1 time: 0.221303 Mar 29 03:19:39.596705 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3244/6719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:39 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:40.613458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:40.614160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:40.621505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:40.621951 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:40.622713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:40.623145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:41.046053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:41.054611 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e7d17928-8da0-4ddb-91d8-58e09b3d916e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1512 microversion: 2.1 time: 0.445392 Mar 29 03:19:41.055181 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3476/6720] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:40 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:41.719478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-2e02c607-ddb4-438e-9635-d4e6f1fb9ea5 req-f7640d92-8aae-4b89-a7d1-1d8db1e05f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "735c74d9-df1f-4ad9-abd6-d01c0c789dfa", "name": "network-vif-deleted", "tag": "cac652ec-8167-4e35-b4b5-b6912dfc3b12"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:41.722144 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:41.722144 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:19:41.730449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2e02c607-ddb4-438e-9635-d4e6f1fb9ea5 req-f7640d92-8aae-4b89-a7d1-1d8db1e05f76 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:41.732590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-2e02c607-ddb4-438e-9635-d4e6f1fb9ea5 req-f7640d92-8aae-4b89-a7d1-1d8db1e05f76 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:41.747767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-2e02c607-ddb4-438e-9635-d4e6f1fb9ea5 req-f7640d92-8aae-4b89-a7d1-1d8db1e05f76 service nova] Creating event network-vif-deleted:cac652ec-8167-4e35-b4b5-b6912dfc3b12 for instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa on n-h2-828148-1 Mar 29 03:19:41.752750 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-2e02c607-ddb4-438e-9635-d4e6f1fb9ea5 req-f7640d92-8aae-4b89-a7d1-1d8db1e05f76 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037906 Mar 29 03:19:41.753405 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3245/6721] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:42.071239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:42.074452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:42.079247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:42.079724 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:42.080486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:42.080946 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:42.147872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:42.148312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:42.148759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lazy-loading 'fault' on Instance uuid 735c74d9-df1f-4ad9-abd6-d01c0c789dfa {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:19:42.293305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:42.302105 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73d8b171-157a-4b5f-9b52-66e1967d7400 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 200 len: 1307 microversion: 2.1 time: 0.234532 Mar 29 03:19:42.302665 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3477/6722] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:42 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:43.319197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:43.319976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:43.327647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.328062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.329392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.329842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.380161 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. Mar 29 03:19:43.380929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 404 to user: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:43.381773 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2de82101-a258-4437-a164-57648ffc9849 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 404 len: 111 microversion: 2.1 time: 0.066830 Mar 29 03:19:43.382323 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3246/6723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:43 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:43.391343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:43.391950 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:43.399097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.399538 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.400288 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.400714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.606773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:43.615187 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7f865531-4470-48f7-a0a0-719b375ac2a7 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.227991 Mar 29 03:19:43.615979 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3478/6724] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:43 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:43.631991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f1abe82-8da7-4291-a5ef-747bfa70422f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:43.633132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2f1abe82-8da7-4291-a5ef-747bfa70422f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 6e9776ca-6233-47d0-81f3-b46c33a231ba] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:43.640201 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-2f1abe82-8da7-4291-a5ef-747bfa70422f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Instance 6e9776ca-6233-47d0-81f3-b46c33a231ba could not be found. Mar 29 03:19:43.641409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2f1abe82-8da7-4291-a5ef-747bfa70422f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 404 to user: Instance 6e9776ca-6233-47d0-81f3-b46c33a231ba could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:43.642279 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2f1abe82-8da7-4291-a5ef-747bfa70422f tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "POST /compute/v2.1/servers/6e9776ca-6233-47d0-81f3-b46c33a231ba/action" status: 404 len: 111 microversion: 2.1 time: 0.014277 Mar 29 03:19:43.643057 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3247/6725] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:19:43 2022] POST /compute/v2.1/servers/6e9776ca-6233-47d0-81f3-b46c33a231ba/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:43.650934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:43.651580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:43.659745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.660189 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.660998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.661437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.858958 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:43.867328 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f39e4ec2-48be-4366-ac00-b54575803492 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.220129 Mar 29 03:19:43.878103 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3479/6726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:43 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:43.884403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:43.885058 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:43.893467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.893921 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:43.898688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:43.898688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.101597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:44.109750 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6bb16ec2-11b2-491c-9255-b7adf864f00b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.228896 Mar 29 03:19:44.110245 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3248/6727] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:43 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:44.125694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "71cfdfbc-7bfc-43d6-8bb6-d15cf404958d"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:44.126646 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:44.133829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.134269 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.135017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.135445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.201143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:44.212659 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Flavor 71cfdfbc-7bfc-43d6-8bb6-d15cf404958d could not be found. Mar 29 03:19:44.213276 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 400 to user: Flavor 71cfdfbc-7bfc-43d6-8bb6-d15cf404958d could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:44.214084 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c6561647-4ec1-4e4f-bb62-b842e730b135 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "POST /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116/action" status: 400 len: 107 microversion: 2.1 time: 0.092259 Mar 29 03:19:44.214623 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3480/6728] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:19:44 2022] POST /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116/action => generated 107 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 03:19:44.223501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:44.224142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:44.231353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.231808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.232575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.233051 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.426383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:44.434416 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e5f292a-6bb0-48a4-a52f-867367b4e18e tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.214503 Mar 29 03:19:44.434963 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3249/6729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:44 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:44.457200 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:44.457807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:44.465809 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.466246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.467000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.467422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.662259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:44.670318 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0b9eca30-4182-4d81-aa72-f322d9339d11 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.217323 Mar 29 03:19:44.670867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3481/6730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:44 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:44.686186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a828631f-bc9d-40ad-81b3-e88a22522f39 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:44.687312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a828631f-bc9d-40ad-81b3-e88a22522f39 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:44.688632 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a828631f-bc9d-40ad-81b3-e88a22522f39 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "POST /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116/action" status: 400 len: 113 microversion: 2.1 time: 0.006176 Mar 29 03:19:44.689148 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3250/6731] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:19:44 2022] POST /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 29 03:19:44.696108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:44.696717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:44.704424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.704890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.705638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.706060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.899495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:44.907719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-43938e5e-b2f9-4d5a-8a49-3d0512737c3b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1504 microversion: 2.1 time: 0.214995 Mar 29 03:19:44.908303 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3482/6732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:44 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:19:44.927429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:44.927866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:44.936102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.936559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.937356 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:44.938381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:44.987026 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. Mar 29 03:19:44.987620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 404 to user: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:44.988438 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-79483c70-8be1-4279-9dcd-0c2e8468f8a8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "DELETE /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 404 len: 111 microversion: 2.1 time: 0.064653 Mar 29 03:19:44.989150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3251/6733] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:44 2022] DELETE /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:44.996829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:44.997456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 735c74d9-df1f-4ad9-abd6-d01c0c789dfa] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:45.004659 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.005194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.005945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.006371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.054811 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. Mar 29 03:19:45.055393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 404 to user: Instance 735c74d9-df1f-4ad9-abd6-d01c0c789dfa could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:45.056197 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-532b315b-7657-49fa-b134-a60bad16c46b tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa" status: 404 len: 111 microversion: 2.1 time: 0.063214 Mar 29 03:19:45.056716 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3483/6734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:44 2022] GET /compute/v2.1/servers/735c74d9-df1f-4ad9-abd6-d01c0c789dfa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:45.064459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:45.065003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:45.072125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.072581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.073377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.073825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.135702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:19:45.456286 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e9fd787-09ae-48aa-9d20-0aac312516e5 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 204 len: 0 microversion: 2.1 time: 0.395186 Mar 29 03:19:45.458693 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3252/6735] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:19:45 2022] DELETE /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:19:45.464622 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:45.465563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:45.472700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.473199 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.473947 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:45.474474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:45.680264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:45.688933 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-64533992-59e6-43b2-8d65-757326d380d8 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1510 microversion: 2.1 time: 0.227967 Mar 29 03:19:45.689485 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3484/6736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:45 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:46.706935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:46.707680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:46.715226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:46.715680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:46.716451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:46.716918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:46.910028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:46.918387 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-16adb0ab-9ee8-4245-88c8-23fdfa3eca3d tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1510 microversion: 2.1 time: 0.216125 Mar 29 03:19:46.918941 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3253/6737] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:46 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:19:47.907360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c963cd95-d4c9-4341-b69a-121f1a9b632f req-5a70d698-9658-43a7-9625-b7927ad68652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8873e1d5-db8f-49dc-b087-94e510a84116", "name": "network-vif-deleted", "tag": "ba47fdcf-aac0-42dc-b0b3-4f541706afe4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:19:47.909029 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:19:47.909029 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:19:47.917342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c963cd95-d4c9-4341-b69a-121f1a9b632f req-5a70d698-9658-43a7-9625-b7927ad68652 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:47.924324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c963cd95-d4c9-4341-b69a-121f1a9b632f req-5a70d698-9658-43a7-9625-b7927ad68652 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:47.933187 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c963cd95-d4c9-4341-b69a-121f1a9b632f req-5a70d698-9658-43a7-9625-b7927ad68652 service nova] Creating event network-vif-deleted:ba47fdcf-aac0-42dc-b0b3-4f541706afe4 for instance 8873e1d5-db8f-49dc-b087-94e510a84116 on n-h1-828148-1 Mar 29 03:19:47.935363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:47.936111 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:47.938827 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c963cd95-d4c9-4341-b69a-121f1a9b632f req-5a70d698-9658-43a7-9625-b7927ad68652 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035755 Mar 29 03:19:47.939763 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3485/6738] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:19:47.943913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:47.944455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:47.945308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:47.945842 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:48.066226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd379e9177d65401d976e97195e54bafc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f5e7aa287416299e1c66dd53f726a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:19:48.074701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-412dc3ab-8a5c-4a90-a919-f89db0770a36 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 200 len: 1468 microversion: 2.1 time: 0.143285 Mar 29 03:19:48.075281 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3254/6739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:47 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 1468 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:19:49.092988 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:19:49.096496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] [instance: 8873e1d5-db8f-49dc-b087-94e510a84116] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:19:49.101138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:49.101577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:49.102339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:19:49.102763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:19:49.151240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] HTTP exception thrown: Instance 8873e1d5-db8f-49dc-b087-94e510a84116 could not be found. Mar 29 03:19:49.151834 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] Returning 404 to user: Instance 8873e1d5-db8f-49dc-b087-94e510a84116 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:19:49.152645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f51dea60-82ce-4539-b587-a84930ec8e74 tempest-ServersNegativeTestJSON-936864672 tempest-ServersNegativeTestJSON-936864672-project] 10.222.0.36 "GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116" status: 404 len: 111 microversion: 2.1 time: 0.064075 Mar 29 03:19:49.153223 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3486/6740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:19:49 2022] GET /compute/v2.1/servers/8873e1d5-db8f-49dc-b087-94e510a84116 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:19:52.224046 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:19:52.226222 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:19:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:20:39.693914 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:20:39.694561 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:20:39.878050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: .version_select at 0x7f8717f5c700>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-374475452"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:20:39.901281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:20:39.907031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:20:40.182153 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:20:40.187591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:20:40.201236 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d101c9b8-fdfe-4b0e-9a24-f289db570ff6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.508714 Mar 29 03:20:40.202467 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3255/6741] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:20:39 2022] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:40.255693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1279153971", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-374475452", "networks": [{"uuid": "33f76f49-be5e-4936-87fe-89c168fe4da1"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:20:40.321245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] validate_networks() for [('33f76f49-be5e-4936-87fe-89c168fe4da1', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:20:41.122376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:20:41.122796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:20:41.123908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:20:41.124315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:20:41.124723 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:20:41.133024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:41.133481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:41.134264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:41.134678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:41.151689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:20:41.157101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:20:41.169318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:20:41.172155 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:20:41.293650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b94b0e2b-9197-4271-8a03-fd855844f128 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.042418 Mar 29 03:20:41.294636 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3487/6742] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:20:41.306555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-74aa1109-50de-4407-97ec-2a1fd49c0a21 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:41.307182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-74aa1109-50de-4407-97ec-2a1fd49c0a21 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:41.324184 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58664. Mar 29 03:20:41.337457 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 58666. Mar 29 03:20:41.471185 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-74aa1109-50de-4407-97ec-2a1fd49c0a21 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:41.479275 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-74aa1109-50de-4407-97ec-2a1fd49c0a21 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1262 microversion: 2.1 time: 0.178205 Mar 29 03:20:41.491650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3256/6743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:41 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1262 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:42.499358 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:42.500631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:42.508486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:42.509236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:42.510194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:42.510780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:42.634689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:42.644413 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9bb928bc-f639-4689-8238-fdf6bb61a2b7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1266 microversion: 2.1 time: 0.149276 Mar 29 03:20:42.654047 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3488/6744] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:42 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:43.664246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:43.665504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:43.681395 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:43.682097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:43.683631 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:43.685373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:43.895118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:43.904153 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-23badc00-4c13-46c6-8079-e681367f3bbe tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1322 microversion: 2.1 time: 0.245411 Mar 29 03:20:43.909087 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3257/6745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:43 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:44.925762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:44.926385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:44.933898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:44.934353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:44.935207 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:44.935627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:45.629458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:45.656109 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7c72eb6-4f1a-429a-aece-cb4920fccd7c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.733829 Mar 29 03:20:45.657845 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3489/6746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:44 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:46.100341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-fea34555-b9c7-440b-9ba8-df47c6e30ae1 req-0cdd5d3d-8a2d-41a9-8893-21b421dbf5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037c0b23-197f-4b2d-b3d3-aa0658c08e5b", "tag": "b7570166-5082-420e-a3e5-9353c2006f0d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:20:46.102444 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:20:46.102444 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:20:46.111569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fea34555-b9c7-440b-9ba8-df47c6e30ae1 req-0cdd5d3d-8a2d-41a9-8893-21b421dbf5f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:46.112009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-fea34555-b9c7-440b-9ba8-df47c6e30ae1 req-0cdd5d3d-8a2d-41a9-8893-21b421dbf5f6 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:46.129585 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-fea34555-b9c7-440b-9ba8-df47c6e30ae1 req-0cdd5d3d-8a2d-41a9-8893-21b421dbf5f6 service nova] Creating event network-changed:b7570166-5082-420e-a3e5-9353c2006f0d for instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b on n-h1-828148-1 Mar 29 03:20:46.134626 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-fea34555-b9c7-440b-9ba8-df47c6e30ae1 req-0cdd5d3d-8a2d-41a9-8893-21b421dbf5f6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039512 Mar 29 03:20:46.135220 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3258/6747] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:20:46.672970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:46.673669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:46.681318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:46.681854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:46.682708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:46.683139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:47.030101 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:47.038484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-02261f99-f8bf-48ed-b439-63b00e7966b6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.369242 Mar 29 03:20:47.039201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3490/6748] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:46 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:48.056032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:48.056707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:48.064227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:48.064681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:48.065484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:48.065928 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:48.263273 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:48.271807 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0080d966-2264-4913-b4a0-3323106e7ea3 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.220021 Mar 29 03:20:48.272368 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3259/6749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:48 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:49.287913 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:49.288525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:49.297184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:49.297630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:49.298395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:49.298826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:49.492053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:49.500727 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d3fe7a9-0427-4eb3-b37b-47506bde667d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.216534 Mar 29 03:20:49.501313 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3491/6750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:49 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:50.517342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:50.517868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:50.526453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:50.526909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:50.527688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:50.528146 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:50.726074 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:50.734278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c93f4ff-3697-4f5d-b55e-35ac3d53a197 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.221286 Mar 29 03:20:50.734829 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3260/6751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:50 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:51.750939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:51.751549 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:51.758755 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:51.759203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:51.759961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:51.760387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:51.960919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:51.970213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d19b8f00-2481-4d1b-9302-3c43ebf04f33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.223640 Mar 29 03:20:51.970770 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3492/6752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:51 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:52.986872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:52.987422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:52.994887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:52.995353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:52.996132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:52.996585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:53.189041 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:53.197071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b0541731-b24a-423c-ab41-9d952a2cf40f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.213876 Mar 29 03:20:53.197631 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3261/6753] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:52 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:20:54.214175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:54.214787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:54.227177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:54.227613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:54.228365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:54.228787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:54.400296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-d51d7ac1-5896-4203-9cc8-decfe4ef7225 req-9dc47187-f506-4e79-95d5-1e53f84a39f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037c0b23-197f-4b2d-b3d3-aa0658c08e5b", "name": "network-vif-plugged", "status": "completed", "tag": "b7570166-5082-420e-a3e5-9353c2006f0d"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:20:54.405155 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:20:54.405155 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:20:54.410166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d51d7ac1-5896-4203-9cc8-decfe4ef7225 req-9dc47187-f506-4e79-95d5-1e53f84a39f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:54.410612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-d51d7ac1-5896-4203-9cc8-decfe4ef7225 req-9dc47187-f506-4e79-95d5-1e53f84a39f3 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:54.426330 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-d51d7ac1-5896-4203-9cc8-decfe4ef7225 req-9dc47187-f506-4e79-95d5-1e53f84a39f3 service nova] Creating event network-vif-plugged:b7570166-5082-420e-a3e5-9353c2006f0d for instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b on n-h1-828148-1 Mar 29 03:20:54.426763 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:54.431207 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-d51d7ac1-5896-4203-9cc8-decfe4ef7225 req-9dc47187-f506-4e79-95d5-1e53f84a39f3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034664 Mar 29 03:20:54.431792 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3262/6754] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:20:54.437272 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-42ba9fc4-ce10-4a7c-b7ac-6556e4e9cb79 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.227233 Mar 29 03:20:54.439456 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3493/6755] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:54 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:55.455683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:55.456397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:55.464337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:55.464802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:55.468824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:55.468824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:55.667556 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:55.675850 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ed447aa7-5e3d-4880-a969-26ddf3b5a7fc tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1362 microversion: 2.1 time: 0.224861 Mar 29 03:20:55.676415 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3263/6756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:55 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:56.693180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:56.693815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:56.701065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:56.701516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:56.702256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:56.702679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:56.896107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:56.904298 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0e86f54b-1d84-47fc-888f-829b078db43d tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1554 microversion: 2.1 time: 0.214780 Mar 29 03:20:56.904880 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3494/6757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:56 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:20:56.920511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:20:56.921157 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:20:56.928436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:56.928918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:56.929692 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:20:56.930137 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:20:57.228605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:20:57.237487 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d1e9bb6-320d-4e4e-b35a-db32958475e5 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1554 microversion: 2.1 time: 0.321162 Mar 29 03:20:57.238045 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3264/6758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:20:56 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1554 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:00.533490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dceb8cc8-f613-43ce-b2b2-c3884fb40bee"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:00.534614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:00.541747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:00.542187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:00.542939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:00.543366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:01.321518 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-428a6cfa-012d-4021-a41b-f2030be8e3cf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791502 Mar 29 03:21:01.322132 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3495/6759] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 03:21:00 2022] POST /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:09.073961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:09.078040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:09.081874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:09.082332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:09.083101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:09.083544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:09.229231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lazy-loading 'services' on Instance uuid 037c0b23-197f-4b2d-b3d3-aa0658c08e5b {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:21:09.493338 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bbbe183f-f222-404a-ac33-d2e99c9bdc33 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments/dceb8cc8-f613-43ce-b2b2-c3884fb40bee" status: 202 len: 0 microversion: 2.1 time: 0.422952 Mar 29 03:21:09.493972 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3265/6760] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:21:09 2022] DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments/dceb8cc8-f613-43ce-b2b2-c3884fb40bee => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:21:09.503046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:09.508033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:09.512180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:09.512620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:09.513417 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:09.513846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:09.576639 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-855d57d0-5c71-4615-80b9-3c450498ad7b tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078182 Mar 29 03:21:09.577205 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3496/6761] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:09 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:10.589104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:10.590263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:10.601488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:10.601956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:10.602741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:10.603188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:10.668502 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f6fa443-610c-4752-b4fa-b337dc25cf18 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083812 Mar 29 03:21:10.669014 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3266/6762] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:10 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:11.679923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:11.680762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:11.688546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:11.689037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:11.689797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:11.690225 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:11.752522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b00498b4-6409-40d4-8f69-75eb5eabec68 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076534 Mar 29 03:21:11.753101 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3497/6763] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:11 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 03:21:11.762801 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:11.763319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:11.770695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:11.771408 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:11.771914 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:11.772351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:11.912988 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] HTTP exception thrown: Instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b is not attached to volume dceb8cc8-f613-43ce-b2b2-c3884fb40bee Mar 29 03:21:11.913604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Returning 404 to user: Instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b is not attached to volume dceb8cc8-f613-43ce-b2b2-c3884fb40bee {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:21:11.914437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cbafb247-7b30-4ed3-bbfe-f3719e8afe11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments/dceb8cc8-f613-43ce-b2b2-c3884fb40bee" status: 404 len: 154 microversion: 2.1 time: 0.155450 Mar 29 03:21:11.915068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3267/6764] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:21:11 2022] DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b/os-volume_attachments/dceb8cc8-f613-43ce-b2b2-c3884fb40bee => generated 154 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:21:14.577373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:14.577971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:14.586191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:14.588648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:14.588648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:14.588648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:14.652745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:21:14.986671 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-809bd886-e884-49d6-a6b9-5f6ef24708ea tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 204 len: 0 microversion: 2.1 time: 0.412714 Mar 29 03:21:14.987255 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3498/6765] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:21:14 2022] DELETE /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:21:14.995141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:14.999334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:15.003029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:15.003486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:15.004278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:15.004722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:15.198011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:15.206941 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f8c18bc0-cd72-4286-8cfb-307797242c1a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1560 microversion: 2.1 time: 0.215455 Mar 29 03:21:15.207503 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3268/6766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:14 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:21:16.224938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:16.225642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:16.233845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:16.234284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:16.235041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:16.235467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:16.429745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:16.438009 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2e0dbbb-9d67-47f1-b066-c5ac0168d461 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1560 microversion: 2.1 time: 0.217191 Mar 29 03:21:16.438646 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3499/6767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:16 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:17.454825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:17.455471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:17.463068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:17.463532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:17.464774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:17.464943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:17.590705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:17.599555 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5332e37a-3b66-4106-971e-bea041a0b692 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 200 len: 1518 microversion: 2.1 time: 0.148940 Mar 29 03:21:17.602139 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3269/6768] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:17 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 1518 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:17.636290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-406d40f5-94c1-4aa7-b0ba-dbce6ecd65b8 req-84a6d27a-e269-43c2-acd3-9f0cd2979a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037c0b23-197f-4b2d-b3d3-aa0658c08e5b", "name": "network-vif-deleted", "tag": "b7570166-5082-420e-a3e5-9353c2006f0d"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:17.638486 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:21:17.638486 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:21:17.651817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-406d40f5-94c1-4aa7-b0ba-dbce6ecd65b8 req-84a6d27a-e269-43c2-acd3-9f0cd2979a63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:17.652254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-406d40f5-94c1-4aa7-b0ba-dbce6ecd65b8 req-84a6d27a-e269-43c2-acd3-9f0cd2979a63 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:17.669120 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-406d40f5-94c1-4aa7-b0ba-dbce6ecd65b8 req-84a6d27a-e269-43c2-acd3-9f0cd2979a63 service nova] Creating event network-vif-deleted:b7570166-5082-420e-a3e5-9353c2006f0d for instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b on n-h1-828148-1 Mar 29 03:21:17.674335 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-406d40f5-94c1-4aa7-b0ba-dbce6ecd65b8 req-84a6d27a-e269-43c2-acd3-9f0cd2979a63 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041544 Mar 29 03:21:17.675411 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3500/6769] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:18.616985 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:18.617600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: 037c0b23-197f-4b2d-b3d3-aa0658c08e5b] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:18.624944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:18.625392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:18.626159 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:18.626592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:18.675014 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] HTTP exception thrown: Instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b could not be found. Mar 29 03:21:18.675614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Returning 404 to user: Instance 037c0b23-197f-4b2d-b3d3-aa0658c08e5b could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:21:18.676442 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71b29a62-f693-491c-adcb-8f568c496b1f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b" status: 404 len: 111 microversion: 2.1 time: 0.063301 Mar 29 03:21:18.677012 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3270/6770] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:18 2022] GET /compute/v2.1/servers/037c0b23-197f-4b2d-b3d3-aa0658c08e5b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:21:18.685859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f1dc0b2-1152-4910-9d15-15eb2a299485 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '.version_select at 0x7f8724b091f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:18.770361 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f1dc0b2-1152-4910-9d15-15eb2a299485 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-374475452" status: 202 len: 0 microversion: 2.1 time: 0.088604 Mar 29 03:21:18.770933 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3501/6771] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-374475452 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:21:18.785986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: .version_select at 0x7f8717e77af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-788688759"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:18.807812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:21:18.812936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:21:19.391491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:21:19.396772 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:21:19.410280 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0595185a-feaf-4d54-b824-591871e8a19f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.628075 Mar 29 03:21:19.410870 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3271/6772] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:21:18 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:19.461722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1214955285", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-788688759", "networks": [{"uuid": "33f76f49-be5e-4936-87fe-89c168fe4da1"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:19.525881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] validate_networks() for [('33f76f49-be5e-4936-87fe-89c168fe4da1', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:21:20.115819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:21:20.116385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:21:20.116686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:21:20.117119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:21:20.117525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:21:20.126060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:20.126491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:20.127272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:20.127694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:20.144597 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:21:20.149954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Getting quotas for user 01f3637b710d4db486cc3f9394f939b1 and project 9dbb66ccd483493ca3cb4fdad9492134. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:21:20.161911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:21:20.164248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:21:20.296435 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2dddc799-a968-4bc9-91d2-5578423642fb tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838571 Mar 29 03:21:20.299704 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3502/6773] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:21:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:21:20.307115 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-340ffb52-525a-4fa9-8a50-cd4ead1887f2 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:20.307745 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-340ffb52-525a-4fa9-8a50-cd4ead1887f2 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:20.385140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-340ffb52-525a-4fa9-8a50-cd4ead1887f2 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:20.395477 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-340ffb52-525a-4fa9-8a50-cd4ead1887f2 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1262 microversion: 2.1 time: 0.092260 Mar 29 03:21:20.396041 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3272/6774] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:20 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:21.413004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:21.413564 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:21.421699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:21.426711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:21.426711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:21.426711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:21.537519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:21.546190 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19fe736c-df6b-49f7-970f-37be3f751971 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1258 microversion: 2.1 time: 0.136986 Mar 29 03:21:21.551865 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3503/6775] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:21 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1258 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:22.563464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:22.564078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:22.571488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:22.571945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:22.572787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:22.573266 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:22.691243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:22.699523 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-621201ce-2678-4779-b67a-91389ba4e0a0 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1320 microversion: 2.1 time: 0.140412 Mar 29 03:21:22.700146 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3273/6776] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:22 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1320 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:23.716571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:23.717224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:23.724472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:23.724953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:23.725719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:23.726153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:24.207680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:24.217642 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b68c84fb-fb1e-4f5f-8196-a5836f784239 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.504893 Mar 29 03:21:24.218226 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3504/6777] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:23 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:21:24.475400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8c5dffcf-a0ba-4ef4-abba-f0577b7360ed req-e2e883d3-e32b-4451-9cb4-8e37e5248d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd60e989-a90a-487c-b97c-9bce8d3c8cc0", "tag": "e962d8ad-2f61-4a12-9892-937dced54ff4"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:24.477092 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:21:24.477092 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:21:24.489834 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c5dffcf-a0ba-4ef4-abba-f0577b7360ed req-e2e883d3-e32b-4451-9cb4-8e37e5248d44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:24.490565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c5dffcf-a0ba-4ef4-abba-f0577b7360ed req-e2e883d3-e32b-4451-9cb4-8e37e5248d44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:24.510102 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8c5dffcf-a0ba-4ef4-abba-f0577b7360ed req-e2e883d3-e32b-4451-9cb4-8e37e5248d44 service nova] Creating event network-changed:e962d8ad-2f61-4a12-9892-937dced54ff4 for instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 on n-h1-828148-1 Mar 29 03:21:24.515158 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8c5dffcf-a0ba-4ef4-abba-f0577b7360ed req-e2e883d3-e32b-4451-9cb4-8e37e5248d44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043263 Mar 29 03:21:24.515744 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3274/6778] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:25.234317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:25.234936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:25.242680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:25.243072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:25.243847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:25.244286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:25.637297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:25.645432 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca6e3c4e-fd83-4d5d-8b38-c128588810cd tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.414814 Mar 29 03:21:25.645994 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3505/6779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:25 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:26.662680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:26.663381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:26.671663 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:26.672116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:26.672907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:26.673350 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:26.870513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:26.879559 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-76455cb9-d56a-4548-890e-24ae3f2ab361 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.221011 Mar 29 03:21:26.880118 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3275/6780] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:26 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:27.896974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:27.897592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:27.904790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:27.905267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:27.906023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:27.906453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:28.256810 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:28.264770 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-204d526d-ccc4-4533-b4e3-4e6a042d607f tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.371524 Mar 29 03:21:28.265346 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3506/6781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:27 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:29.281230 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:29.281850 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:29.289094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:29.289554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:29.290320 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:29.290762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:29.483085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:29.491170 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d789ffc8-4564-4290-ace6-f4f4b5253270 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.213813 Mar 29 03:21:29.491729 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3276/6782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:29 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:30.508017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:30.508555 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:30.516542 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:30.517023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:30.517784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:30.518210 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:30.716741 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:30.725243 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc664faf-033a-4452-a09e-e7bb9834a1e7 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.220921 Mar 29 03:21:30.725801 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3507/6783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:30 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:31.742370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:31.743076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:31.750400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:31.750929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:31.751796 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:31.752305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:31.951596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:31.959647 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fad8a46-37b4-4ddb-beb5-687c3ea1b324 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.220941 Mar 29 03:21:31.960204 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3277/6784] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:31 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:32.541074 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-30b9e2d8-33dc-4901-a052-5e0e618b99f0 req-83078701-f150-45b7-858a-2c55780c9791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd60e989-a90a-487c-b97c-9bce8d3c8cc0", "name": "network-vif-plugged", "status": "completed", "tag": "e962d8ad-2f61-4a12-9892-937dced54ff4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:32.547596 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:21:32.547596 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:21:32.551334 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-30b9e2d8-33dc-4901-a052-5e0e618b99f0 req-83078701-f150-45b7-858a-2c55780c9791 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:32.551773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-30b9e2d8-33dc-4901-a052-5e0e618b99f0 req-83078701-f150-45b7-858a-2c55780c9791 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:32.566869 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-30b9e2d8-33dc-4901-a052-5e0e618b99f0 req-83078701-f150-45b7-858a-2c55780c9791 service nova] Creating event network-vif-plugged:e962d8ad-2f61-4a12-9892-937dced54ff4 for instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 on n-h1-828148-1 Mar 29 03:21:32.571573 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-30b9e2d8-33dc-4901-a052-5e0e618b99f0 req-83078701-f150-45b7-858a-2c55780c9791 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034251 Mar 29 03:21:32.576263 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3508/6785] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:32.977237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:32.977873 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:32.985319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:32.985762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:32.986529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:32.986966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:33.179864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:33.188384 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a516cebb-7567-4cc4-a054-bf788f583e60 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1362 microversion: 2.1 time: 0.214816 Mar 29 03:21:33.188960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3278/6786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:32 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:34.205915 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:34.206522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:34.214160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:34.214602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:34.215882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:34.216308 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:34.413857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:34.422078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7c439e9f-5e2a-4148-8fa3-dc878070e015 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1553 microversion: 2.1 time: 0.220556 Mar 29 03:21:34.422644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3509/6787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:34 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:34.437912 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:34.441875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:34.445767 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:34.446227 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:34.446989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:34.447431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:34.641733 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:34.649861 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e40cf52f-67a8-4ed4-b458-70e8ec96d883 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1553 microversion: 2.1 time: 0.215616 Mar 29 03:21:34.650421 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3279/6788] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:34 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:36.619843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d37ce07-9cd2-4fdf-9811-93c31230a6d9"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:36.620917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:36.628798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:36.629283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:36.630032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:36.630459 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:37.377811 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-361e089b-1e44-4a00-925b-09af23ae8f1c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "POST /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761736 Mar 29 03:21:37.378399 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3510/6789] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 03:21:36 2022] POST /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments => generated 194 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:46.219854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:46.220402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:46.227704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:46.228154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:46.228955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:46.229402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:46.380368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lazy-loading 'services' on Instance uuid bd60e989-a90a-487c-b97c-9bce8d3c8cc0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:21:46.658922 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f129a6b6-278f-4cbd-8912-145797166eef tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments/1d37ce07-9cd2-4fdf-9811-93c31230a6d9" status: 202 len: 0 microversion: 2.1 time: 0.442650 Mar 29 03:21:46.659505 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3280/6790] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:21:46 2022] DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments/1d37ce07-9cd2-4fdf-9811-93c31230a6d9 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:21:46.668939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:46.671284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:46.679857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:46.680325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:46.681122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:46.681548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:46.745673 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-da6cada4-79f2-41f4-9ab0-598cf7df3cdf tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081349 Mar 29 03:21:46.746183 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3511/6791] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:46 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:47.757960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:47.758938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:47.767081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:47.767541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:47.771028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:47.771028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:47.832472 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e0e9bd4a-9ff5-4d75-9ad8-c2449294879c tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078689 Mar 29 03:21:47.833053 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3281/6792] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:47 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:48.844075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:48.845006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:48.852602 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:48.853084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:48.853844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:48.854274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:48.916680 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4c1d726-ab5e-4972-bfa7-0b81651184a9 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076888 Mar 29 03:21:48.917175 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3512/6793] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:21:48 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 03:21:48.926837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:48.927338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:48.935327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:48.935778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:48.936538 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:48.937004 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:49.077986 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] HTTP exception thrown: Instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 is not attached to volume 1d37ce07-9cd2-4fdf-9811-93c31230a6d9 Mar 29 03:21:49.078595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Returning 404 to user: Instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 is not attached to volume 1d37ce07-9cd2-4fdf-9811-93c31230a6d9 {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:21:49.079424 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da5d6d6b-9948-42e8-b189-48313e427bca tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments/1d37ce07-9cd2-4fdf-9811-93c31230a6d9" status: 404 len: 154 microversion: 2.1 time: 0.156462 Mar 29 03:21:49.079960 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3282/6794] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:21:48 2022] DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0/os-volume_attachments/1d37ce07-9cd2-4fdf-9811-93c31230a6d9 => generated 154 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:21:51.741697 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:51.742185 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:51.749712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:51.750160 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:51.750924 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:51.751357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:51.818980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:21:52.077692 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51fb3b3b-17bd-4549-9e22-43951d7c9b11 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 204 len: 0 microversion: 2.1 time: 0.339365 Mar 29 03:21:52.082218 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3513/6795] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:21:51 2022] DELETE /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 03:21:52.086901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:52.087522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:52.095378 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:52.095837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:52.096635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:52.097163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:52.303911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:52.312671 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbd888db-f87a-4e97-a199-58f84b38f5c6 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1559 microversion: 2.1 time: 0.229724 Mar 29 03:21:52.313260 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3283/6796] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:52 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:53.330195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:53.330885 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:53.338877 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:53.339312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:53.340059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:53.340480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:53.532071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:53.540271 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23cf693a-4162-4db9-ab07-56e5a70ff2ad tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1559 microversion: 2.1 time: 0.214162 Mar 29 03:21:53.540857 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3514/6797] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:53 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:54.557851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:54.558466 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:54.565868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:54.566330 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:54.567150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:54.567594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:54.685807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:54.695193 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6d6bfbc3-b38e-49bf-9069-a317bb1378aa tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1517 microversion: 2.1 time: 0.140527 Mar 29 03:21:54.695764 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3284/6798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:54 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1517 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:54.785357 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c26797a6-734a-46af-be3f-809ea1c928d5 req-39da80b9-9163-4333-a085-234fbed9108b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd60e989-a90a-487c-b97c-9bce8d3c8cc0", "name": "network-vif-deleted", "tag": "e962d8ad-2f61-4a12-9892-937dced54ff4"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:21:54.785357 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:21:54.785357 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:21:54.788819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c26797a6-734a-46af-be3f-809ea1c928d5 req-39da80b9-9163-4333-a085-234fbed9108b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:54.789285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c26797a6-734a-46af-be3f-809ea1c928d5 req-39da80b9-9163-4333-a085-234fbed9108b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:54.808258 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c26797a6-734a-46af-be3f-809ea1c928d5 req-39da80b9-9163-4333-a085-234fbed9108b service nova] Creating event network-vif-deleted:e962d8ad-2f61-4a12-9892-937dced54ff4 for instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 on n-h1-828148-1 Mar 29 03:21:54.811115 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c26797a6-734a-46af-be3f-809ea1c928d5 req-39da80b9-9163-4333-a085-234fbed9108b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037986 Mar 29 03:21:54.811718 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3515/6799] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:21:55.712878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:55.714060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:55.721875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:55.722332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:55.723132 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:55.723635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:55.796257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:55.796627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:55.797124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lazy-loading 'fault' on Instance uuid bd60e989-a90a-487c-b97c-9bce8d3c8cc0 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:21:55.851951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f3637b710d4db486cc3f9394f939b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbb66ccd483493ca3cb4fdad9492134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:21:55.860120 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2897c277-d9a8-4c3f-a5d5-006ebd9fe31a tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 200 len: 1352 microversion: 2.1 time: 0.151462 Mar 29 03:21:55.860674 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3285/6800] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:55 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 1352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:21:56.877566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:56.878266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] [instance: bd60e989-a90a-487c-b97c-9bce8d3c8cc0] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:21:56.885808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:56.886252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:56.887008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:21:56.887441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:21:56.938668 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] HTTP exception thrown: Instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 could not be found. Mar 29 03:21:56.939178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Returning 404 to user: Instance bd60e989-a90a-487c-b97c-9bce8d3c8cc0 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:21:56.939976 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fe6afbc5-409c-4995-aab7-c8c14ba00cf4 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0" status: 404 len: 111 microversion: 2.1 time: 0.067355 Mar 29 03:21:56.940491 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3516/6801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:21:56 2022] GET /compute/v2.1/servers/bd60e989-a90a-487c-b97c-9bce8d3c8cc0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:21:56.948498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-daceb218-88fa-44c7-b044-04feadaf4e26 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] Calling method '.version_select at 0x7f8724d419d0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:21:57.061489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-daceb218-88fa-44c7-b044-04feadaf4e26 tempest-TestEncryptedCinderVolumes-1401383430 tempest-TestEncryptedCinderVolumes-1401383430-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-788688759" status: 202 len: 0 microversion: 2.1 time: 0.116631 Mar 29 03:21:57.062071 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3286/6802] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Mar 29 03:21:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-788688759 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:22:37.251811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'create', calling method: .version_select at 0x7f8724c6d040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-658729453"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:22:37.258082 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:22:37.274882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:22:37.280498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for user 4fe25f1d536343dbb0b0a566ffcc6603 and project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:22:37.545876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:22:37.551218 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for user 4fe25f1d536343dbb0b0a566ffcc6603 and project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:22:37.564647 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-21d79a9b-2907-4e7d-9f54-7d4f959c9247 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.316588 Mar 29 03:22:37.565262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3517/6803] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:22:37 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:37.618007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2145557709", "imageRef": "09eae777-1c54-444c-b03a-02d279ad9ccc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-658729453", "networks": [{"uuid": "d6b9a6ac-9f0e-45f1-aa8a-250cec3f7c42"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:22:37.683809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] validate_networks() for [('d6b9a6ac-9f0e-45f1-aa8a-250cec3f7c42', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:22:38.209271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:22:38.209711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:22:38.210231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:22:38.211000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:22:38.211461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:22:38.219784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:38.220244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:38.221112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:38.221558 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:38.238851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:22:38.243980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Getting quotas for user 4fe25f1d536343dbb0b0a566ffcc6603 and project a73a019f43cb4041a0fe9d0632e077ef. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:22:38.256123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:22:38.258341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='09eae777-1c54-444c-b03a-02d279ad9ccc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:22:38.391371 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-778c93a6-d360-459a-bedf-8f5ddeab236f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777495 Mar 29 03:22:38.392010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3287/6804] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:22:38.405414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0dd6e129-6d57-4e23-8ac9-ecc1345d3c08 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:38.406058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0dd6e129-6d57-4e23-8ac9-ecc1345d3c08 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:38.418554 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59126. Mar 29 03:22:38.577047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0dd6e129-6d57-4e23-8ac9-ecc1345d3c08 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:38.584539 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0dd6e129-6d57-4e23-8ac9-ecc1345d3c08 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1258 microversion: 2.1 time: 0.186583 Mar 29 03:22:38.594986 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3518/6805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:38 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1258 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:39.601782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40aec397-6cf1-4417-9c02-7d5077432dce tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:39.602420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40aec397-6cf1-4417-9c02-7d5077432dce tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:39.674651 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-40aec397-6cf1-4417-9c02-7d5077432dce tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:39.682615 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40aec397-6cf1-4417-9c02-7d5077432dce tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1258 microversion: 2.1 time: 0.084575 Mar 29 03:22:39.683154 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3288/6806] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:39 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:40.699060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:40.704116 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:40.707634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:40.708075 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:40.708852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:40.709278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:40.831212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:40.839788 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ca92f7db-dff4-43f2-984d-0fc9994f7cfb tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1318 microversion: 2.1 time: 0.144486 Mar 29 03:22:40.840348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3519/6807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:40 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:41.860120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:41.861675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:41.878001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:41.878757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:41.879838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:41.882458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:42.172276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:42.181335 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-746aa536-6423-4286-a9de-56b951fe2422 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.325371 Mar 29 03:22:42.187354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3289/6808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:41 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:43.204452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:43.205811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:43.213892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:43.214678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:43.215682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:43.216934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:43.658485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:43.670398 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f3afcd0d-9e8c-43b1-9518-bb09448b4696 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.469237 Mar 29 03:22:43.680949 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3520/6809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:43 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:44.687884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:44.688649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:44.696243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:44.696688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:44.697502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:44.697935 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:44.911073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:44.921688 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38dbd713-b08c-4e24-a707-d3c52c735be0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.237764 Mar 29 03:22:44.931517 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3290/6810] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:44 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:45.938854 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:45.939475 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:45.947573 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:45.948025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:45.948801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:45.949274 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:46.166105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:46.176680 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-094e700d-852c-4c76-bfc2-ae33d6afa00c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.241424 Mar 29 03:22:46.186584 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3521/6811] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:45 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:47.195637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:47.197071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:47.205847 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:47.206743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:47.207901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:47.208704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:47.415750 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:47.424573 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-571ac892-dc98-4143-a8ed-8e65fb394679 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.234367 Mar 29 03:22:47.425173 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3291/6812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:47 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:48.441707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:48.442306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:48.449790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:48.450239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:48.451647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:48.452089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:48.865255 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:48.874240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ab68b168-ace3-4f50-a37b-8a8bb06c9815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.436501 Mar 29 03:22:48.874805 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3522/6813] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:48 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:22:49.891081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:49.891698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:49.899040 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:49.899489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:49.900244 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:49.900675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:50.260039 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:50.268675 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6903d247-4ff7-4ecd-b408-34deba78b815 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.381494 Mar 29 03:22:50.269261 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3292/6814] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:49 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:51.285289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:51.285910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:51.293172 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:51.293603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:51.294949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:51.295380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:51.486689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:51.494774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6abfd2c3-d7ae-4bcc-adcb-b4810726416c tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.213187 Mar 29 03:22:51.495329 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3523/6815] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:51 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:52.511368 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:52.511998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:52.519729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:52.520193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:52.520988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:52.521437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:52.719837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:52.728745 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b62f7c0a-b631-45a6-a568-ecd1a490d275 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.220994 Mar 29 03:22:52.730825 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3293/6816] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:52 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:52.740681 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-51b9a959-1fbc-4d3e-939b-be6390dcd39b req-5f0a6043-5c0f-4e2b-a3bb-7300e8f4099a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:22:52.742607 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:22:52.742607 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:22:52.752390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-51b9a959-1fbc-4d3e-939b-be6390dcd39b req-5f0a6043-5c0f-4e2b-a3bb-7300e8f4099a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:52.752861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-51b9a959-1fbc-4d3e-939b-be6390dcd39b req-5f0a6043-5c0f-4e2b-a3bb-7300e8f4099a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:52.770356 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-51b9a959-1fbc-4d3e-939b-be6390dcd39b req-5f0a6043-5c0f-4e2b-a3bb-7300e8f4099a service nova] Creating event network-changed:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:22:52.775484 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-51b9a959-1fbc-4d3e-939b-be6390dcd39b req-5f0a6043-5c0f-4e2b-a3bb-7300e8f4099a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039243 Mar 29 03:22:52.776250 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3524/6817] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:22:53.745013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:53.745534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:53.753329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:53.753780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:53.754541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:53.754977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:54.102628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:54.111320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d582725f-2c17-4062-bd78-0ff76736e3c6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.370120 Mar 29 03:22:54.111884 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3294/6818] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:53 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:55.129252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:55.130078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:55.138297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:55.138874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:55.139644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:55.140118 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:55.337826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:55.346061 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5c93e64-1eee-4e1b-8f53-b188a454e8ff tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.221009 Mar 29 03:22:55.346629 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3525/6819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:55 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:56.362209 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:56.362858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:56.370087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:56.370550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:56.371317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:56.371756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:56.563461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:56.573436 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-267f3338-9df6-4d26-83d2-c0c5e0f86445 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.214860 Mar 29 03:22:56.573989 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3295/6820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:56 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:57.591202 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:57.591822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:57.598974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:57.599415 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:57.600165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:57.600589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:57.791751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:57.799754 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d579412-83cb-42d5-8fa8-8f57f72678e3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.212881 Mar 29 03:22:57.800307 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3526/6821] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:57 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:22:58.816128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:22:58.816929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:22:58.824031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:58.824497 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:58.825871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:22:58.826324 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:22:59.035899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:22:59.042463 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-473e672c-f755-4ec5-9756-a16712a9bae6 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.229968 Mar 29 03:22:59.043003 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3296/6822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:22:58 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:00.059677 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:00.060231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:00.067396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:00.067835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:00.068582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:00.069041 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:00.263959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:00.272005 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-63040265-5f99-4c4e-a963-b0ccf8292d5d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.216061 Mar 29 03:23:00.272554 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3527/6823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:00 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:00.991694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-997570ad-0947-4c8b-a604-ce8a204bb06e req-9860dc4d-f6cc-4c45-99ed-95a91e01bb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "name": "network-vif-plugged", "status": "completed", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:23:01.006798 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:23:01.006798 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:23:01.006798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-997570ad-0947-4c8b-a604-ce8a204bb06e req-9860dc4d-f6cc-4c45-99ed-95a91e01bb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:01.006798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-997570ad-0947-4c8b-a604-ce8a204bb06e req-9860dc4d-f6cc-4c45-99ed-95a91e01bb04 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:01.016878 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-997570ad-0947-4c8b-a604-ce8a204bb06e req-9860dc4d-f6cc-4c45-99ed-95a91e01bb04 service nova] Creating event network-vif-plugged:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:23:01.021844 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-997570ad-0947-4c8b-a604-ce8a204bb06e req-9860dc4d-f6cc-4c45-99ed-95a91e01bb04 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033821 Mar 29 03:23:01.022483 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3297/6824] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:23:01.288679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:01.289291 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:01.296449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:01.296961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:01.297722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:01.298151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:01.497035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:01.505078 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b4f742a5-eded-466d-acd4-b13b5aa2b7ef tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.220112 Mar 29 03:23:01.505620 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3528/6825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:01 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:02.522815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:02.523523 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:02.531382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:02.531836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:02.532607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:02.533085 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:02.733121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:02.741213 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-19861ed6-cf34-4e9d-a305-9525774eb868 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1358 microversion: 2.1 time: 0.222528 Mar 29 03:23:02.741757 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3298/6826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:02 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:03.760158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:03.760773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:03.768097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:03.768476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:03.769263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:03.769693 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:03.960335 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:03.968914 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d6fb7059-058c-4550-b775-27dd27b51ca7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1549 microversion: 2.1 time: 0.212605 Mar 29 03:23:03.969462 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3529/6827] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:03 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:03.985204 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:03.985829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:03.992955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:03.993419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:03.994193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:03.994634 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:04.189524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:04.197678 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e25b138d-2df8-4636-b6ac-db305dc77d7a tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1549 microversion: 2.1 time: 0.216742 Mar 29 03:23:04.198232 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3299/6828] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:03 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1549 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:04.213273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:04.217006 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:23:04.217006 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:23:04.217984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:04.218716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Searching by: {'deleted': False, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef'} {{(pid=103513) get_all /opt/stack/nova/nova/compute/api.py:2855}} Mar 29 03:23:04.223934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:04.224369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:04.225251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:04.225680 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:04.311248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.multi_cell_list [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=103513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Mar 29 03:23:04.399208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cc03b0e6-a641-42c6-ada3-b77a4a42a906 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.189644 Mar 29 03:23:04.399700 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3530/6829] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Mar 29 03:23:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:23:04.410189 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:04.410839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:04.418213 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:04.418799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:04.419564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:04.420005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:04.610643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:04.618668 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8c2dfd52-ca8a-4199-936e-fca1be6c5b1f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1549 microversion: 2.1 time: 0.212101 Mar 29 03:23:04.619231 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3300/6830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:04 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:06.697669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:23:06.698794 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:06.706017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:06.706476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:06.707244 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:06.707682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:07.359816 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5f5ba5c5-a039-468e-a8fc-66811030331f tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.665706 Mar 29 03:23:07.360454 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3531/6831] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Mar 29 03:23:06 2022] POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments => generated 194 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:23:16.288093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:16.288721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:16.296584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:16.297026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:16.297798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:16.298242 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:16.493592 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:16.502772 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b45faee3-7040-4298-bfab-c69e00c23572 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1595 microversion: 2.1 time: 0.218459 Mar 29 03:23:16.503322 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3301/6832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:16 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1595 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:23:19.353889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c0d0a699-384a-4671-a4f8-e5af1f442715 req-99134f63-88f5-43c8-8f02-50d987f6e727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:23:19.355945 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:23:19.355945 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:23:19.365180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c0d0a699-384a-4671-a4f8-e5af1f442715 req-99134f63-88f5-43c8-8f02-50d987f6e727 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:19.365615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c0d0a699-384a-4671-a4f8-e5af1f442715 req-99134f63-88f5-43c8-8f02-50d987f6e727 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:19.381219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c0d0a699-384a-4671-a4f8-e5af1f442715 req-99134f63-88f5-43c8-8f02-50d987f6e727 service nova] Creating event network-changed:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:23:19.386108 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c0d0a699-384a-4671-a4f8-e5af1f442715 req-99134f63-88f5-43c8-8f02-50d987f6e727 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091139 Mar 29 03:23:19.386908 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3532/6833] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:23:22.289416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-745171740"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:23:22.289944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:22.297766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:22.298218 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:22.298979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:22.299414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:22.488327 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.network.security_group_api [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Adding security group 4e20da17-4e57-4199-80bc-b42406516710 to port 05dee28e-ce39-4b0c-99f7-7a8f01071fdf Mar 29 03:23:23.049843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c37ec242-b937-4782-9c19-0773fc521122 req-0e48d205-dd42-4979-bf0e-f63b88e5d865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:23:23.049843 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:23:23.049843 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:23:23.051331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e06daa6c-a051-4295-b0c2-da9cc64a4e21 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action" status: 202 len: 0 microversion: 2.1 time: 0.763730 Mar 29 03:23:23.052310 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3302/6834] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:23:22 2022] POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:23:23.064059 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:23:23.065429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:23:23.067941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c37ec242-b937-4782-9c19-0773fc521122 req-0e48d205-dd42-4979-bf0e-f63b88e5d865 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:23.068374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c37ec242-b937-4782-9c19-0773fc521122 req-0e48d205-dd42-4979-bf0e-f63b88e5d865 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:23.080303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:23.081024 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:23.083423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:23:23.084020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:23:23.093006 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c37ec242-b937-4782-9c19-0773fc521122 req-0e48d205-dd42-4979-bf0e-f63b88e5d865 service nova] Creating event network-changed:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:23:23.098031 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c37ec242-b937-4782-9c19-0773fc521122 req-0e48d205-dd42-4979-bf0e-f63b88e5d865 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054337 Mar 29 03:23:23.099009 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3533/6835] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:23:23.312009 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:23:23.322379 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c1c05512-d2e9-4be3-a813-16c053572205 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1759 microversion: 2.1 time: 0.265715 Mar 29 03:23:23.324883 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3303/6836] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:23:23 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1759 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:11.231230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:24:11.232272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:11.239707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:11.240143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:11.240910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:11.241340 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:11.521240 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c7186ff6-b80c-4727-bec7-4d2f50348401 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action" status: 202 len: 0 microversion: 2.1 time: 0.294639 Mar 29 03:24:11.521783 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3534/6837] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:24:11 2022] POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:24:11.529982 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:11.530638 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:11.533870 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:24:11.534697 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:24:11.539623 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:11.542436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:11.542436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:11.542436 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:11.750010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:11.758662 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9a3e0d57-406c-4efc-b660-11ebe4f8f473 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1751 microversion: 2.1 time: 0.232612 Mar 29 03:24:11.759216 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3304/6838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:11 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:12.775881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:12.776570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:12.784625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:12.785100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:12.785852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:12.786279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:13.068813 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:13.078400 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-26d346e3-5161-4330-8412-761d6ddffa89 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.306591 Mar 29 03:24:13.081705 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3535/6839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:12 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:14.096860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:14.097494 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:14.111637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:14.112094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:14.112893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:14.113336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:14.146739 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59344. Mar 29 03:24:14.147662 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59346. Mar 29 03:24:14.311560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:14.320042 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-54345a66-cc75-4d8e-b4a9-54010f70076d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.226872 Mar 29 03:24:14.320592 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3305/6840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:14 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:15.338135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:15.338786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:15.346535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:15.346980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:15.347739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:15.348168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:15.544295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:15.553368 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22a49d49-2164-494d-a236-6d324ae67c15 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.218647 Mar 29 03:24:15.553368 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3536/6841] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:15 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:16.569564 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:16.570192 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:16.577418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:16.577876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:16.578640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:16.579080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:16.774407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:16.783470 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c365059-f90d-46ac-942d-7851231c9fbf tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.217613 Mar 29 03:24:16.784023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3306/6842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:16 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:17.801689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:17.802295 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:17.812182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:17.812554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:17.813344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:17.813776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:18.011481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:18.020612 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0837577b-c6d1-49eb-875a-821e8fd286f3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.222575 Mar 29 03:24:18.021197 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3537/6843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:17 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:19.038752 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:19.039386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:19.047342 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:19.049709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:19.049709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:19.049709 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:19.247442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:19.256018 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39ce2047-7ab1-4c08-a528-285d333b21a7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.221185 Mar 29 03:24:19.256580 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3307/6844] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:19 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:20.273067 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:20.273774 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:20.282216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:20.282664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:20.283428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:20.283860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:20.477860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:20.486494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-baa079d6-a6ec-4d9f-81bc-d8ee0e591c28 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.217103 Mar 29 03:24:20.487054 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3538/6845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:20 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:21.502714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:21.503327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:21.510619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:21.511076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:21.512333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:21.512780 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:21.711972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:21.721320 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0cd3e04-8f0b-494c-af8d-e6344e29fcf1 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.222361 Mar 29 03:24:21.721894 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3308/6846] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:21 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:22.738652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:22.739266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:22.747029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:22.747485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:22.748236 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:22.748661 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:22.947180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:22.956233 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-881b9342-1b70-40ed-8677-9ad9ed2d5cf4 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1756 microversion: 2.1 time: 0.221303 Mar 29 03:24:22.956795 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3539/6847] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:22 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:23.974294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:24:23.974913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:24:23.982154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:23.982607 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:23.983373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:24:23.983809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:24:24.177933 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:24:24.187208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d7e47d3-39cd-478d-a5bd-1e6273755a23 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1759 microversion: 2.1 time: 0.216546 Mar 29 03:24:24.187766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3309/6848] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:24:23 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1759 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:24:52.234926 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:24:52.235702 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:24:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:25:13.271735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-745171740"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:13.272309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:13.279517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:13.279960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:13.280719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:13.281188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:13.474901 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.network.security_group_api [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Removing security group 4e20da17-4e57-4199-80bc-b42406516710 from port 05dee28e-ce39-4b0c-99f7-7a8f01071fdf Mar 29 03:25:13.998535 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed8295eb-80e4-4c07-836a-cdd063cb27d0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action" status: 202 len: 0 microversion: 2.1 time: 0.730899 Mar 29 03:25:14.002415 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3540/6849] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:25:13 2022] POST /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:25:14.089374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-59b538d1-4122-4c3b-ae28-3097e1673833 req-3883dbc7-818c-4fe5-b329-f8293b955115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:14.091113 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:25:14.091113 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:25:14.101248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-59b538d1-4122-4c3b-ae28-3097e1673833 req-3883dbc7-818c-4fe5-b329-f8293b955115 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:14.101707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-59b538d1-4122-4c3b-ae28-3097e1673833 req-3883dbc7-818c-4fe5-b329-f8293b955115 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:14.125542 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-59b538d1-4122-4c3b-ae28-3097e1673833 req-3883dbc7-818c-4fe5-b329-f8293b955115 service nova] Creating event network-changed:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:25:14.131029 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-59b538d1-4122-4c3b-ae28-3097e1673833 req-3883dbc7-818c-4fe5-b329-f8293b955115 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125082 Mar 29 03:25:14.132240 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3310/6850] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:25:16.043247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:16.044385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:16.048407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-dfefedbc-7bd9-41d1-ab35-603a5a312ef3 req-7f16bf19-f7a7-43bd-a2e6-23cb37b3426c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:16.050259 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:25:16.050259 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:25:16.052679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:16.053159 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:16.053933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:16.054371 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:16.065307 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dfefedbc-7bd9-41d1-ab35-603a5a312ef3 req-7f16bf19-f7a7-43bd-a2e6-23cb37b3426c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:16.065854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-dfefedbc-7bd9-41d1-ab35-603a5a312ef3 req-7f16bf19-f7a7-43bd-a2e6-23cb37b3426c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:16.084613 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-dfefedbc-7bd9-41d1-ab35-603a5a312ef3 req-7f16bf19-f7a7-43bd-a2e6-23cb37b3426c service nova] Creating event network-changed:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:25:16.089709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-dfefedbc-7bd9-41d1-ab35-603a5a312ef3 req-7f16bf19-f7a7-43bd-a2e6-23cb37b3426c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047980 Mar 29 03:25:16.090578 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3311/6851] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:25:16.216071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lazy-loading 'services' on Instance uuid af8d372b-c1dc-4f01-ad45-4436f01995e4 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:25:16.497066 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa2c4921-4c1e-4069-a380-f990c71f5ac3 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments/dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3" status: 202 len: 0 microversion: 2.1 time: 0.457573 Mar 29 03:25:16.497758 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3541/6852] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:25:16 2022] DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments/dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:25:16.506893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:16.507918 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:16.515685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:16.516154 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:16.525186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:16.525186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:16.586155 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f0d920d1-55c5-4d75-894d-a7e32a624f33 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083566 Mar 29 03:25:16.590332 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3312/6853] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:25:16 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:25:17.598673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:17.599709 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:17.609650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:17.609650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:17.609650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:17.609650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:17.678039 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-01f98d47-96e7-4d03-999e-9c33b8a11f9d tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083536 Mar 29 03:25:17.682134 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3542/6854] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:25:17 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:25:18.690314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:18.691237 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:18.698522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:18.698980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:18.699749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:18.700191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:18.762544 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3f7b5648-a21b-4011-af04-ca83556575c7 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076724 Mar 29 03:25:18.763084 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3313/6855] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Mar 29 03:25:18 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 29 03:25:18.773165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:18.773656 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:18.780830 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:18.781302 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:18.782066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:18.782516 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:18.923167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] HTTP exception thrown: Instance af8d372b-c1dc-4f01-ad45-4436f01995e4 is not attached to volume dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3 Mar 29 03:25:18.923761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Returning 404 to user: Instance af8d372b-c1dc-4f01-ad45-4436f01995e4 is not attached to volume dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3 {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:25:18.924564 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ea132553-387a-4047-88ba-403024d034b9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments/dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3" status: 404 len: 154 microversion: 2.1 time: 0.155249 Mar 29 03:25:18.925122 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3543/6856] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Mar 29 03:25:18 2022] DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4/os-volume_attachments/dd2c1c3e-db75-4dae-82a0-69bca8e3bdd3 => generated 154 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:25:21.373979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:21.374522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:21.382144 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:21.382600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:21.383363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:21.383822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:21.443435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:25:21.738456 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0f5695de-8869-4ca4-b863-c8cabcfcadbc tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 204 len: 0 microversion: 2.1 time: 0.367754 Mar 29 03:25:21.739078 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3314/6857] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:25:21 2022] DELETE /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:25:21.747030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:21.747717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:21.755804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:21.756260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:21.757063 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:21.757499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:21.960096 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:21.968470 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0702c4ed-4d9c-4cd5-99ed-780342bb46a5 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1555 microversion: 2.1 time: 0.225212 Mar 29 03:25:21.969138 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3544/6858] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:21 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:22.987439 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:22.988062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:22.995317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:22.995770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:22.996536 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:22.997008 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:23.317517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:23.325715 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f76962a-b6be-4d0e-ac98-0222815ef9a0 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1555 microversion: 2.1 time: 0.342534 Mar 29 03:25:23.326335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3315/6859] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:22 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1555 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:24.342953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:24.343668 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:24.351007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:24.351455 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:24.352216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:24.352648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:24.472227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fe25f1d536343dbb0b0a566ffcc6603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73a019f43cb4041a0fe9d0632e077ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:24.480605 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-178c6eec-d7f5-4b05-873f-a35172f1e3ba tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 200 len: 1513 microversion: 2.1 time: 0.141414 Mar 29 03:25:24.481420 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3545/6860] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:24 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:24.609261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1e61cbcf-a0c7-49e7-93b6-30dc33a84a30 req-65cb2317-047f-4aca-ac56-65dd957e3d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8d372b-c1dc-4f01-ad45-4436f01995e4", "name": "network-vif-deleted", "tag": "05dee28e-ce39-4b0c-99f7-7a8f01071fdf"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:24.610872 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:25:24.610872 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:25:24.619101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1e61cbcf-a0c7-49e7-93b6-30dc33a84a30 req-65cb2317-047f-4aca-ac56-65dd957e3d80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:24.621827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1e61cbcf-a0c7-49e7-93b6-30dc33a84a30 req-65cb2317-047f-4aca-ac56-65dd957e3d80 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:24.635572 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1e61cbcf-a0c7-49e7-93b6-30dc33a84a30 req-65cb2317-047f-4aca-ac56-65dd957e3d80 service nova] Creating event network-vif-deleted:05dee28e-ce39-4b0c-99f7-7a8f01071fdf for instance af8d372b-c1dc-4f01-ad45-4436f01995e4 on n-h1-828148-1 Mar 29 03:25:24.640246 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1e61cbcf-a0c7-49e7-93b6-30dc33a84a30 req-65cb2317-047f-4aca-ac56-65dd957e3d80 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Mar 29 03:25:24.640817 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3316/6861] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:25:25.504087 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:25.504617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] [instance: af8d372b-c1dc-4f01-ad45-4436f01995e4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:25.511808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:25.512341 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:25.513137 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:25.517079 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:25.569151 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] HTTP exception thrown: Instance af8d372b-c1dc-4f01-ad45-4436f01995e4 could not be found. Mar 29 03:25:25.569792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Returning 404 to user: Instance af8d372b-c1dc-4f01-ad45-4436f01995e4 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:25:25.570614 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b410d361-a0fe-418e-aeaa-ac4fdac1e9f9 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4" status: 404 len: 111 microversion: 2.1 time: 0.070490 Mar 29 03:25:25.571161 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3546/6862] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:25 2022] GET /compute/v2.1/servers/af8d372b-c1dc-4f01-ad45-4436f01995e4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 29 03:25:25.580845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e451c17b-ff5d-4d56-b4dc-33fccc0c1178 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] Calling method '.version_select at 0x7f872405d160>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:25.687021 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e451c17b-ff5d-4d56-b4dc-33fccc0c1178 tempest-TestMinimumBasicScenario-391704434 tempest-TestMinimumBasicScenario-391704434-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658729453" status: 202 len: 0 microversion: 2.1 time: 0.111114 Mar 29 03:25:25.687589 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3317/6863] 10.222.0.36 () {58 vars in 1268 bytes} [Tue Mar 29 03:25:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-658729453 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:25:41.779654 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:25:41.946472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: .version_select at 0x7f8717fc09d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1104840264"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:41.969652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:25:41.974745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:25:42.234382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:25:42.239785 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:25:42.254220 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed50a293-9c58-4b49-8079-e590a2faa9bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.479598 Mar 29 03:25:42.254847 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3547/6864] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:25:41 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:52.636072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1962045288", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "47224163-333c-4eeb-8f6b-281f0d7f9573"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1104840264", "security_groups": [{"name": "tempest-secgroup-smoke-1982446582"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:25:52.757821 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] validate_networks() for [('47224163-333c-4eeb-8f6b-281f0d7f9573', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:25:53.729570 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:25:53.735947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:25:53.735947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:25:53.735947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:25:53.735947 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:25:53.740465 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:53.741184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:53.742174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:53.742628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:53.772029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:25:53.780811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:25:53.799991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:25:53.802872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:25:53.934657 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-40fb0a56-43af-4d15-8295-fddc75b62c4f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.302547 Mar 29 03:25:53.942161 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3318/6865] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:25:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:25:53.947633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f4e82518-8b62-4c72-bbf3-f05db247673a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:53.948252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f4e82518-8b62-4c72-bbf3-f05db247673a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:53.994529 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59662. Mar 29 03:25:54.031424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f4e82518-8b62-4c72-bbf3-f05db247673a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:54.039857 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f4e82518-8b62-4c72-bbf3-f05db247673a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1267 microversion: 2.1 time: 0.097381 Mar 29 03:25:54.045094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3548/6866] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:53 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:55.059241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e113144-6d4b-4996-b87b-83c538901c84 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:55.059993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e113144-6d4b-4996-b87b-83c538901c84 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:55.131499 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e113144-6d4b-4996-b87b-83c538901c84 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:55.142105 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e113144-6d4b-4996-b87b-83c538901c84 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1267 microversion: 2.1 time: 0.086210 Mar 29 03:25:55.142851 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3319/6867] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:55 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:25:56.159028 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-78b87935-4c3f-450f-a0bc-96c9c6eaae5f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:56.159632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-78b87935-4c3f-450f-a0bc-96c9c6eaae5f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:56.232281 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-78b87935-4c3f-450f-a0bc-96c9c6eaae5f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:56.240238 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-78b87935-4c3f-450f-a0bc-96c9c6eaae5f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1267 microversion: 2.1 time: 0.085336 Mar 29 03:25:56.240783 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3549/6868] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:56 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:57.257106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e1ae0097-2f0c-4290-8273-354584de354e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:57.257762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e1ae0097-2f0c-4290-8273-354584de354e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:57.325243 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e1ae0097-2f0c-4290-8273-354584de354e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:57.332639 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e1ae0097-2f0c-4290-8273-354584de354e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1267 microversion: 2.1 time: 0.079244 Mar 29 03:25:57.333208 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3320/6869] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:57 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1267 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:58.350259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:58.350871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:58.359022 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:58.359465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:58.360213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:58.360637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:58.470971 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:58.478891 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb01e5cd-c7db-4163-b42a-1b23d251646f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1271 microversion: 2.1 time: 0.132920 Mar 29 03:25:58.479437 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3550/6870] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:58 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:25:59.495198 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:25:59.495822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:25:59.503664 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:59.504122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:59.504916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:25:59.505362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:25:59.620143 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:25:59.628867 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-246fc179-94ba-4128-a3fb-a7869f1ab19a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1263 microversion: 2.1 time: 0.137208 Mar 29 03:25:59.629766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3321/6871] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:25:59 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:00.645939 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:00.646889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:00.654796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:00.655406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:00.656286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:00.657612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:00.792994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:00.801906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e094c856-7df7-4cea-8c74-6201ad418ebe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1325 microversion: 2.1 time: 0.159638 Mar 29 03:26:00.802473 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3551/6872] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:00 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:01.819353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:01.820016 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:01.827246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:01.827699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:01.828514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:01.828989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:02.153440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:02.162055 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-250d9a6b-2188-43ad-b04b-834198753e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.346264 Mar 29 03:26:02.162619 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3322/6873] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:01 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:02.762634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ec67349d-f355-4f6b-ab87-db0951291a48 req-518bd63d-d3f6-4906-8602-3fc9d4995f70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf0b202-4b2d-4079-8813-afb19974ffb4", "tag": "8a1f6ca7-52f8-4474-8e60-0c76cde125e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:02.765499 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:26:02.765499 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:26:02.774926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec67349d-f355-4f6b-ab87-db0951291a48 req-518bd63d-d3f6-4906-8602-3fc9d4995f70 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:02.775472 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ec67349d-f355-4f6b-ab87-db0951291a48 req-518bd63d-d3f6-4906-8602-3fc9d4995f70 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:02.792951 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ec67349d-f355-4f6b-ab87-db0951291a48 req-518bd63d-d3f6-4906-8602-3fc9d4995f70 service nova] Creating event network-changed:8a1f6ca7-52f8-4474-8e60-0c76cde125e5 for instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 on n-h2-828148-1 Mar 29 03:26:02.797874 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ec67349d-f355-4f6b-ab87-db0951291a48 req-518bd63d-d3f6-4906-8602-3fc9d4995f70 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038872 Mar 29 03:26:02.798573 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3552/6874] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:26:03.178858 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:03.179471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:03.187049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:03.188433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:03.189229 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:03.189666 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:03.388628 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:03.396794 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b1d8722-28a7-42c2-b3b5-cd838581960a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.221730 Mar 29 03:26:03.397399 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3323/6875] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:03 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:04.414248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:04.414945 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:04.422501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:04.422944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:04.423703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:04.424134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:04.688293 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:04.696439 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-38aaa88b-f763-4d86-aadb-32ccbec8bb75 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.286478 Mar 29 03:26:04.697094 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3553/6876] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:04 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:05.713597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:05.715899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:05.722241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:05.722725 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:05.723502 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:05.723949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:05.915389 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:05.923422 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-944273b0-2a22-46ab-8183-6ae690a6cd2c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.213575 Mar 29 03:26:05.923986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3324/6877] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:05 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:06.940012 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:06.940614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:06.947881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:06.948317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:06.949100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:06.949525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:07.143884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:07.151884 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-27e92f95-5177-4fc5-9939-64d9fc967295 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.215544 Mar 29 03:26:07.152439 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3554/6878] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:06 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:08.168988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:08.169603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:08.177445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:08.177896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:08.178658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:08.179090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:08.372267 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:08.380251 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5c0bdc5c-3718-4a44-8958-858129faa469 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.214934 Mar 29 03:26:08.380803 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3325/6879] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:08 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:09.397377 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:09.397986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:09.405294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:09.405750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:09.406487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:09.406914 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:09.604329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:09.613466 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8da3312c-5c31-42c9-b558-380953be9749 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.219655 Mar 29 03:26:09.622702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3555/6880] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:09 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:10.630723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:10.631427 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:10.638754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:10.639214 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:10.639988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:10.640435 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:10.762156 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-35699ace-5aef-427c-88d2-caf921177d2f req-7d694ff2-9e07-49c6-aaee-a24ce27975d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf0b202-4b2d-4079-8813-afb19974ffb4", "name": "network-vif-plugged", "status": "completed", "tag": "8a1f6ca7-52f8-4474-8e60-0c76cde125e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:10.763695 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:26:10.763695 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:26:10.771747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-35699ace-5aef-427c-88d2-caf921177d2f req-7d694ff2-9e07-49c6-aaee-a24ce27975d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:10.772183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-35699ace-5aef-427c-88d2-caf921177d2f req-7d694ff2-9e07-49c6-aaee-a24ce27975d2 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:10.789799 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-35699ace-5aef-427c-88d2-caf921177d2f req-7d694ff2-9e07-49c6-aaee-a24ce27975d2 service nova] Creating event network-vif-plugged:8a1f6ca7-52f8-4474-8e60-0c76cde125e5 for instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 on n-h2-828148-1 Mar 29 03:26:10.794654 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-35699ace-5aef-427c-88d2-caf921177d2f req-7d694ff2-9e07-49c6-aaee-a24ce27975d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088412 Mar 29 03:26:10.795546 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3556/6881] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:26:10.845385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:10.853629 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e257816c-a41d-4b10-aa5b-71994a570fb5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.226548 Mar 29 03:26:10.854425 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3326/6882] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:10 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:11.871533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:11.872135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:11.880259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:11.880933 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:11.881710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:11.882242 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:12.077431 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:12.085855 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1edbbe37-6e83-4e9f-bb25-917fa44c7614 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1393 microversion: 2.1 time: 0.218466 Mar 29 03:26:12.086873 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3557/6883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:11 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1393 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:13.102637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:13.103255 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:13.111087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:13.111535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:13.112301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:13.112739 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:13.302669 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:13.310643 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f2fd191-79a3-4621-aee9-9699ed781c1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1565 microversion: 2.1 time: 0.211727 Mar 29 03:26:13.311205 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3327/6884] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:13 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1565 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:13.327163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:13.327781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:13.335157 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:13.335604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:13.336360 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:13.336792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:13.533261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:13.541456 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-31e81276-2ffb-40e3-bc18-4a8ba256023d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1565 microversion: 2.1 time: 0.218009 Mar 29 03:26:13.542014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3558/6885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:13 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1565 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:16.169148 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:16.170344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:16.170874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3241c817-c5f9-45c4-81b1-6ad0e39d3d2c req-9355d37f-59f1-4ece-88de-644a2b49753c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf0b202-4b2d-4079-8813-afb19974ffb4", "tag": "8a1f6ca7-52f8-4474-8e60-0c76cde125e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:16.172449 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:26:16.172449 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:26:16.178105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:16.178597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:16.179479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:16.179922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:16.180963 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3241c817-c5f9-45c4-81b1-6ad0e39d3d2c req-9355d37f-59f1-4ece-88de-644a2b49753c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:16.181488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3241c817-c5f9-45c4-81b1-6ad0e39d3d2c req-9355d37f-59f1-4ece-88de-644a2b49753c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:16.197494 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3241c817-c5f9-45c4-81b1-6ad0e39d3d2c req-9355d37f-59f1-4ece-88de-644a2b49753c service nova] Creating event network-changed:8a1f6ca7-52f8-4474-8e60-0c76cde125e5 for instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 on n-h2-828148-1 Mar 29 03:26:16.202434 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3241c817-c5f9-45c4-81b1-6ad0e39d3d2c req-9355d37f-59f1-4ece-88de-644a2b49753c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035305 Mar 29 03:26:16.203099 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3559/6886] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:26:16.393357 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:16.401638 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1c2e70e3-0faf-4a62-a29d-97e62050894b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1565 microversion: 2.1 time: 0.236703 Mar 29 03:26:16.404882 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3328/6887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:16 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1565 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:29.757816 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:26:29.758291 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:26:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:26:36.853070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:36.854077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:36.861653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:36.862100 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:36.862859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:36.863937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:36.945526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f7350610-62b9-4485-a47f-aa076492be19 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action" status: 200 len: 24563 microversion: 2.1 time: 0.096954 Mar 29 03:26:36.946128 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3560/6888] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:26:36 2022] POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action => generated 24563 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 29 03:26:43.315533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:43.316830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:43.324186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:43.324630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:43.325419 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:43.325856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:43.550336 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b221ed0c-0167-4902-8ea1-fe19779715ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action" status: 202 len: 0 microversion: 2.1 time: 0.238424 Mar 29 03:26:43.554254 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3329/6889] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:26:43 2022] POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:26:43.559742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:43.560525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:43.569491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:43.570021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:43.570793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:43.571226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:43.772482 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:43.780800 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c65ab39e-cc56-46ee-afc6-fbce14242898 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1689 microversion: 2.1 time: 0.225070 Mar 29 03:26:43.790742 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3561/6890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:43 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:44.798813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:44.799519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:44.807942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:44.808400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:44.809188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:44.809624 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:45.008114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:45.013211 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ecb1ba63-9aea-41d0-b788-06b5bc9f13e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1669 microversion: 2.1 time: 0.218509 Mar 29 03:26:45.013763 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3330/6891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:44 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1669 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:46.148045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:46.149023 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:46.156889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.157344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.158110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.158552 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.241754 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-038b7215-3a9f-4d30-a894-68eb061501f3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action" status: 200 len: 32636 microversion: 2.1 time: 0.097841 Mar 29 03:26:46.242532 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3562/6892] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:26:46 2022] POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action => generated 32636 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:26:46.253841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:46.254365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:46.261703 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.262162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.262919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.263358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.549586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e98da12a-a1c8-4757-87df-9c82f2cb6d80 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action" status: 202 len: 0 microversion: 2.1 time: 0.299621 Mar 29 03:26:46.550167 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3331/6893] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:26:46 2022] POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:26:46.558944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:46.559640 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:46.568327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.568776 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.569561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:46.569992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:46.770133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:46.778314 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5e0d666a-a84f-4c02-8447-ba9a2e8df644 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1676 microversion: 2.1 time: 0.223622 Mar 29 03:26:46.778875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3563/6894] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:46 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:47.800054 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:47.801581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:47.809456 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:47.809919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:47.810691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:47.811139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:48.007383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:48.015538 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-03f218be-2bd5-492d-9e4d-c6c9e0181688 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1684 microversion: 2.1 time: 0.222424 Mar 29 03:26:48.020970 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3332/6895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:47 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1684 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:26:48.154013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:48.154870 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:48.163381 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:48.163826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:48.164594 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:48.165061 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:48.245222 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7388234f-646c-4cd0-beba-cc3ce541e463 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action" status: 200 len: 35885 microversion: 2.1 time: 0.094841 Mar 29 03:26:48.245832 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3564/6896] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:26:48 2022] POST /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4/action => generated 35885 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:26:50.129283 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:50.129805 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:50.131699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-a837fdd7-d2bc-4ea0-9cff-8d648010e93d req-b9ba7c84-b0bc-4d8e-91ba-b5be3fdf360d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf0b202-4b2d-4079-8813-afb19974ffb4", "tag": "8a1f6ca7-52f8-4474-8e60-0c76cde125e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:50.134475 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:26:50.134475 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:26:50.137113 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:50.137566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:50.138358 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:50.138804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:50.145637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a837fdd7-d2bc-4ea0-9cff-8d648010e93d req-b9ba7c84-b0bc-4d8e-91ba-b5be3fdf360d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:50.146333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-a837fdd7-d2bc-4ea0-9cff-8d648010e93d req-b9ba7c84-b0bc-4d8e-91ba-b5be3fdf360d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:50.165065 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-a837fdd7-d2bc-4ea0-9cff-8d648010e93d req-b9ba7c84-b0bc-4d8e-91ba-b5be3fdf360d service nova] Creating event network-changed:8a1f6ca7-52f8-4474-8e60-0c76cde125e5 for instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 on n-h2-828148-1 Mar 29 03:26:50.170325 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-a837fdd7-d2bc-4ea0-9cff-8d648010e93d req-b9ba7c84-b0bc-4d8e-91ba-b5be3fdf360d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043295 Mar 29 03:26:50.171825 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3565/6897] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:26:50.205167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:26:50.575017 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-62dd011e-d0ed-45b5-9165-c2934c541703 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 204 len: 0 microversion: 2.1 time: 0.450154 Mar 29 03:26:50.575875 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3333/6898] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:26:50 2022] DELETE /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:26:50.585044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:50.586033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:50.593841 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:50.596800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:50.596800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:50.596800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:51.009921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:51.018252 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73a22e53-5995-4ed2-83e3-8a79cfc10ecd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1690 microversion: 2.1 time: 0.437523 Mar 29 03:26:51.019741 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3566/6899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:50 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1690 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:52.037674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:52.038333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:52.045560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:52.046021 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:52.046790 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:52.047235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:52.245123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:52.254037 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-efe117a1-1d61-455b-b5a4-f1ed71c3ed71 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1571 microversion: 2.1 time: 0.221315 Mar 29 03:26:52.254601 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3334/6900] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:52 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1571 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:52.948518 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e2f9d195-6031-475e-a078-6e608fddf3a4 req-06d70f8f-660e-401b-8013-d5d6a965ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf0b202-4b2d-4079-8813-afb19974ffb4", "name": "network-vif-deleted", "tag": "8a1f6ca7-52f8-4474-8e60-0c76cde125e5"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:26:52.950049 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:26:52.950049 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:26:52.959007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e2f9d195-6031-475e-a078-6e608fddf3a4 req-06d70f8f-660e-401b-8013-d5d6a965ed82 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:52.959447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e2f9d195-6031-475e-a078-6e608fddf3a4 req-06d70f8f-660e-401b-8013-d5d6a965ed82 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:52.975528 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e2f9d195-6031-475e-a078-6e608fddf3a4 req-06d70f8f-660e-401b-8013-d5d6a965ed82 service nova] Creating event network-vif-deleted:8a1f6ca7-52f8-4474-8e60-0c76cde125e5 for instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 on n-h2-828148-1 Mar 29 03:26:52.980221 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e2f9d195-6031-475e-a078-6e608fddf3a4 req-06d70f8f-660e-401b-8013-d5d6a965ed82 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Mar 29 03:26:52.980997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3567/6901] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:26:53.270832 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:53.271453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:53.279073 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:53.279534 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:53.280323 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:53.280768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:53.354582 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:53.355035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:53.355495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lazy-loading 'fault' on Instance uuid 0cf0b202-4b2d-4079-8813-afb19974ffb4 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:26:53.413871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:26:53.422108 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d28b6a17-7297-491a-baaa-bfbd8489a5e0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 200 len: 1357 microversion: 2.1 time: 0.155112 Mar 29 03:26:53.422665 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3335/6902] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:53 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:26:54.439517 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:26:54.440214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 0cf0b202-4b2d-4079-8813-afb19974ffb4] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:26:54.448394 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:54.448850 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:54.449611 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:26:54.450044 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:26:54.498302 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] HTTP exception thrown: Instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 could not be found. Mar 29 03:26:54.498889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Returning 404 to user: Instance 0cf0b202-4b2d-4079-8813-afb19974ffb4 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:26:54.499690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-18008079-ab39-43c1-a374-624f6d70f645 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4" status: 404 len: 111 microversion: 2.1 time: 0.064341 Mar 29 03:26:54.500206 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3568/6903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:26:54 2022] GET /compute/v2.1/servers/0cf0b202-4b2d-4079-8813-afb19974ffb4 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:27:00.164938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f38e5968-867c-42b5-a472-3dd769cf96c2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '.version_select at 0x7f872405d280>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:00.239217 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f38e5968-867c-42b5-a472-3dd769cf96c2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1104840264" status: 202 len: 0 microversion: 2.1 time: 0.077999 Mar 29 03:27:00.239803 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3336/6904] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 03:27:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1104840264 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:27:00.265803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: .version_select at 0x7f87240d5280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2132764223"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:27:00.288733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:27:00.293974 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:27:01.092277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:27:01.096592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:27:01.110628 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ed4bc4f-7109-4300-a7a4-2e9d39f6cbc7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.848471 Mar 29 03:27:01.111225 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3569/6905] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:27:00 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:11.105561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-535593021", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "e7c3a45e-60d5-41c9-8add-a7fab4cb8220"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2132764223", "security_groups": [{"name": "tempest-secgroup-smoke-666954374"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:27:11.235076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] validate_networks() for [('e7c3a45e-60d5-41c9-8add-a7fab4cb8220', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:27:11.837338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:27:11.837777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:27:11.838265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:27:11.838689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:27:11.839114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:27:11.848087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:11.848537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:11.849383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:11.849828 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:11.867469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:27:11.872756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:27:11.884559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:27:11.886934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:27:12.016445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-db2bd257-94a3-43d1-b479-209dd3e1024b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914520 Mar 29 03:27:12.017497 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3337/6906] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:27:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:27:12.027284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0a081445-d461-4899-add4-b9993f9d37c5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:12.028021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0a081445-d461-4899-add4-b9993f9d37c5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:12.124078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0a081445-d461-4899-add4-b9993f9d37c5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:12.131180 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0a081445-d461-4899-add4-b9993f9d37c5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1266 microversion: 2.1 time: 0.107676 Mar 29 03:27:12.131778 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3570/6907] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:12 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:13.147393 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-92d99093-9b03-4215-9990-32435ebac4a9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:13.147917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-92d99093-9b03-4215-9990-32435ebac4a9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:13.228731 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-92d99093-9b03-4215-9990-32435ebac4a9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:13.237110 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-92d99093-9b03-4215-9990-32435ebac4a9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1266 microversion: 2.1 time: 0.093487 Mar 29 03:27:13.242989 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3338/6908] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:13 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:14.255009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3dd675b7-e414-447e-9433-6092bffca3d8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:14.255762 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3dd675b7-e414-447e-9433-6092bffca3d8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:14.327248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3dd675b7-e414-447e-9433-6092bffca3d8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:14.336799 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3dd675b7-e414-447e-9433-6092bffca3d8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1266 microversion: 2.1 time: 0.085969 Mar 29 03:27:14.347317 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3571/6909] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:14 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:15.363753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:15.364362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:15.367574 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:27:15.368396 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:27:15.373560 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:15.374013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:15.375015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:15.375459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:15.485851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:15.494509 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2df635c9-876f-41a9-b9cd-81b59a0d3bae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1270 microversion: 2.1 time: 0.134979 Mar 29 03:27:15.495060 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3339/6910] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:15 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:16.511343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:16.511975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:16.519909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:16.520345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:16.521119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:16.521544 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:16.643351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:16.651522 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04c5c9d3-c815-4e28-bb56-1fe5031f73e4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1318 microversion: 2.1 time: 0.143873 Mar 29 03:27:16.655922 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3572/6911] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:16 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:17.668706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:17.669527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:17.682507 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:17.682975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:17.683763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:17.684207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:17.741018 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59926. Mar 29 03:27:17.745526 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 59928. Mar 29 03:27:17.802276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:17.810546 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d94182a1-04c5-4c45-b920-6f96701d850e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1324 microversion: 2.1 time: 0.145827 Mar 29 03:27:17.811110 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3340/6912] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:17 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1324 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:18.827608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:18.828219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:18.836719 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:18.837196 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:18.838056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:18.838491 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:19.261721 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:19.270221 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-cfdd7b2b-07b2-4e16-b923-a320840619a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.446528 Mar 29 03:27:19.270865 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3573/6913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:18 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:19.335747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-7be84825-bf0d-4e83-ba22-26de49aa08f8 req-1e604cb5-3791-4ea8-a9e1-63b0b2ca4ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277184fa-48f0-4fce-8772-f9854f06d374", "tag": "659539fc-e3ad-435f-843a-c05807293051"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:27:19.337929 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:27:19.337929 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:27:19.348225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7be84825-bf0d-4e83-ba22-26de49aa08f8 req-1e604cb5-3791-4ea8-a9e1-63b0b2ca4ce7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:19.348759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-7be84825-bf0d-4e83-ba22-26de49aa08f8 req-1e604cb5-3791-4ea8-a9e1-63b0b2ca4ce7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:19.366369 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-7be84825-bf0d-4e83-ba22-26de49aa08f8 req-1e604cb5-3791-4ea8-a9e1-63b0b2ca4ce7 service nova] Creating event network-changed:659539fc-e3ad-435f-843a-c05807293051 for instance 277184fa-48f0-4fce-8772-f9854f06d374 on n-h1-828148-1 Mar 29 03:27:19.371261 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-7be84825-bf0d-4e83-ba22-26de49aa08f8 req-1e604cb5-3791-4ea8-a9e1-63b0b2ca4ce7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039384 Mar 29 03:27:19.372068 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3341/6914] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:27:20.287179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:20.287803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:20.295584 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:20.296032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:20.297006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:20.297613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:20.559855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:20.568868 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51606939-64ae-42b3-bbec-4a5d4295a5ad tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.285416 Mar 29 03:27:20.569483 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3574/6915] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:20 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:21.587087 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:21.587792 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:21.595202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:21.595655 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:21.596418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:21.596878 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:21.914667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:21.922822 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7744dbfc-cc3a-4dcd-b627-1e4cbd82a01f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.339867 Mar 29 03:27:21.923383 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3342/6916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:21 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:22.940683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:22.941249 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:22.948561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:22.949045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:22.949815 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:22.950251 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:23.148818 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:23.156913 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-93a7afb9-e26c-4eee-993b-6ec9c75dd00c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.220262 Mar 29 03:27:23.157472 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3575/6917] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:22 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:27:24.173637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:24.174370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:24.181803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:24.182263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:24.183978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:24.183978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:24.382037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:24.390325 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5f6bcc55-2ff2-4037-b7cd-cd0e3531db24 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.220464 Mar 29 03:27:24.390896 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3343/6918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:24 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:25.407781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:25.408608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:25.417037 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:25.417500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:25.418254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:25.418717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:25.612554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:25.620804 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6f017b5e-5539-4ad9-95b1-93d10309b099 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.216831 Mar 29 03:27:25.621387 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3576/6919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:25 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:26.472193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-28865097-4d89-4c8b-bb78-184bfac791b9 req-bcb504cc-5712-4927-b98b-6845b07ee073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277184fa-48f0-4fce-8772-f9854f06d374", "name": "network-vif-plugged", "status": "completed", "tag": "659539fc-e3ad-435f-843a-c05807293051"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:27:26.473792 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:27:26.473792 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:27:26.481795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-28865097-4d89-4c8b-bb78-184bfac791b9 req-bcb504cc-5712-4927-b98b-6845b07ee073 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:26.487233 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-28865097-4d89-4c8b-bb78-184bfac791b9 req-bcb504cc-5712-4927-b98b-6845b07ee073 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:26.497936 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-28865097-4d89-4c8b-bb78-184bfac791b9 req-bcb504cc-5712-4927-b98b-6845b07ee073 service nova] Creating event network-vif-plugged:659539fc-e3ad-435f-843a-c05807293051 for instance 277184fa-48f0-4fce-8772-f9854f06d374 on n-h1-828148-1 Mar 29 03:27:26.502803 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-28865097-4d89-4c8b-bb78-184bfac791b9 req-bcb504cc-5712-4927-b98b-6845b07ee073 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034274 Mar 29 03:27:26.504237 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3344/6920] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:27:26.636749 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:26.637399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:26.644910 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:26.645363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:26.646138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:26.646577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:26.843989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:26.852461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c67a539-1ed0-4c1d-9bf7-ea3083617109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.219568 Mar 29 03:27:26.853052 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3577/6921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:26 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:27.870222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:27.870925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:27.880656 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:27.881168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:27.881941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:27.882381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:28.079306 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:28.087524 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9918811-eac8-43ba-ad51-bc584c173ddf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1391 microversion: 2.1 time: 0.221365 Mar 29 03:27:28.088099 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3345/6922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:27 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:29.104065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:29.104672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:29.111897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:29.112339 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:29.113123 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:29.113551 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:29.312758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:29.321401 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-adb87fc2-6a33-4395-8400-f1a5184c8076 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1564 microversion: 2.1 time: 0.221116 Mar 29 03:27:29.321960 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3578/6923] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:29 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1564 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:29.338803 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:29.339420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:29.346627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:29.347117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:29.347891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:29.348338 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:29.540667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:29.548780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-eada2ef1-f6c4-4bdf-ba16-b38390143b9e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1564 microversion: 2.1 time: 0.213755 Mar 29 03:27:29.549362 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3346/6924] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:29 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1564 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:27:32.160048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:27:32.160704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:27:32.163178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-63837d1d-88aa-4d19-b530-aa9ca50d5935 req-d64e5730-912a-493c-8f94-481f6b5a8dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277184fa-48f0-4fce-8772-f9854f06d374", "tag": "659539fc-e3ad-435f-843a-c05807293051"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:27:32.164826 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:27:32.164826 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:27:32.168783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:32.169265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:32.170049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:32.170485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:32.173596 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63837d1d-88aa-4d19-b530-aa9ca50d5935 req-d64e5730-912a-493c-8f94-481f6b5a8dd5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:27:32.174045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-63837d1d-88aa-4d19-b530-aa9ca50d5935 req-d64e5730-912a-493c-8f94-481f6b5a8dd5 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:27:32.190659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-63837d1d-88aa-4d19-b530-aa9ca50d5935 req-d64e5730-912a-493c-8f94-481f6b5a8dd5 service nova] Creating event network-changed:659539fc-e3ad-435f-843a-c05807293051 for instance 277184fa-48f0-4fce-8772-f9854f06d374 on n-h1-828148-1 Mar 29 03:27:32.195841 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-63837d1d-88aa-4d19-b530-aa9ca50d5935 req-d64e5730-912a-493c-8f94-481f6b5a8dd5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037860 Mar 29 03:27:32.196650 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3347/6925] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:27:32.610631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:27:32.622373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-07fd6376-6928-4520-8b24-473e1c2516de tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1564 microversion: 2.1 time: 0.466761 Mar 29 03:27:32.623419 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3579/6926] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:27:32 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1564 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:03.971911 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:28:03.973440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:03.981182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:03.981646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:03.982421 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:03.982867 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:04.061923 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e7cd83b-bdbe-4463-bc21-914559150e18 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action" status: 200 len: 24569 microversion: 2.1 time: 0.094136 Mar 29 03:28:04.062529 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3348/6927] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:28:03 2022] POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action => generated 24569 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:28:34.491829 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:28:34.492878 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:34.500604 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:34.501088 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:34.501847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:34.502278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:34.803058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-37910b9b-830c-4113-b153-bf6365d707cb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action" status: 202 len: 0 microversion: 2.1 time: 0.315357 Mar 29 03:28:34.803694 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3580/6928] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:28:34 2022] POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:28:34.812374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:34.814516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:34.821152 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:34.821604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:34.822373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:34.822808 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:35.098813 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:35.107010 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-603fe808-ba0e-4299-a17a-5703ba10f8a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1675 microversion: 2.1 time: 0.298915 Mar 29 03:28:35.107575 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3349/6929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:34 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1675 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:36.124889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:36.125596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:36.133048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:36.133496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:36.134259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:36.134689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:36.380264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:36.388474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-056dcc31-c986-424d-a649-12f6460d96e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.267719 Mar 29 03:28:36.389061 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3581/6930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:36 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:37.406332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:37.406954 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:37.415239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:37.415701 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:37.416506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:37.416979 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:37.607079 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:37.615309 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b88fb8d8-9f26-4fff-898f-d4fb7d611a15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.212693 Mar 29 03:28:37.615884 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3350/6931] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:37 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:38.633632 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:38.634239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:38.641634 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:38.642080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:38.642837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:38.643267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:38.836006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:38.843997 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5b613153-99d2-4b24-9cfb-0c0f11a4f613 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.214098 Mar 29 03:28:38.844553 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3582/6932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:38 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:39.861105 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:39.861720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:39.869942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:39.870392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:39.871158 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:39.871593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:40.175673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:40.183865 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-acab1f14-8a41-4744-b889-7a7e6217bb66 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.326353 Mar 29 03:28:40.184435 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3351/6933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:39 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:41.202342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:41.203035 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:41.211068 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:41.214351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:41.214351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:41.214351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:41.406712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:41.414787 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a019d6a8-2ce7-4b16-a71e-56ea6b7d6a27 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.216395 Mar 29 03:28:41.415344 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3583/6934] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:41 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:42.431491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:42.432106 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:42.439295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:42.439748 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:42.441071 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:42.441512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:42.637258 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:42.646100 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56135a6f-d879-4e54-ae92-409c93815ab6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.218349 Mar 29 03:28:42.646656 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3352/6935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:42 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:43.664086 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:43.664765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:43.672561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:43.673046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:43.673826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:43.674256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:43.870828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:43.878992 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b8b79500-cb10-45b7-889a-bae625ec098c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.219395 Mar 29 03:28:43.879540 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3584/6936] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:43 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:44.895890 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:44.896513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:44.904269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:44.904732 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:44.905566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:44.906028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:45.100688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:45.108900 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82493594-6e64-463e-a211-01be7c1c5247 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.216704 Mar 29 03:28:45.109462 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3353/6937] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:44 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:46.125796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:46.126406 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:46.134396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:46.136048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:46.136048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:46.136048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:46.325211 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:46.333384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-50fab99b-b420-41db-b30d-ece527a30005 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1680 microversion: 2.1 time: 0.211254 Mar 29 03:28:46.333947 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3585/6938] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:46 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:28:47.350381 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:28:47.351000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:28:47.358305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:47.358759 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:47.359527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:28:47.359968 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:28:47.552346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:28:47.560418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f7b23d81-a915-4d3b-82a5-ecb78bd290e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1683 microversion: 2.1 time: 0.213747 Mar 29 03:28:47.560994 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3354/6939] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:28:47 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1683 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:29:19.810569 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:29:19.814452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:29:19.815372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:19.823090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:19.823826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:19.824590 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:19.825065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:19.912493 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6327a2c4-7b8b-4d51-b2f1-13492fb59d40 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action" status: 200 len: 69034 microversion: 2.1 time: 0.102844 Mar 29 03:29:19.913162 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3586/6940] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:29:19 2022] POST /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374/action => generated 69034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:29:37.846385 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:37.846977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:37.856694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:37.857173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:37.857952 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:37.858390 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:37.867324 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60062. Mar 29 03:29:37.903326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-b0c74a34-a479-462e-8c97-4bd47a4fd6c6 req-b653b59d-fbd4-4cdb-9ca0-b97664f257b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "277184fa-48f0-4fce-8772-f9854f06d374", "tag": "659539fc-e3ad-435f-843a-c05807293051"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:29:37.904878 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:29:37.904878 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:29:37.917004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b0c74a34-a479-462e-8c97-4bd47a4fd6c6 req-b653b59d-fbd4-4cdb-9ca0-b97664f257b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:37.917322 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-b0c74a34-a479-462e-8c97-4bd47a4fd6c6 req-b653b59d-fbd4-4cdb-9ca0-b97664f257b0 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:37.927742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:29:37.932860 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-b0c74a34-a479-462e-8c97-4bd47a4fd6c6 req-b653b59d-fbd4-4cdb-9ca0-b97664f257b0 service nova] Creating event network-changed:659539fc-e3ad-435f-843a-c05807293051 for instance 277184fa-48f0-4fce-8772-f9854f06d374 on n-h1-828148-1 Mar 29 03:29:37.938023 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-b0c74a34-a479-462e-8c97-4bd47a4fd6c6 req-b653b59d-fbd4-4cdb-9ca0-b97664f257b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092698 Mar 29 03:29:37.938971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3587/6941] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:29:38.300553 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1eb5686c-42b8-44a3-853d-fdbb883a8d77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 204 len: 0 microversion: 2.1 time: 0.458088 Mar 29 03:29:38.301459 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3355/6942] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:29:37 2022] DELETE /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:29:38.310374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:38.311309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:38.319524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:38.319960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:38.320935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:38.321364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:38.724639 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:29:38.734215 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-851ab132-c6e7-426f-bf4f-8e91b3030aa3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1689 microversion: 2.1 time: 0.428096 Mar 29 03:29:38.734999 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3588/6943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:29:38 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1689 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:29:39.752222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:39.752222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:39.760303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:39.760763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:39.761555 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:39.761988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:40.038429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:29:40.046790 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c47018fd-d5db-4e80-9da5-b3652ee101bd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1570 microversion: 2.1 time: 0.298724 Mar 29 03:29:40.047353 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3356/6944] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:29:39 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1570 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:29:40.815366 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2c3a2e68-30fb-4ff1-b917-7d4a2e159b8c req-8e5570ba-be40-47c2-b7e9-0a8e7430ec31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "277184fa-48f0-4fce-8772-f9854f06d374", "name": "network-vif-deleted", "tag": "659539fc-e3ad-435f-843a-c05807293051"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:29:40.817656 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:29:40.817656 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:29:40.826422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2c3a2e68-30fb-4ff1-b917-7d4a2e159b8c req-8e5570ba-be40-47c2-b7e9-0a8e7430ec31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:40.826884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2c3a2e68-30fb-4ff1-b917-7d4a2e159b8c req-8e5570ba-be40-47c2-b7e9-0a8e7430ec31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:40.842429 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2c3a2e68-30fb-4ff1-b917-7d4a2e159b8c req-8e5570ba-be40-47c2-b7e9-0a8e7430ec31 service nova] Creating event network-vif-deleted:659539fc-e3ad-435f-843a-c05807293051 for instance 277184fa-48f0-4fce-8772-f9854f06d374 on n-h1-828148-1 Mar 29 03:29:40.847208 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2c3a2e68-30fb-4ff1-b917-7d4a2e159b8c req-8e5570ba-be40-47c2-b7e9-0a8e7430ec31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Mar 29 03:29:40.847787 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3589/6945] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:29:41.065804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:41.069300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:41.074180 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:41.074641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:41.075432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:41.075874 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:41.193239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:29:41.202248 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5206d036-cf33-45f8-be2d-300dbd131aa0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 200 len: 1351 microversion: 2.1 time: 0.140034 Mar 29 03:29:41.206229 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3357/6946] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:29:41 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:29:42.220222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:42.220954 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 277184fa-48f0-4fce-8772-f9854f06d374] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:29:42.228507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:42.228997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:42.229773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:29:42.230208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:29:42.279004 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] HTTP exception thrown: Instance 277184fa-48f0-4fce-8772-f9854f06d374 could not be found. Mar 29 03:29:42.279603 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Returning 404 to user: Instance 277184fa-48f0-4fce-8772-f9854f06d374 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:29:42.280477 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ab12fa5-470b-4166-a63b-1bda0c2ea18e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374" status: 404 len: 111 microversion: 2.1 time: 0.064539 Mar 29 03:29:42.281036 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3590/6947] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:29:42 2022] GET /compute/v2.1/servers/277184fa-48f0-4fce-8772-f9854f06d374 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:29:47.770367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-38a6ba18-0893-4228-b865-ca7651ca0e4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '.version_select at 0x7f8717d57c10>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:29:47.860803 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-38a6ba18-0893-4228-b865-ca7651ca0e4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2132764223" status: 202 len: 0 microversion: 2.1 time: 0.094586 Mar 29 03:29:47.861488 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3358/6948] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 03:29:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2132764223 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:29:47.887998 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: .version_select at 0x7f87240cf820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-675492686"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:29:47.910232 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:29:47.915282 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:29:47.928046 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [041e4ede-e058-4112-8064-8ca9eae076f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:29:48.934558 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [041e4ede-e058-4112-8064-8ca9eae076f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60100. Mar 29 03:29:49.153065 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:29:49.158722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:29:49.172558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ec0f7a2-a449-4423-966b-88ef172e0c17 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.288341 Mar 29 03:29:49.173177 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3591/6949] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:29:47 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:29:49.766398 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:29:49.766599 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:29:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:29:52.086103 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:29:52.086586 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:29:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:29:59.521687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1594962348", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "895da1df-f691-45df-a129-9ac1009567ce"}], "key_name": "tempest-TestNetworkAdvancedServerOps-675492686", "security_groups": [{"name": "tempest-secgroup-smoke-664689436"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:29:59.716422 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] validate_networks() for [('895da1df-f691-45df-a129-9ac1009567ce', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:30:00.530500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:30:00.531081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:30:00.531434 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:30:00.531913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:30:00.532343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:30:00.541221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:00.541680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:00.542488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:00.543126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:00.561208 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:30:00.566978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:30:00.579362 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:30:00.582349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:30:00.723520 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b6d3cee0-053a-4713-ad1c-701119af5aec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.205294 Mar 29 03:30:00.724188 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3359/6950] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:29:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:30:00.734367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ced3a59-e37f-483a-8d72-0b1f6c27fabc tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:00.734973 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ced3a59-e37f-483a-8d72-0b1f6c27fabc tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:00.863503 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ced3a59-e37f-483a-8d72-0b1f6c27fabc tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:00.872670 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ced3a59-e37f-483a-8d72-0b1f6c27fabc tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1266 microversion: 2.1 time: 0.141018 Mar 29 03:30:00.872670 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3592/6951] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:00 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:01.887920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:01.889366 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:01.898042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:01.898591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:01.900141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:01.900141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:02.038296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:02.047196 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7fc5915-84c8-429d-ba44-38eec577c5b5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1262 microversion: 2.1 time: 0.163072 Mar 29 03:30:02.059933 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3360/6952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:01 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:30:03.071828 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:03.072722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:03.080277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:03.080798 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:03.082153 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:03.082664 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:03.213228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:03.221282 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23c6b821-6764-4433-8f43-7d69de084fca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1324 microversion: 2.1 time: 0.153557 Mar 29 03:30:03.222038 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3593/6953] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:03 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:04.239417 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:04.240031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:04.247789 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:04.248245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:04.249076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:04.249641 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:04.448005 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:04.456143 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f575b172-5a68-49f5-90f7-d20cef0b1d1b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.221034 Mar 29 03:30:04.457241 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3361/6954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:04 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:30:05.047588 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-595bc5ef-9eba-48f2-871d-3b857c8326b7 req-9cb49964-ca43-48e5-9020-9751262be258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:30:05.050105 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:30:05.050105 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:30:05.061275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-595bc5ef-9eba-48f2-871d-3b857c8326b7 req-9cb49964-ca43-48e5-9020-9751262be258 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:05.061722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-595bc5ef-9eba-48f2-871d-3b857c8326b7 req-9cb49964-ca43-48e5-9020-9751262be258 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:05.081961 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-595bc5ef-9eba-48f2-871d-3b857c8326b7 req-9cb49964-ca43-48e5-9020-9751262be258 service nova] Creating event network-changed:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h2-828148-1 Mar 29 03:30:05.087431 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-595bc5ef-9eba-48f2-871d-3b857c8326b7 req-9cb49964-ca43-48e5-9020-9751262be258 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043081 Mar 29 03:30:05.088041 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3594/6955] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:30:05.473981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:05.474604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:05.481771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:05.482232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:05.483003 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:05.483445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:05.683836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:05.692797 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e9f2f984-acb2-404a-b9b5-4a045cd55491 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.222951 Mar 29 03:30:05.693393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3362/6956] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:05 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:06.710642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:06.711337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:06.718811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:06.719256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:06.720007 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:06.720436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:07.024630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:07.032691 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2076456c-3ff1-40f4-bff4-e2d27cec71c7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.326635 Mar 29 03:30:07.033295 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3595/6957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:06 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:08.049682 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:08.050817 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:08.058057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:08.058508 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:08.059269 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:08.059705 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:08.250626 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:08.258603 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c61d6b86-7c7e-4279-a918-8b65058e7172 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.212674 Mar 29 03:30:08.259150 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3363/6958] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:08 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:09.274650 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:09.275266 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:09.282649 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:09.283099 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:09.283867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:09.284305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:09.484975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:09.493637 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-437bf938-342a-44f4-9c35-94b148c27bfd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.222864 Mar 29 03:30:09.494208 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3596/6959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:09 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:10.510049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:10.510670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:10.518336 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:10.518798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:10.519573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:10.520013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:10.815069 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:10.824203 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cb517d4d-c9ad-4229-a043-329e056b5de8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.317850 Mar 29 03:30:10.824757 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3364/6960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:10 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:11.775987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5ac44897-6508-4dc1-a1ac-8cc5ebef6735 req-7adb95de-33a1-4500-9dc3-0922a4133dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "name": "network-vif-plugged", "status": "completed", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:30:11.777937 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:30:11.777937 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:30:11.786135 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5ac44897-6508-4dc1-a1ac-8cc5ebef6735 req-7adb95de-33a1-4500-9dc3-0922a4133dd4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:11.786569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5ac44897-6508-4dc1-a1ac-8cc5ebef6735 req-7adb95de-33a1-4500-9dc3-0922a4133dd4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:11.802174 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5ac44897-6508-4dc1-a1ac-8cc5ebef6735 req-7adb95de-33a1-4500-9dc3-0922a4133dd4 service nova] Creating event network-vif-plugged:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h2-828148-1 Mar 29 03:30:11.807087 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5ac44897-6508-4dc1-a1ac-8cc5ebef6735 req-7adb95de-33a1-4500-9dc3-0922a4133dd4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Mar 29 03:30:11.807713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3597/6961] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:30:11.841305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:11.841951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:11.850811 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:11.851314 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:11.852119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:11.852729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:12.050992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:12.058898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83e0ff46-6ff7-4de6-8e36-90134880ebca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.221838 Mar 29 03:30:12.059446 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3365/6962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:11 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:13.077312 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:13.078039 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:13.086103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:13.088107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:13.088107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:13.088107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:13.287051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:13.295082 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ed5f26c0-8e45-4c29-861a-ba636fb31aee tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1391 microversion: 2.1 time: 0.222310 Mar 29 03:30:13.295634 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3598/6963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:13 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:14.311922 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:14.312575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:14.320301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:14.320768 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:14.321572 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:14.322272 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:14.524859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:14.532867 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-79ea8208-1607-4b96-999a-408145f6ce69 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1563 microversion: 2.1 time: 0.224706 Mar 29 03:30:14.533437 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3366/6964] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:14 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1563 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:14.549392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:14.550006 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:14.557416 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:14.557862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:14.558624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:14.559053 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:14.750654 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:14.759338 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-307956d4-bb18-4411-9112-a00f8b6a454a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1563 microversion: 2.1 time: 0.213689 Mar 29 03:30:14.759902 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3599/6965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:14 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1563 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:30:17.559883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:17.560514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:17.568798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:17.569416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:17.570201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:17.570644 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:17.611467 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-5792cf79-d684-49cd-a55d-aa991c1855bf req-ecede202-feae-4dee-acfe-d17f8862c5fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:30:17.613735 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:30:17.613735 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:30:17.622585 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5792cf79-d684-49cd-a55d-aa991c1855bf req-ecede202-feae-4dee-acfe-d17f8862c5fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:17.623262 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-5792cf79-d684-49cd-a55d-aa991c1855bf req-ecede202-feae-4dee-acfe-d17f8862c5fe service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:17.640622 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-5792cf79-d684-49cd-a55d-aa991c1855bf req-ecede202-feae-4dee-acfe-d17f8862c5fe service nova] Creating event network-changed:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h2-828148-1 Mar 29 03:30:17.646436 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-5792cf79-d684-49cd-a55d-aa991c1855bf req-ecede202-feae-4dee-acfe-d17f8862c5fe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093341 Mar 29 03:30:17.647587 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3600/6966] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:30:17.721774 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:30:17.795533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:17.804652 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fedba46a-982b-447b-9a24-e77b7f0f4e0e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1563 microversion: 2.1 time: 0.254210 Mar 29 03:30:17.805552 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3367/6967] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:17 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:36.337570 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:30:36.338587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:36.346122 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:36.346569 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:36.347328 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:36.347760 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:36.432474 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8a2c2b39-f860-4356-97af-6e86afd90541 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action" status: 200 len: 24561 microversion: 2.1 time: 0.099554 Mar 29 03:30:36.433170 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3601/6968] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:30:36 2022] POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action => generated 24561 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:30:47.491089 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60262. Mar 29 03:30:47.553363 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:30:47.554380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:47.561557 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:47.562013 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:47.562775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:47.563250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:47.634281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:47.646515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Old instance type m1.heat2, new instance type m1.heat {{(pid=103514) resize /opt/stack/nova/nova/compute/api.py:4035}} Mar 29 03:30:47.653619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:30:47.654047 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:30:47.654529 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:30:47.654946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:30:47.655394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:30:47.980942 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fb748e0-2888-4ab5-8001-8becf9f94c98 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action" status: 202 len: 0 microversion: 2.1 time: 0.500434 Mar 29 03:30:47.981544 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3368/6969] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:30:47 2022] POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:30:47.990876 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:47.991568 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:47.999715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:48.000149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:48.000944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:48.001372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:48.196501 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:48.204567 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dbabc93b-3786-40f7-9c2f-34cac8938d4a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1690 microversion: 2.1 time: 0.218621 Mar 29 03:30:48.205152 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3602/6970] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:47 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:30:49.221977 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:49.222729 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:49.230002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:49.230461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:49.231225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:49.231667 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:49.428423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:49.436668 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-31a0353b-44f8-4ae0-bba9-84244d7bbaf2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1690 microversion: 2.1 time: 0.218400 Mar 29 03:30:49.437284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3369/6971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:49 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:50.453687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:50.454300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:50.462962 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:50.463511 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:50.464651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:50.465179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:50.819016 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:50.827880 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d69ddc47-5449-4918-b49e-8a26e5df364c tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1690 microversion: 2.1 time: 0.377884 Mar 29 03:30:50.828450 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3603/6972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:50 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1690 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:51.844369 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:51.845011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:51.852327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:51.852812 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:51.853605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:51.854042 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:52.057458 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:52.066192 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-59f57c96-2fe1-485e-ac7b-dc9b9441eb62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.224893 Mar 29 03:30:52.066774 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3370/6973] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:51 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:53.083382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:53.083996 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:53.091675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:53.092125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:53.092984 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:53.093423 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:53.291296 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:53.299397 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcb56e43-0a2a-4570-b572-49d8ea8ceb79 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.219689 Mar 29 03:30:53.300566 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3604/6974] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:53 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:54.317503 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:54.318101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:54.325598 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:54.326050 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:54.326826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:54.327240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:54.516420 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:54.524460 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98147f62-55a3-423e-b005-b5f557bb6d55 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.211253 Mar 29 03:30:54.525042 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3371/6975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:54 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:55.541246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:55.541856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:55.549173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:55.549620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:55.550380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:55.550811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:55.741043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:55.749235 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-23d1ab68-b320-4a8a-8b4f-f73654621c00 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.211604 Mar 29 03:30:55.749797 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3605/6976] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:55 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:56.766464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:56.767076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:56.774839 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:56.775287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:56.776045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:56.776481 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:56.969304 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:56.977360 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ebc22c4e-dd45-402b-9b7b-cf9b7251bb58 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.214515 Mar 29 03:30:56.977906 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3372/6977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:56 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:57.994180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:57.994700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:58.002612 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:58.003055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:58.003811 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:58.004461 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:58.200318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:58.208911 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e5553706-3187-4141-92a5-1ab3c4604213 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.218426 Mar 29 03:30:58.209472 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3606/6978] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:57 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:30:59.226441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:30:59.227081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:30:59.234380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:59.234829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:59.235581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:30:59.236018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:30:59.432376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:30:59.440896 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ea2197d8-79ba-447d-88cf-3909c6aff209 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.217633 Mar 29 03:30:59.441439 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3373/6979] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:30:59 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:00.457474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:00.458125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:00.465454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:00.465898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:00.466665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:00.467085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:00.664783 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:00.674526 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68fbbfec-6880-48fb-a7d3-2f4fbc5327e6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.221076 Mar 29 03:31:00.675201 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3607/6980] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:00 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:01.691885 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:01.693798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:01.700123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:01.700581 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:01.701382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:01.701826 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:01.893279 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:01.901817 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8409ac97-af0f-49b0-b052-2ee77e95acca tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.213614 Mar 29 03:31:01.902377 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3374/6981] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:01 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:02.919700 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:02.920300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:02.928133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:02.928572 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:02.929364 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:02.929791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:03.130093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:03.138530 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73ae9b28-bda8-4730-add1-126864e11a94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1695 microversion: 2.1 time: 0.222869 Mar 29 03:31:03.138971 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3608/6982] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:02 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1695 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:04.155196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:04.155814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:04.163033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:04.163483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:04.164261 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:04.164699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:04.365443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:04.373770 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-30c5f13c-4bdd-4d18-a4f9-fd34d5749dae tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1694 microversion: 2.1 time: 0.222193 Mar 29 03:31:04.374554 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3375/6983] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:04 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1694 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:04.387919 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "name": "network-vif-unplugged", "status": "completed", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:04.390054 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:31:04.390054 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:31:04.398347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:04.398527 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:04.415091 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] Creating event network-vif-unplugged:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h1-828148-1 Mar 29 03:31:04.421561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] Instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:31:04.432863 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-8eace86e-27e2-45bc-ba36-2064f9257f83 req-c1eac838-8cb9-46be-989f-a328f18e5468 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048897 Mar 29 03:31:04.433475 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3609/6984] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:31:05.391191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:05.391902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:05.399777 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:05.400231 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:05.401033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:05.401478 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:05.600879 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:05.609595 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1fb91bed-bbd6-47fe-9cbf-85a8e36442c4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1694 microversion: 2.1 time: 0.222121 Mar 29 03:31:05.610176 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3376/6985] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:05 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1694 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:06.447283 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:06.448774 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:31:06.448774 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:31:06.457647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:06.458113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:06.474588 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] Creating event network-changed:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h1-828148-1 Mar 29 03:31:06.480819 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] Instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:31:06.491247 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-23098eb9-cb0d-4613-bcf4-998479961cc6 req-3cc28637-ab15-4f51-a7e4-03802282976f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048769 Mar 29 03:31:06.491821 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3610/6986] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:31:06.628187 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:06.631182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:06.637429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:06.638102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:06.639334 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:06.639966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:06.845084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:06.853313 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20ad1fc5-fc8f-4813-be96-89f2d2cc2e99 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1692 microversion: 2.1 time: 0.229160 Mar 29 03:31:06.853884 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3377/6987] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:06 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:07.871446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:07.872145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:07.879524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:07.879966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:07.880735 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:07.881195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:08.081502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:08.089461 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9e76d738-e8db-48ad-9e7e-728d56a94ef8 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1692 microversion: 2.1 time: 0.222398 Mar 29 03:31:08.090014 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3611/6988] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:07 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1692 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:09.106550 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:09.114096 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:09.115190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:09.115658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:09.116479 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:09.116941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:09.323904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:09.333004 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-302b577b-33bb-4d12-93ef-b87472f04ef5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1692 microversion: 2.1 time: 0.230156 Mar 29 03:31:09.333582 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3378/6989] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:09 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1692 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:10.349775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:10.350387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:10.357688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.358130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:10.358886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.359315 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:10.555134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:10.563088 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8e281e0d-d0f8-4840-95ba-7614c396134b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1689 microversion: 2.1 time: 0.217004 Mar 29 03:31:10.563644 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3612/6990] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:10 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:10.579333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:10.579883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:10.587201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.587662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:10.588432 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.588909 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:10.810412 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-71111d47-8b40-42cc-a1dc-641cfb7fd06f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action" status: 204 len: 0 microversion: 2.1 time: 0.234320 Mar 29 03:31:10.811055 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3379/6991] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:31:10 2022] POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 29 03:31:10.818952 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:10.820385 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:10.828867 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.829580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:10.830520 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:10.831214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:11.077648 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:11.086414 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5d361efb-9d0a-4f7f-9b18-f3c6f87bf16e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1689 microversion: 2.1 time: 0.271139 Mar 29 03:31:11.086987 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3613/6992] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:10 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:11.103616 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:11.104371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:11.112020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:11.112367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:11.113164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:11.113632 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:11.317967 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:11.326722 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-945d0d05-cb71-4c1d-979d-6b90b2255058 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1689 microversion: 2.1 time: 0.227184 Mar 29 03:31:11.327615 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3380/6993] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:11 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1689 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:11.450051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "name": "network-vif-plugged", "status": "completed", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:11.453931 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:31:11.453931 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:31:11.460289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:11.460726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:11.477309 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] Creating event network-vif-plugged:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h1-828148-1 Mar 29 03:31:11.484120 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] Instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-828148-1', 'n-h2-828148-1'} {{(pid=103513) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5607}} Mar 29 03:31:11.495469 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-6df1ba7f-c5cc-4658-ba83-733aa74f6ff9 req-47af07c7-3963-4213-ab5f-b386fad23e99 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097545 Mar 29 03:31:11.496072 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3614/6994] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:31:12.344513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:12.345168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:12.353163 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:12.353620 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:12.354391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:12.354831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:12.556112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:12.564297 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-bd8c6fdc-8a74-4d6c-88d8-50d24996039a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1689 microversion: 2.1 time: 0.223476 Mar 29 03:31:12.564880 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3381/6995] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:12 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:13.581252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:13.581987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:13.589528 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:13.589981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:13.590744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:13.591181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:13.788556 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:13.796921 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dcf83940-5c66-4a76-980e-f429163899b1 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1681 microversion: 2.1 time: 0.219844 Mar 29 03:31:13.797487 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3615/6996] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:13 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:31:40.172345 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:40.173299 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:40.180549 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:40.181063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:40.181837 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:40.182278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:40.266144 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c9bbe796-6c2a-4488-a08e-42a7bd994d48 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action" status: 200 len: 24573 microversion: 2.1 time: 0.097615 Mar 29 03:31:40.266753 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3382/6997] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:31:40 2022] POST /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f/action => generated 24573 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:31:58.363471 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:58.364013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:58.366679 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-db331e74-56a8-4aa8-af4a-9bf9264418c9 req-fc668b9b-450b-481f-b4a7-50cbaee4b533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:31:58.367991 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:31:58.367991 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:31:58.372082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:58.372608 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:58.373522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:58.374011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:58.377193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db331e74-56a8-4aa8-af4a-9bf9264418c9 req-fc668b9b-450b-481f-b4a7-50cbaee4b533 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:58.377649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-db331e74-56a8-4aa8-af4a-9bf9264418c9 req-fc668b9b-450b-481f-b4a7-50cbaee4b533 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:58.396033 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-db331e74-56a8-4aa8-af4a-9bf9264418c9 req-fc668b9b-450b-481f-b4a7-50cbaee4b533 service nova] Creating event network-changed:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h1-828148-1 Mar 29 03:31:58.402396 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-db331e74-56a8-4aa8-af4a-9bf9264418c9 req-fc668b9b-450b-481f-b4a7-50cbaee4b533 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040011 Mar 29 03:31:58.403264 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3383/6998] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:31:58.597499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:31:58.917763 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6b3846aa-362e-49ca-bde8-b9eeb058d760 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 204 len: 0 microversion: 2.1 time: 0.557557 Mar 29 03:31:58.921630 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3616/6999] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:31:58 2022] DELETE /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:31:58.927798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:31:58.928694 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:31:58.936595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:58.937176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:58.938031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:31:58.938589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:31:59.139101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:31:59.148265 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8f0aabb5-90e8-4f75-992e-1de5e103125b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1687 microversion: 2.1 time: 0.224013 Mar 29 03:31:59.149085 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3384/7000] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:31:58 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:00.166715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:00.167429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:00.174618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:00.175058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:00.175807 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:00.176233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:00.499073 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:00.507690 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7adf72b5-858a-4850-935f-92a4ed1dbfdf tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1569 microversion: 2.1 time: 0.345662 Mar 29 03:32:00.508321 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3617/7001] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:00 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1569 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:01.328822 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1a671fa4-9c2e-45b7-ad1b-d13566e8ab77 req-478860c6-ebca-4954-bce0-3cec72d77774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce559904-aac0-4b13-ba3e-4889c2fbaa4f", "name": "network-vif-deleted", "tag": "31c09b99-1e93-405a-ae5d-5d7b4a486fa1"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:01.330330 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:32:01.330330 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:32:01.338940 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1a671fa4-9c2e-45b7-ad1b-d13566e8ab77 req-478860c6-ebca-4954-bce0-3cec72d77774 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:01.340668 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1a671fa4-9c2e-45b7-ad1b-d13566e8ab77 req-478860c6-ebca-4954-bce0-3cec72d77774 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:01.355303 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1a671fa4-9c2e-45b7-ad1b-d13566e8ab77 req-478860c6-ebca-4954-bce0-3cec72d77774 service nova] Creating event network-vif-deleted:31c09b99-1e93-405a-ae5d-5d7b4a486fa1 for instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f on n-h1-828148-1 Mar 29 03:32:01.359975 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1a671fa4-9c2e-45b7-ad1b-d13566e8ab77 req-478860c6-ebca-4954-bce0-3cec72d77774 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034895 Mar 29 03:32:01.360532 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3385/7002] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:32:01.525290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:01.525852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:01.533346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:01.533793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:01.534562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:01.534997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:01.737739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:01.745977 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6ac1a8a5-96cd-4339-9bff-4be076b4e72e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 200 len: 1351 microversion: 2.1 time: 0.224632 Mar 29 03:32:01.746519 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3618/7003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:01 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 1351 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:02.764129 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:02.764889 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: ce559904-aac0-4b13-ba3e-4889c2fbaa4f] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:02.772477 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:02.772976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:02.773756 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:02.774201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:02.823408 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] HTTP exception thrown: Instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f could not be found. Mar 29 03:32:02.824018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Returning 404 to user: Instance ce559904-aac0-4b13-ba3e-4889c2fbaa4f could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:32:02.824858 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-04a4eb16-594a-4c38-a83f-de8c06519e53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f" status: 404 len: 111 microversion: 2.1 time: 0.064884 Mar 29 03:32:02.825417 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3386/7004] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:02 2022] GET /compute/v2.1/servers/ce559904-aac0-4b13-ba3e-4889c2fbaa4f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:32:08.421085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c4127d2e-ffc8-40dd-8644-94e9d9227017 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '.version_select at 0x7f872405a1f0>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:08.507200 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c4127d2e-ffc8-40dd-8644-94e9d9227017 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-675492686" status: 202 len: 0 microversion: 2.1 time: 0.089403 Mar 29 03:32:08.507745 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3619/7005] 10.222.0.36 () {58 vars in 1280 bytes} [Tue Mar 29 03:32:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-675492686 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:32:08.532589 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: .version_select at 0x7f87241dcca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1117064173"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:08.557045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:32:08.562095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:32:08.804028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:32:08.809077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:32:08.823212 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-76c76cf6-7377-4ed5-ac17-8f57eb8ffeb3 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.294326 Mar 29 03:32:08.823795 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3387/7006] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:32:08 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:18.803365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-217312028", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "f82a654d-03f6-49a4-91cc-dea03b845ab0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1117064173", "security_groups": [{"name": "tempest-secgroup-smoke-453609659"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:18.916390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] validate_networks() for [('f82a654d-03f6-49a4-91cc-dea03b845ab0', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:32:19.596261 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:32:19.596692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:32:19.597208 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:32:19.597620 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:32:19.598032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:32:19.606881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:19.607326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:19.608119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:19.608546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:19.626658 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:32:19.632089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:32:19.644376 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:32:19.647494 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:32:19.771874 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-ece944fe-7d37-4204-a160-9c584d18df62 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.972023 Mar 29 03:32:19.772750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3620/7007] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:32:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:32:19.783513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-423e4cfe-c5aa-4e23-9d42-cae627898d15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:19.784136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-423e4cfe-c5aa-4e23-9d42-cae627898d15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:19.874913 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-423e4cfe-c5aa-4e23-9d42-cae627898d15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:19.882279 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-423e4cfe-c5aa-4e23-9d42-cae627898d15 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1266 microversion: 2.1 time: 0.103173 Mar 29 03:32:19.882837 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3388/7008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:19 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:20.898687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:20.899836 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:20.907220 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:20.907667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:20.908438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:20.908893 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:21.027959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:21.036343 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8d787212-eae1-4043-8416-a0129eed1091 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1270 microversion: 2.1 time: 0.141914 Mar 29 03:32:21.037169 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3621/7009] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:20 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1270 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:22.054463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:22.055920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:22.064636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:22.065525 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:22.066530 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:22.067201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:22.210527 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:22.219445 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1e7053db-8fca-45d4-89cd-1a5f030d4e8e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1336 microversion: 2.1 time: 0.169424 Mar 29 03:32:22.220435 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3389/7010] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:22 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1336 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:23.237462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:23.238273 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:23.246758 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:23.247206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:23.247989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:23.248446 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:23.692903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:23.701026 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f5571112-4374-4a33-af08-389c2d0f28e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.467399 Mar 29 03:32:23.701576 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3622/7011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:23 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:24.284552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-725e3980-d6b7-4cad-a2aa-0f8591def7e9 req-19fa4db4-7b3a-4683-ad1e-43684bdd156e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d464c39-301f-456a-9aa8-b2474796ac18", "tag": "1cdc0791-13f8-44e9-91e3-35b2a61ed816"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:24.286148 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:32:24.286148 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:32:24.299601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-725e3980-d6b7-4cad-a2aa-0f8591def7e9 req-19fa4db4-7b3a-4683-ad1e-43684bdd156e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:24.300053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-725e3980-d6b7-4cad-a2aa-0f8591def7e9 req-19fa4db4-7b3a-4683-ad1e-43684bdd156e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:24.316684 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-725e3980-d6b7-4cad-a2aa-0f8591def7e9 req-19fa4db4-7b3a-4683-ad1e-43684bdd156e service nova] Creating event network-changed:1cdc0791-13f8-44e9-91e3-35b2a61ed816 for instance 7d464c39-301f-456a-9aa8-b2474796ac18 on n-h1-828148-1 Mar 29 03:32:24.323293 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-725e3980-d6b7-4cad-a2aa-0f8591def7e9 req-19fa4db4-7b3a-4683-ad1e-43684bdd156e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042467 Mar 29 03:32:24.323900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3390/7012] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:32:24.718290 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:24.718901 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:24.727222 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:24.727674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:24.728441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:24.728895 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:25.087792 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:25.095700 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e8fd4121-53b0-4337-88bf-a56581b596be tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.381083 Mar 29 03:32:25.096249 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3623/7013] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:24 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:26.112910 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:26.113646 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:26.121809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:26.122263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:26.123028 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:26.123468 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:26.392882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:26.401486 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a2fc7fb5-99c1-477b-acda-537c1e78fc89 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.292673 Mar 29 03:32:26.402043 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3391/7014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:26 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:27.417747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:27.418356 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:27.425618 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:27.426058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:27.426804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:27.427742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:27.624669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:27.632868 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-68681b77-e0bc-4611-938d-e4dfde92eb5d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.218775 Mar 29 03:32:27.633674 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3624/7015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:27 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:28.649990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:28.650746 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:28.658445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:28.658902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:28.659672 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:28.660112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:28.861038 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:28.871978 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-889426f1-7d97-42df-aa9f-8475917a6b67 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.226163 Mar 29 03:32:28.872526 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3392/7016] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:28 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:29.888695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:29.889468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:29.896718 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:29.897191 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:29.897955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:29.898387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:29.918091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1e9f7e31-d665-4f20-a3e4-dfc4f6e384ac req-14bf2234-669d-4c1c-99ac-e38438e5db01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d464c39-301f-456a-9aa8-b2474796ac18", "name": "network-vif-plugged", "status": "completed", "tag": "1cdc0791-13f8-44e9-91e3-35b2a61ed816"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:29.919616 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:32:29.919616 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:32:29.928514 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1e9f7e31-d665-4f20-a3e4-dfc4f6e384ac req-14bf2234-669d-4c1c-99ac-e38438e5db01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:29.928980 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1e9f7e31-d665-4f20-a3e4-dfc4f6e384ac req-14bf2234-669d-4c1c-99ac-e38438e5db01 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:30.111390 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1e9f7e31-d665-4f20-a3e4-dfc4f6e384ac req-14bf2234-669d-4c1c-99ac-e38438e5db01 service nova] Creating event network-vif-plugged:1cdc0791-13f8-44e9-91e3-35b2a61ed816 for instance 7d464c39-301f-456a-9aa8-b2474796ac18 on n-h1-828148-1 Mar 29 03:32:30.116776 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1e9f7e31-d665-4f20-a3e4-dfc4f6e384ac req-14bf2234-669d-4c1c-99ac-e38438e5db01 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202703 Mar 29 03:32:30.117066 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:30.117402 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3393/7017] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:32:30.125497 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e66209fc-234c-435a-8840-a68defc2d155 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.240502 Mar 29 03:32:30.126055 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3625/7018] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:29 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:31.142169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:31.142864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:31.150784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:31.151301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:31.152068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:31.152504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:31.346919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:31.354939 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-54f2d9bc-b56d-44d4-b0f3-8c02058d4efd tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1391 microversion: 2.1 time: 0.216777 Mar 29 03:32:31.355485 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3394/7019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:31 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1391 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:32.371736 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:32.372342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:32.379587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:32.380024 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:32.380793 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:32.381239 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:32.576536 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:32.585144 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6fcba91d-f2ae-420f-bb66-7a0e0f5f7628 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1562 microversion: 2.1 time: 0.217091 Mar 29 03:32:32.585702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3626/7020] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:32 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:32.604876 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:32.605495 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:32.612681 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:32.613167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:32.613934 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:32.614371 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:32.809305 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:32.817772 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9cddff17-b715-4bb1-afbc-345dcd3dd59f tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1562 microversion: 2.1 time: 0.216343 Mar 29 03:32:32.818335 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3395/7021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:32 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:32:35.573058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:32:35.573672 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:32:35.575661 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-56139a8b-8a19-48d1-a55c-ef4c64459724 req-ed84911d-e451-45d6-b93d-58069d24e35c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d464c39-301f-456a-9aa8-b2474796ac18", "tag": "1cdc0791-13f8-44e9-91e3-35b2a61ed816"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:32:35.577217 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:32:35.577217 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:32:35.581045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:35.581489 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:35.582447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:35.582874 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:35.587544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-56139a8b-8a19-48d1-a55c-ef4c64459724 req-ed84911d-e451-45d6-b93d-58069d24e35c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:32:35.587991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-56139a8b-8a19-48d1-a55c-ef4c64459724 req-ed84911d-e451-45d6-b93d-58069d24e35c service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:32:35.604243 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-56139a8b-8a19-48d1-a55c-ef4c64459724 req-ed84911d-e451-45d6-b93d-58069d24e35c service nova] Creating event network-changed:1cdc0791-13f8-44e9-91e3-35b2a61ed816 for instance 7d464c39-301f-456a-9aa8-b2474796ac18 on n-h1-828148-1 Mar 29 03:32:35.609169 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-56139a8b-8a19-48d1-a55c-ef4c64459724 req-ed84911d-e451-45d6-b93d-58069d24e35c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037885 Mar 29 03:32:35.610441 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3396/7022] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:32:35.925960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:32:35.934833 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-932a9115-603b-4780-8085-1b8280c0eb11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1562 microversion: 2.1 time: 0.365831 Mar 29 03:32:35.935615 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3627/7023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:32:35 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1562 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:05.294205 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:33:05.295196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:05.302602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:05.303057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:05.303845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:05.304276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:05.388767 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ac341d2-9473-41bd-a0fc-a62da061e864 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action" status: 200 len: 24568 microversion: 2.1 time: 0.099006 Mar 29 03:33:05.389416 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3397/7024] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:33:05 2022] POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action => generated 24568 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:33:12.099939 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:33:12.100509 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:33:35.589951 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:33:35.593323 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1cc9712e-3d04-4734-8cec-aef9bd0d9049 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:33:35.600714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cc9712e-3d04-4734-8cec-aef9bd0d9049 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:35.601765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1cc9712e-3d04-4734-8cec-aef9bd0d9049 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:35.659745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1cc9712e-3d04-4734-8cec-aef9bd0d9049 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Going to try to stop instance {{(pid=103513) force_stop /opt/stack/nova/nova/compute/api.py:2602}} Mar 29 03:33:35.841978 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1cc9712e-3d04-4734-8cec-aef9bd0d9049 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action" status: 202 len: 0 microversion: 2.1 time: 0.253108 Mar 29 03:33:35.842525 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3628/7025] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:33:35 2022] POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:33:35.851292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:35.851998 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:35.859993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:35.865742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:35.865742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:35.865742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:36.107713 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:36.115731 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c4914c3a-aa0e-4486-bb08-c49db22fc46b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.268717 Mar 29 03:33:36.116284 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3398/7026] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:35 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:37.134699 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:37.135400 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:37.143727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:37.144175 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:37.144966 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:37.145399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:37.178571 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60586. Mar 29 03:33:37.384177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:37.392373 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9a1c2e4e-d0f5-455b-becc-89dd9f0dc901 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.262796 Mar 29 03:33:37.392886 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3629/7027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:37 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:38.409521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:38.410133 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:38.418327 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:38.418782 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:38.419543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:38.419978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:38.610453 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:38.618587 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7e6b2da-ce2e-482d-9f93-f1b9b4b08b11 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.212724 Mar 29 03:33:38.622782 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3399/7028] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:38 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:39.635690 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:39.636294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:39.643589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:39.644030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:39.644790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:39.645238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:39.836223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:39.844409 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4f44b06b-2ba4-4e0e-ad44-3ec2f898d1ba tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.212571 Mar 29 03:33:39.844984 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3630/7029] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:39 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:40.861818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:40.862438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:40.870052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:40.870504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:40.871268 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:40.871707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:41.067853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:41.076505 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3c4d9e7f-a893-4fb0-ba5e-cefb9c637581 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.218381 Mar 29 03:33:41.077093 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3400/7030] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:40 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:42.099637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:42.100181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:42.108319 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:42.108765 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:42.109577 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:42.110008 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:42.307909 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:42.316202 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b9d5f20b-7204-4b61-bb3a-a79ce357a2fe tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.220320 Mar 29 03:33:42.316830 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3631/7031] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:42 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:43.333548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:43.334226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:43.341727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:43.342191 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:43.342975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:43.343424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:43.538775 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:43.547313 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d72d001f-f0cd-43f7-83a9-93b5bd0c8766 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.217533 Mar 29 03:33:43.547886 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3401/7032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:43 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:44.564346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:44.565227 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:44.572499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:44.575812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:44.575812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:44.575812 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:44.771212 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:44.779906 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9161cb90-da0c-462e-a586-f51767f225ec tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.219274 Mar 29 03:33:44.780457 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3632/7033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:44 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:45.796932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:45.797553 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:45.805220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:45.805683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:45.806462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:45.806903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:46.011433 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:46.019492 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6ef04a2b-a2ca-45a7-9d64-073f6b3881f4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1691 microversion: 2.1 time: 0.226290 Mar 29 03:33:46.020045 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3402/7034] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:45 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:47.037043 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:47.038912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:47.045500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:47.045953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:47.046716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:47.047151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:47.236624 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:47.245313 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e425d057-e523-4f03-b00f-4b1abc3ac666 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1668 microversion: 2.1 time: 0.212051 Mar 29 03:33:47.245866 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3633/7035] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:47 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:48.379141 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:33:48.380077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:48.383821 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:33:48.388786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:48.389297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:48.390072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:48.390519 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:48.476437 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-99b041e9-14e4-4cba-b871-68bf4ee4ea9d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action" status: 200 len: 38391 microversion: 2.1 time: 0.100364 Mar 29 03:33:48.477075 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3403/7036] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:33:48 2022] POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action => generated 38391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:33:48.488147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e0fb8185-c1f2-4a03-9087-48275b8cf2a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:33:48.496294 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fb8185-c1f2-4a03-9087-48275b8cf2a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:48.496738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e0fb8185-c1f2-4a03-9087-48275b8cf2a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:48.554253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e0fb8185-c1f2-4a03-9087-48275b8cf2a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Going to try to start instance {{(pid=103513) start /opt/stack/nova/nova/compute/api.py:2625}} Mar 29 03:33:48.745011 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e0fb8185-c1f2-4a03-9087-48275b8cf2a0 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action" status: 202 len: 0 microversion: 2.1 time: 0.260305 Mar 29 03:33:48.745631 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3634/7037] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:33:48 2022] POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 29 03:33:48.754700 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:48.755399 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:48.763686 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:48.764138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:48.764981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:48.765424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:48.963673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:48.973184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29ed7c0c-584e-4385-8c7b-cd8a7b78f039 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1677 microversion: 2.1 time: 0.222546 Mar 29 03:33:48.973753 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3404/7038] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:48 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:49.992547 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:49.993284 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:50.000715 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:50.001193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:50.001965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:50.002399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:50.302927 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:50.311139 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-22239535-cefb-4d43-9bd5-7a8c74b4ef53 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1677 microversion: 2.1 time: 0.323367 Mar 29 03:33:50.311759 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3635/7039] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:49 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1677 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:33:51.329388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:33:51.330010 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:33:51.338762 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:51.339221 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:51.339993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:33:51.340437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:33:51.393086 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60624. Mar 29 03:33:51.643594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:33:51.652057 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-82d9a866-7d8b-4f07-b3c3-07d4bc7ad844 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1681 microversion: 2.1 time: 0.326526 Mar 29 03:33:51.652611 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3405/7040] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:33:51 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1681 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:34:21.896373 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:34:21.897408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:21.904739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:21.905221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:21.905990 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:21.906449 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:21.998480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a92596e6-e20c-4961-a179-cd322f8821d7 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action" status: 200 len: 62954 microversion: 2.1 time: 0.105912 Mar 29 03:34:21.999019 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3636/7041] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:34:21 2022] POST /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18/action => generated 62954 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:34:39.781172 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:39.781734 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:39.784094 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f4c785b1-9353-4f56-b908-79ec123414d5 req-24fa7c03-fbf9-42b2-8763-127451719c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d464c39-301f-456a-9aa8-b2474796ac18", "tag": "1cdc0791-13f8-44e9-91e3-35b2a61ed816"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:34:39.785806 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:34:39.785806 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:34:39.789854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:39.790319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:39.791118 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:39.791541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:39.795055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f4c785b1-9353-4f56-b908-79ec123414d5 req-24fa7c03-fbf9-42b2-8763-127451719c34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:39.795565 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f4c785b1-9353-4f56-b908-79ec123414d5 req-24fa7c03-fbf9-42b2-8763-127451719c34 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:39.812181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f4c785b1-9353-4f56-b908-79ec123414d5 req-24fa7c03-fbf9-42b2-8763-127451719c34 service nova] Creating event network-changed:1cdc0791-13f8-44e9-91e3-35b2a61ed816 for instance 7d464c39-301f-456a-9aa8-b2474796ac18 on n-h1-828148-1 Mar 29 03:34:39.818070 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f4c785b1-9353-4f56-b908-79ec123414d5 req-24fa7c03-fbf9-42b2-8763-127451719c34 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037556 Mar 29 03:34:39.818936 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3637/7042] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:34:39.860194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:34:40.194236 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e64f4fda-ae1a-4259-b401-c0a280b53fa9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 204 len: 0 microversion: 2.1 time: 0.416578 Mar 29 03:34:40.194851 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3406/7043] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:34:39 2022] DELETE /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:34:40.203733 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:40.204434 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:40.212695 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:40.213186 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:40.213960 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:40.214393 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:40.771058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:34:40.780026 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c14ebd98-160e-456f-8c60-de2fe7756aea tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1687 microversion: 2.1 time: 0.580423 Mar 29 03:34:40.780677 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3638/7044] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:34:40 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1687 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:34:41.798174 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:41.798903 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:41.807035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:41.807492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:41.808265 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:41.808702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:42.006955 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:34:42.015230 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-14bf5ad2-5dfc-4976-894d-2fedcad0c4ac tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1568 microversion: 2.1 time: 0.221193 Mar 29 03:34:42.015797 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3407/7045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:34:41 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:34:42.600056 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-24301a21-cd06-468f-b9c7-ea713fcad120 req-5dbcb091-5553-40d7-8eeb-22b05eb3a66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d464c39-301f-456a-9aa8-b2474796ac18", "name": "network-vif-deleted", "tag": "1cdc0791-13f8-44e9-91e3-35b2a61ed816"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:34:42.601658 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:34:42.601658 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:34:42.610465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-24301a21-cd06-468f-b9c7-ea713fcad120 req-5dbcb091-5553-40d7-8eeb-22b05eb3a66b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:42.610999 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-24301a21-cd06-468f-b9c7-ea713fcad120 req-5dbcb091-5553-40d7-8eeb-22b05eb3a66b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:42.627050 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-24301a21-cd06-468f-b9c7-ea713fcad120 req-5dbcb091-5553-40d7-8eeb-22b05eb3a66b service nova] Creating event network-vif-deleted:1cdc0791-13f8-44e9-91e3-35b2a61ed816 for instance 7d464c39-301f-456a-9aa8-b2474796ac18 on n-h1-828148-1 Mar 29 03:34:42.632739 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-24301a21-cd06-468f-b9c7-ea713fcad120 req-5dbcb091-5553-40d7-8eeb-22b05eb3a66b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Mar 29 03:34:42.633999 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3639/7046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:34:43.032594 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:43.033232 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:43.040430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:43.040920 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:43.041687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:43.042128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:43.116467 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:43.116943 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:43.117429 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lazy-loading 'fault' on Instance uuid 7d464c39-301f-456a-9aa8-b2474796ac18 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:34:43.173802 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:34:43.182586 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fa6f2e8a-5fb0-44d1-a0ed-67f5e7b50109 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 200 len: 1356 microversion: 2.1 time: 0.153688 Mar 29 03:34:43.183142 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3408/7047] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:34:43 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:34:44.200351 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:44.201083 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7d464c39-301f-456a-9aa8-b2474796ac18] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:34:44.209506 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:44.209981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:44.210761 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:34:44.211219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:34:44.259793 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] HTTP exception thrown: Instance 7d464c39-301f-456a-9aa8-b2474796ac18 could not be found. Mar 29 03:34:44.260285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Returning 404 to user: Instance 7d464c39-301f-456a-9aa8-b2474796ac18 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:34:44.261107 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-94ffc2cb-113d-48cc-b340-9f1b45992a77 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18" status: 404 len: 111 microversion: 2.1 time: 0.064894 Mar 29 03:34:44.261625 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3640/7048] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:34:44 2022] GET /compute/v2.1/servers/7d464c39-301f-456a-9aa8-b2474796ac18 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:34:49.630825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce1dacd5-fbf3-4a27-8c94-b5c0c62ce853 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '.version_select at 0x7f872443fa60>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:34:49.697998 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce1dacd5-fbf3-4a27-8c94-b5c0c62ce853 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117064173" status: 202 len: 0 microversion: 2.1 time: 0.071511 Mar 29 03:34:49.698562 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3409/7049] 10.222.0.36 () {58 vars in 1283 bytes} [Tue Mar 29 03:34:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1117064173 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:34:49.728025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: .version_select at 0x7f8724caf310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-983131781"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:34:49.750183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:34:49.755837 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:34:49.768435 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [041e4ede-e058-4112-8064-8ca9eae076f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:34:49.776714 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:34:49.776902 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:34:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.36) !!! Mar 29 03:34:50.775692 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [041e4ede-e058-4112-8064-8ca9eae076f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 60694. Mar 29 03:34:50.967015 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:34:50.972034 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:34:50.986645 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1f27c2c0-2003-4dd1-928d-c4aac14f3a78 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 1.262275 Mar 29 03:34:50.987236 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3641/7050] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:34:49 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:01.229747 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-489098549", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "networks": [{"uuid": "456d253e-9bd9-499d-9ec4-5a60de3290a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-983131781", "security_groups": [{"name": "tempest-secgroup-smoke-904457281"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:01.441547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] validate_networks() for [('456d253e-9bd9-499d-9ec4-5a60de3290a0', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:35:02.310825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:02.329052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:02.347824 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:35:02.353807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Getting quotas for user 10c8b14b36ac47d69b60a7fae45e8965 and project 672542bce07c4b6f8716447d0a4c0a24. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:35:02.367382 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:35:02.370033 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:35:02.495275 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6468ce6c-b0e7-4936-bd8e-d8d6e246e34e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.269228 Mar 29 03:35:02.498393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3410/7051] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:35:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1273 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:35:02.508936 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d3e1688b-2ef4-47b6-9ee1-23b3482329e5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:02.510490 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d3e1688b-2ef4-47b6-9ee1-23b3482329e5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:02.623226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d3e1688b-2ef4-47b6-9ee1-23b3482329e5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:02.637696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d3e1688b-2ef4-47b6-9ee1-23b3482329e5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1265 microversion: 2.1 time: 0.134843 Mar 29 03:35:02.639484 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3642/7052] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:02 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:03.655851 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:03.656757 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:03.665404 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:03.665995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:03.667061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:03.667500 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:03.796045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:03.804979 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7f22ec45-48b9-404c-84ae-b7d3cbb827ed tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1269 microversion: 2.1 time: 0.152953 Mar 29 03:35:03.805548 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3411/7053] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:03 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:04.822237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:04.822843 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:04.830195 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:04.830644 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:04.831477 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:04.831908 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:04.955303 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:04.964183 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9b40594b-c625-4c8c-b2e0-3528ecd8f4eb tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1323 microversion: 2.1 time: 0.145933 Mar 29 03:35:04.964755 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3643/7054] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:04 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1323 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:05.981883 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:05.983138 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:05.993568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:05.994728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:05.996749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:05.997770 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:06.222403 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:06.230672 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-67758acb-1562-47f9-a205-2378f9e79c73 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.252912 Mar 29 03:35:06.231266 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3412/7055] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:05 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:06.804708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9e324f26-b4f8-4a69-828e-b30eb66a8082 req-92ae7224-c79b-402e-b25c-c20ba795c3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc5d059-d350-441d-bd4c-c814b4c56ba3", "tag": "152e9252-f737-479f-803b-5a07777e5840"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:06.806571 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:35:06.806571 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:35:06.814986 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e324f26-b4f8-4a69-828e-b30eb66a8082 req-92ae7224-c79b-402e-b25c-c20ba795c3b4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:06.816128 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e324f26-b4f8-4a69-828e-b30eb66a8082 req-92ae7224-c79b-402e-b25c-c20ba795c3b4 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:06.831983 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9e324f26-b4f8-4a69-828e-b30eb66a8082 req-92ae7224-c79b-402e-b25c-c20ba795c3b4 service nova] Creating event network-changed:152e9252-f737-479f-803b-5a07777e5840 for instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 on n-h2-828148-1 Mar 29 03:35:06.837620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9e324f26-b4f8-4a69-828e-b30eb66a8082 req-92ae7224-c79b-402e-b25c-c20ba795c3b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Mar 29 03:35:06.838213 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3644/7056] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:35:07.247942 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:07.248593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:07.256337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:07.256788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:07.257593 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:07.258032 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:07.460407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:07.468610 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-29c7c0b1-ba6d-45c3-a670-98ed63816789 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.224944 Mar 29 03:35:07.469136 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3413/7057] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:07 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:08.486182 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:08.486879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:08.495029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:08.495474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:08.496231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:08.496663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:08.872687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:08.880792 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-54fa564b-39e3-4c69-b508-b4ca76db9326 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.398685 Mar 29 03:35:08.881377 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3645/7058] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:08 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:09.897480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:09.898128 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:09.905958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:09.906416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:09.907190 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:09.907635 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:10.103437 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:10.111510 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ad850329-b54d-4221-af4d-f0c2f27a0031 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.217760 Mar 29 03:35:10.112064 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3414/7059] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:09 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:11.128342 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:11.129119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:11.137192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:11.137641 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:11.138409 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:11.138840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:11.336550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:11.344761 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9af70d6a-d84d-470d-9c0c-a225de4280a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.220239 Mar 29 03:35:11.345348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3646/7060] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:11 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:12.361460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:12.362081 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:12.369471 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:12.369936 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:12.370722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:12.371169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:12.563981 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:12.572560 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c96f242e-f6e4-478c-aa0e-ec26071a041a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.214781 Mar 29 03:35:12.573151 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3415/7061] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:12 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:13.105344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e042fdc9-eb2b-44ea-833e-f39a6bacbc3b req-b39fb680-65ce-4d6f-9f8f-2ebccd44cf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc5d059-d350-441d-bd4c-c814b4c56ba3", "name": "network-vif-plugged", "status": "completed", "tag": "152e9252-f737-479f-803b-5a07777e5840"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:13.106933 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:35:13.106933 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:35:13.116060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e042fdc9-eb2b-44ea-833e-f39a6bacbc3b req-b39fb680-65ce-4d6f-9f8f-2ebccd44cf44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:13.116495 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e042fdc9-eb2b-44ea-833e-f39a6bacbc3b req-b39fb680-65ce-4d6f-9f8f-2ebccd44cf44 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:13.131650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e042fdc9-eb2b-44ea-833e-f39a6bacbc3b req-b39fb680-65ce-4d6f-9f8f-2ebccd44cf44 service nova] Creating event network-vif-plugged:152e9252-f737-479f-803b-5a07777e5840 for instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 on n-h2-828148-1 Mar 29 03:35:13.136819 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e042fdc9-eb2b-44ea-833e-f39a6bacbc3b req-b39fb680-65ce-4d6f-9f8f-2ebccd44cf44 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034692 Mar 29 03:35:13.136976 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3647/7062] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:35:13.589605 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:13.590235 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:13.597578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:13.598035 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:13.598987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:13.599974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:13.797714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:13.806255 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2e37cf9d-91a2-4589-93a2-053087d2629b tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1390 microversion: 2.1 time: 0.220367 Mar 29 03:35:13.806808 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3416/7063] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:13 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:14.823103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:14.823795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:14.831215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:14.831655 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:14.832405 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:14.832860 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:15.029786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:15.038502 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f9c41479-f779-478d-81b8-c18b72822b94 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1560 microversion: 2.1 time: 0.219500 Mar 29 03:35:15.039053 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3648/7064] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:14 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:15.054492 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:15.055104 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:15.062543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:15.062995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:15.063751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:15.064183 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:15.253587 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:15.261659 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f49ac092-9846-4fee-baeb-c6541f60e8c6 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1560 microversion: 2.1 time: 0.210786 Mar 29 03:35:15.262212 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3417/7065] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:15 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:18.050275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:18.050886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:18.059049 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:18.059499 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:18.060272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:18.060905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:18.110451 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8b5eb5ff-557f-43b2-8095-ac95ea51c066 req-a71cf729-dab2-4a5c-9748-0860e0347c9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc5d059-d350-441d-bd4c-c814b4c56ba3", "tag": "152e9252-f737-479f-803b-5a07777e5840"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:18.112241 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:35:18.112241 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:35:18.121316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8b5eb5ff-557f-43b2-8095-ac95ea51c066 req-a71cf729-dab2-4a5c-9748-0860e0347c9d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:18.122610 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8b5eb5ff-557f-43b2-8095-ac95ea51c066 req-a71cf729-dab2-4a5c-9748-0860e0347c9d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:18.140806 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8b5eb5ff-557f-43b2-8095-ac95ea51c066 req-a71cf729-dab2-4a5c-9748-0860e0347c9d service nova] Creating event network-changed:152e9252-f737-479f-803b-5a07777e5840 for instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 on n-h2-828148-1 Mar 29 03:35:18.146013 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8b5eb5ff-557f-43b2-8095-ac95ea51c066 req-a71cf729-dab2-4a5c-9748-0860e0347c9d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095034 Mar 29 03:35:18.146784 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3418/7066] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:35:18.421107 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:18.430501 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b2015fb0-b57b-4015-bafe-a90b3ff4829e tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1560 microversion: 2.1 time: 0.384041 Mar 29 03:35:18.431301 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3649/7067] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:18 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:37.784194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:37.785238 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:37.792924 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:37.793384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:37.794156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:37.794603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:37.880132 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09ff8971-4da0-4885-ba3f-ec22c06953e9 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action" status: 200 len: 24572 microversion: 2.1 time: 0.100532 Mar 29 03:35:37.880741 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3419/7068] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:35:37 2022] POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action => generated 24572 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:35:49.123778 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:49.124317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:49.132233 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:49.139684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:49.139684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:49.139684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:49.193021 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lazy-loading 'flavor' on Instance uuid 7dc5d059-d350-441d-bd4c-c814b4c56ba3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:35:49.493966 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1920187-3adc-411d-8995-531b4b254884 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action" status: 202 len: 0 microversion: 2.1 time: 0.602802 Mar 29 03:35:49.494496 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3650/7069] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:35:48 2022] POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:35:49.503060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:49.503761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:49.511337 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:49.511788 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:49.512551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:49.513018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:49.712784 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:49.719311 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9d132ad0-7400-4035-8e9e-34ba3a9a38a2 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1687 microversion: 2.1 time: 0.220332 Mar 29 03:35:49.719874 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3420/7070] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:49 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1687 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:50.737267 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:50.737957 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:50.745921 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:50.749726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:50.749726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:50.749726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:50.941858 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:50.950507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-04b3cecc-e37a-4b3e-9071-5228b24cd43a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1670 microversion: 2.1 time: 0.217461 Mar 29 03:35:50.951060 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3651/7071] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:50 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1670 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:52.084830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:52.085825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:52.093476 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.093929 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.094688 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.095124 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.176457 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5958a986-0373-4194-8913-92120461c8f5 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action" status: 200 len: 38430 microversion: 2.1 time: 0.095324 Mar 29 03:35:52.177397 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3421/7072] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:35:52 2022] POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action => generated 38430 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:35:52.188786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:52.189354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:52.197595 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.198011 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.198779 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.199214 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.459891 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-53d40492-9e57-4935-bfcf-3ced84d35694 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action" status: 202 len: 0 microversion: 2.1 time: 0.274767 Mar 29 03:35:52.460484 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3652/7073] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:35:52 2022] POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:35:52.469224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:52.469927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:52.478253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.478711 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.479486 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:52.479927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:52.686783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:52.695340 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0a7dd302-cef6-459e-8850-5b8986e3aa36 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1676 microversion: 2.1 time: 0.230235 Mar 29 03:35:52.696489 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3422/7074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:52 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:53.714523 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:53.715226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:53.722801 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:53.723245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:53.724009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:53.724441 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:53.919742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:53.927953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4af251d9-0aad-4042-b998-e736e196045a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1676 microversion: 2.1 time: 0.218146 Mar 29 03:35:53.928514 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3653/7075] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:53 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:54.945512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:54.946075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:54.953670 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:54.954125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:54.954886 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:54.955321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:55.148475 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:55.157014 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6c6f714a-d4e1-455b-a88f-a09eba490114 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1679 microversion: 2.1 time: 0.215270 Mar 29 03:35:55.157576 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3423/7076] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:54 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:55.293543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:55.294466 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:55.301731 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:55.302178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:55.302940 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:55.303370 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:55.376314 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-17bd9a92-8bb1-4c2f-9261-d10e3466e759 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action" status: 200 len: 38430 microversion: 2.1 time: 0.086982 Mar 29 03:35:55.376955 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3654/7077] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:35:55 2022] POST /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3/action => generated 38430 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 29 03:35:57.159608 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:57.160127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:57.162158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-65ad5c5b-6afb-422f-803d-85c2b2fd79fe req-3b00acce-6474-49c6-9c23-11d422d00b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dc5d059-d350-441d-bd4c-c814b4c56ba3", "tag": "152e9252-f737-479f-803b-5a07777e5840"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:35:57.163629 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:35:57.163629 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:35:57.168511 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:57.168994 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:57.169815 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:57.170392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:57.173883 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-65ad5c5b-6afb-422f-803d-85c2b2fd79fe req-3b00acce-6474-49c6-9c23-11d422d00b33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:57.174457 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-65ad5c5b-6afb-422f-803d-85c2b2fd79fe req-3b00acce-6474-49c6-9c23-11d422d00b33 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:57.196558 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-65ad5c5b-6afb-422f-803d-85c2b2fd79fe req-3b00acce-6474-49c6-9c23-11d422d00b33 service nova] Creating event network-changed:152e9252-f737-479f-803b-5a07777e5840 for instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 on n-h2-828148-1 Mar 29 03:35:57.201545 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-65ad5c5b-6afb-422f-803d-85c2b2fd79fe req-3b00acce-6474-49c6-9c23-11d422d00b33 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043386 Mar 29 03:35:57.202322 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3655/7078] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:35:57.232938 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:35:57.536360 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-83d678ed-1650-42ff-900b-1aff2d2afd3a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 204 len: 0 microversion: 2.1 time: 0.380189 Mar 29 03:35:57.537179 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3424/7079] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:35:57 2022] DELETE /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:35:57.546131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:57.551004 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:57.555304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:57.555970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:57.557161 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:57.557653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:57.877254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:57.886388 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-87840dce-5758-49f5-af81-8ea984d3e970 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1685 microversion: 2.1 time: 0.344249 Mar 29 03:35:57.887193 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3656/7080] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:57 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1685 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:35:58.905814 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:35:58.906539 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:35:58.913691 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:58.914779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:58.915543 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:35:58.915978 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:35:59.196512 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:35:59.205522 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a7b3fb83-f11b-4642-a839-87262cf33af4 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1566 microversion: 2.1 time: 0.303860 Mar 29 03:35:59.206316 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3425/7081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:35:58 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1566 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:00.190825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-881a45c7-64af-4553-99d5-25d5b7038c31 req-5be0954d-7c66-4f68-beac-1a89c069e837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dc5d059-d350-441d-bd4c-c814b4c56ba3", "name": "network-vif-deleted", "tag": "152e9252-f737-479f-803b-5a07777e5840"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:00.196011 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:36:00.196011 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:36:00.200959 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-881a45c7-64af-4553-99d5-25d5b7038c31 req-5be0954d-7c66-4f68-beac-1a89c069e837 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:00.201399 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-881a45c7-64af-4553-99d5-25d5b7038c31 req-5be0954d-7c66-4f68-beac-1a89c069e837 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:00.217851 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-881a45c7-64af-4553-99d5-25d5b7038c31 req-5be0954d-7c66-4f68-beac-1a89c069e837 service nova] Creating event network-vif-deleted:152e9252-f737-479f-803b-5a07777e5840 for instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 on n-h2-828148-1 Mar 29 03:36:00.222154 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-881a45c7-64af-4553-99d5-25d5b7038c31 req-5be0954d-7c66-4f68-beac-1a89c069e837 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145864 Mar 29 03:36:00.222739 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3657/7082] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:36:00.223149 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:00.223843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:00.231897 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:00.232290 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:00.233099 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:00.233546 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:00.350614 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c8b14b36ac47d69b60a7fae45e8965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672542bce07c4b6f8716447d0a4c0a24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:00.359526 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-47e46fd4-aa92-4595-8d62-e90a73fb5872 tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 200 len: 1499 microversion: 2.1 time: 0.140359 Mar 29 03:36:00.360682 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3426/7083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:00 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 1499 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:36:01.377610 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:01.378316 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] [instance: 7dc5d059-d350-441d-bd4c-c814b4c56ba3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:01.386369 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:01.386826 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:01.387592 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:01.388030 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:01.436148 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] HTTP exception thrown: Instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 could not be found. Mar 29 03:36:01.436744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Returning 404 to user: Instance 7dc5d059-d350-441d-bd4c-c814b4c56ba3 could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:36:01.437577 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc82a039-95b8-40cd-8ce9-18adaf55a96d tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3" status: 404 len: 111 microversion: 2.1 time: 0.064179 Mar 29 03:36:01.438107 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3658/7084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:01 2022] GET /compute/v2.1/servers/7dc5d059-d350-441d-bd4c-c814b4c56ba3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:36:07.074297 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-191ba819-f111-4ddf-9f7b-54c716e50c1a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] Calling method '.version_select at 0x7f8725e6aee0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:07.153569 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-191ba819-f111-4ddf-9f7b-54c716e50c1a tempest-TestNetworkAdvancedServerOps-813645121 tempest-TestNetworkAdvancedServerOps-813645121-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983131781" status: 202 len: 0 microversion: 2.1 time: 0.083518 Mar 29 03:36:07.154126 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3427/7085] 10.222.0.36 () {58 vars in 1280 bytes} [Tue Mar 29 03:36:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-983131781 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:36:25.492638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'create', calling method: .version_select at 0x7f8724b2adc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-715354873"}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:25.513816 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:36:25.518861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:36:25.833821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:36:25.839382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:36:25.854319 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-023117c4-0e47-4b1e-949b-bf514f15afbb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.536393 Mar 29 03:36:25.854912 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3659/7086] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:36:25 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:28.251755 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1398314112", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-715354873", "security_groups": [{"name": "tempest-secgroup-smoke-1616198255"}], "networks": [{"uuid": "03656f73-8f91-46a0-b446-ba937ffdd87d"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:28.469706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] validate_networks() for [('03656f73-8f91-46a0-b446-ba937ffdd87d', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:36:29.031774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:36:29.032207 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:36:29.032799 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:36:29.033253 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:36:29.033698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:36:29.042615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:29.043056 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:29.043841 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:29.044270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:29.061219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:36:29.066319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:36:29.077737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:36:29.079989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:36:29.217124 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2f4cd48-1421-4445-be2f-e1c35f6e7061 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.969553 Mar 29 03:36:29.217766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3428/7087] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:36:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:36:29.227380 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fd1144bf-ffd8-41bd-a660-c2c42b3adcd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:29.227975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fd1144bf-ffd8-41bd-a660-c2c42b3adcd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:29.378081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fd1144bf-ffd8-41bd-a660-c2c42b3adcd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:29.386136 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fd1144bf-ffd8-41bd-a660-c2c42b3adcd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1246 microversion: 2.1 time: 0.162467 Mar 29 03:36:29.386687 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3660/7088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:29 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1246 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:30.403975 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:30.404588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:30.411986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:30.412372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:30.413162 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:30.414287 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:30.530248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:30.539216 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af0b9590-1357-4252-971b-32cdfc42750b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1242 microversion: 2.1 time: 0.138599 Mar 29 03:36:30.539930 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3429/7089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:30 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:31.557018 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:31.557631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:31.565881 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:31.566326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:31.567092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:31.567524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:31.695177 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:31.703426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-73a6150f-2066-481e-8faf-d93a4f680635 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1304 microversion: 2.1 time: 0.150673 Mar 29 03:36:31.706889 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3661/7090] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:31 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:32.720738 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:32.721445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:32.728714 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:32.729196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:32.729960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:32.730400 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:32.929987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:32.938651 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-56c229e4-ee45-4087-afbe-422d0d316901 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.221464 Mar 29 03:36:32.939137 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3430/7091] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:32 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:33.428725 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-3d7ad31d-84d5-4022-9b39-99f6da5dacf4 req-4762b99d-a357-4857-a0d5-2193a7c9468f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:33.430372 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:36:33.430372 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:36:33.445840 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d7ad31d-84d5-4022-9b39-99f6da5dacf4 req-4762b99d-a357-4857-a0d5-2193a7c9468f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:33.446180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-3d7ad31d-84d5-4022-9b39-99f6da5dacf4 req-4762b99d-a357-4857-a0d5-2193a7c9468f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:33.464570 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-3d7ad31d-84d5-4022-9b39-99f6da5dacf4 req-4762b99d-a357-4857-a0d5-2193a7c9468f service nova] Creating event network-changed:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h1-828148-1 Mar 29 03:36:33.471537 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-3d7ad31d-84d5-4022-9b39-99f6da5dacf4 req-4762b99d-a357-4857-a0d5-2193a7c9468f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046356 Mar 29 03:36:33.476664 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3662/7092] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:36:33.955281 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:33.955899 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:33.964202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:33.964695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:33.965513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:33.965951 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:34.269735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:34.277780 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5615d19d-64a1-4893-a5e7-7f7424c7736f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.326184 Mar 29 03:36:34.278354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3431/7093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:33 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:35.295440 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:35.296140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:35.303775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:35.304886 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:35.305651 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:35.306084 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:35.588964 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:35.596943 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c9b54c0-48b5-4818-aaa3-03883ffa7236 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.305581 Mar 29 03:36:35.597507 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3663/7094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:35 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:36.614263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:36.614872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:36.629077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:36.629077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:36.629077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:36.629077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:36.820116 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:36.828157 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-07b27c52-f764-46e0-b8df-8ec453c94442 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.217631 Mar 29 03:36:36.828726 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3432/7095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:36 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:37.844791 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:37.845420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:37.848715 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:36:37.853726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:37.854165 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:37.854918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:37.855374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:38.048344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:38.056983 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-51dbd9d6-418a-496f-8c1c-718acbe989ee tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.215851 Mar 29 03:36:38.057534 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3664/7096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:37 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:39.074397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:39.075049 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:39.082396 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:39.082853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:39.083622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:39.084060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:39.277845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:39.285834 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-545c3668-a5e8-46e0-afff-43306e87c2cb tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.215235 Mar 29 03:36:39.286394 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3433/7097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:39 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:40.302333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:40.302944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:40.315277 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:40.315753 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:40.316519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:40.316981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:40.317726 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 32854. Mar 29 03:36:40.517550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:40.526719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c2b47d6b-eb78-47c0-b7e9-ce68d837fb6e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.228029 Mar 29 03:36:40.527273 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3665/7098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:40 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:36:40.925662 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a9be1489-b452-449e-86a4-6fa131152cfe req-2284a9dd-1094-4416-b619-05c16ee15ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "name": "network-vif-plugged", "status": "completed", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:40.927269 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:36:40.927269 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:36:40.936552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a9be1489-b452-449e-86a4-6fa131152cfe req-2284a9dd-1094-4416-b619-05c16ee15ab7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:40.937037 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a9be1489-b452-449e-86a4-6fa131152cfe req-2284a9dd-1094-4416-b619-05c16ee15ab7 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:40.953570 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a9be1489-b452-449e-86a4-6fa131152cfe req-2284a9dd-1094-4416-b619-05c16ee15ab7 service nova] Creating event network-vif-plugged:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h1-828148-1 Mar 29 03:36:40.958441 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a9be1489-b452-449e-86a4-6fa131152cfe req-2284a9dd-1094-4416-b619-05c16ee15ab7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090218 Mar 29 03:36:40.959022 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3434/7099] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:36:41.544694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:41.545260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:41.552091 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:41.552529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:41.553321 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:41.553789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:41.749184 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:41.757367 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2aba3c2d-6492-48ef-9aff-7bdf4cd95182 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1372 microversion: 2.1 time: 0.217100 Mar 29 03:36:41.757932 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3666/7100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:41 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:42.774737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:42.775461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:42.783025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:42.783522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:42.784284 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:42.784726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:42.981470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:42.989621 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-52cb987e-eba3-44f7-a33b-66b1f6e2f430 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1557 microversion: 2.1 time: 0.219157 Mar 29 03:36:42.990179 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3435/7101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:42 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:43.005363 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:36:43.005981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:36:43.013144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:43.013596 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:43.014361 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:43.014817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:43.206889 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:36:43.215687 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5830f4a7-b2df-48d3-8e53-25f718988c2c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1557 microversion: 2.1 time: 0.213965 Mar 29 03:36:43.216241 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3667/7102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:36:43 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:36:46.106702 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1ebf74a2-09dc-4056-9e9c-1d4c4f6e130e req-1877a102-9014-453d-afed-7bf517a007e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:36:46.108223 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:36:46.108223 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:36:46.117136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ebf74a2-09dc-4056-9e9c-1d4c4f6e130e req-1877a102-9014-453d-afed-7bf517a007e1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:36:46.117578 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1ebf74a2-09dc-4056-9e9c-1d4c4f6e130e req-1877a102-9014-453d-afed-7bf517a007e1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:36:46.134842 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1ebf74a2-09dc-4056-9e9c-1d4c4f6e130e req-1877a102-9014-453d-afed-7bf517a007e1 service nova] Creating event network-changed:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h1-828148-1 Mar 29 03:36:46.140210 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1ebf74a2-09dc-4056-9e9c-1d4c4f6e130e req-1877a102-9014-453d-afed-7bf517a007e1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036990 Mar 29 03:36:46.140877 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3436/7103] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:38:09.786174 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:38:09.786636 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:38:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:39:11.126443 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:39:11.130148 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:39:11.130687 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:11.137967 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:11.138412 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:11.139168 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:11.139601 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:11.198806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lazy-loading 'flavor' on Instance uuid 17325c7d-6c00-442c-921f-ea622c4b005a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:39:12.110480 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2999bc25-b6d6-4a72-b87c-b590766c9b14 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a/action" status: 202 len: 0 microversion: 2.1 time: 0.985253 Mar 29 03:39:12.111997 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3668/7104] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:39:11 2022] POST /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a/action => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:39:12.117840 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:39:12.118579 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:39:12.122194 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:12.122906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:12.130409 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:12.130864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:12.131636 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:12.132107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:12.381461 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:12.389637 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-10929874-e73a-463b-a04c-95588ca5814b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.273405 Mar 29 03:39:12.390196 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3437/7105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:12 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:13.409217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:13.409912 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:13.421401 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:13.421847 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:13.422617 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:13.423050 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:13.460967 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 32956. Mar 29 03:39:13.627897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:13.636213 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9d44f90a-b9b7-47ed-a1bd-b8781b3b6cd3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.231887 Mar 29 03:39:13.636766 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3669/7106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:13 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:14.653925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:14.654544 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:14.673110 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:14.673573 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:14.674353 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:14.674797 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:14.675433 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 32962. Mar 29 03:39:14.700071 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 32960. Mar 29 03:39:14.869220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:14.877242 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-af5dcbec-55d9-4be2-93d3-9fd3d49409c5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.227008 Mar 29 03:39:14.878293 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3438/7107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:14 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:15.894638 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:15.895253 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:15.902635 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:15.903080 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:15.903838 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:15.904272 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:16.098593 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:16.106719 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-19cdda49-70fc-4da3-bc09-fb1b5e6e0aa3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.215872 Mar 29 03:39:16.107274 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3670/7108] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:15 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:17.122848 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:17.123463 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:17.131270 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:17.131719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:17.132485 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:17.132966 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:17.325904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:17.334737 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-13134b24-ba5a-4bed-9f77-62fead6aefc9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.215539 Mar 29 03:39:17.335718 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3439/7109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:17 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:18.350871 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:18.351481 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:18.358855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:18.359309 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:18.360112 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:18.360560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:18.552187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:18.560951 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4b2d5531-ec80-4718-8f11-5b150957c989 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.213771 Mar 29 03:39:18.561507 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3671/7110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:18 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:19.578166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:19.578776 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:19.586575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:19.587025 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:19.587787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:19.588223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:19.786571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:19.794646 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8b24f6c0-ff82-4ce9-81be-9da29156d867 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.220232 Mar 29 03:39:19.795196 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3440/7111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:19 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:39:20.812382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:20.813047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:20.820827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:20.821297 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:20.822058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:20.822492 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:21.017374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:21.026148 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5158a6f9-b750-4b21-a01e-fac2239271a0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.217399 Mar 29 03:39:21.026713 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3672/7112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:20 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:22.042248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:22.042865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:22.050117 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:22.050575 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:22.051343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:22.051785 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:22.243472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:22.251590 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ce98951a-a80f-4f54-9a82-5a5653d1488a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.212995 Mar 29 03:39:22.252147 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3441/7113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:22 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:23.268333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:23.268953 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:23.276429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:23.276935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:23.277711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:23.278141 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:23.478566 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:23.486790 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b1b25690-bf8b-42fe-b687-5654cf01e1a1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1682 microversion: 2.1 time: 0.222207 Mar 29 03:39:23.487376 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3673/7114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:23 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1682 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:24.503621 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:24.504245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:24.511506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:24.511971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:24.512749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:24.513295 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:24.710787 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:24.718791 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-37908684-0a67-4fd5-92fa-6fc4a17d093d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1703 microversion: 2.1 time: 0.219020 Mar 29 03:39:24.719365 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3442/7115] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:24 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1703 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:25.735803 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:25.736975 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:25.744221 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:25.744662 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:25.745462 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:25.745891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:25.940171 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:25.948287 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e3948e28-0217-4848-a8ef-70f29ef78666 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1703 microversion: 2.1 time: 0.216413 Mar 29 03:39:25.948852 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3674/7116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:25 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1703 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:26.965319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:26.965864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:26.973779 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:26.974246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:26.975065 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:26.975515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:27.167454 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:27.175984 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a75770b6-07c8-4bdc-879d-80c573af49b5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1703 microversion: 2.1 time: 0.214426 Mar 29 03:39:27.176535 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3443/7117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:26 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1703 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:27.641711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-d6ca8eda-9d87-4e45-b5e7-5877ac61e5c8 req-a68f61c3-802d-4a09-933e-a6c013687d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "name": "network-vif-plugged", "status": "completed", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:39:27.643938 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:39:27.643938 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:39:27.652250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d6ca8eda-9d87-4e45-b5e7-5877ac61e5c8 req-a68f61c3-802d-4a09-933e-a6c013687d72 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:27.652712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-d6ca8eda-9d87-4e45-b5e7-5877ac61e5c8 req-a68f61c3-802d-4a09-933e-a6c013687d72 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:27.668260 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-d6ca8eda-9d87-4e45-b5e7-5877ac61e5c8 req-a68f61c3-802d-4a09-933e-a6c013687d72 service nova] Creating event network-vif-plugged:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h1-828148-1 Mar 29 03:39:27.677316 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-d6ca8eda-9d87-4e45-b5e7-5877ac61e5c8 req-a68f61c3-802d-4a09-933e-a6c013687d72 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035458 Mar 29 03:39:27.677316 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3675/7118] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:39:28.193348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:28.193961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:28.201166 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:28.201618 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:28.202394 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:28.202819 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:28.408576 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:28.416899 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-dc0bb4f1-2436-4f82-aad3-9e0982d04f84 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.227327 Mar 29 03:39:28.417472 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3444/7119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:28 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:29.435821 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:29.436522 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:29.445678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:29.446421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:29.447230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:29.447665 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:29.656563 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:29.666531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-312128a5-93f8-4c36-8362-5a6ca3c9654b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.235258 Mar 29 03:39:29.667309 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3676/7120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:29 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:30.687516 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:30.688613 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:30.696568 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:30.697315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:30.698343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:30.698791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:30.916164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:30.926751 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f51bcf9d-8b03-42f0-9d31-1d3e726e1946 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.246067 Mar 29 03:39:30.927546 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3445/7121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:30 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:31.945032 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:31.945692 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:31.954787 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:31.955243 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:31.956033 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:31.956607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:32.186929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:32.195959 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5a27422-866c-4921-a635-ae5a458ce4f5 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.255156 Mar 29 03:39:32.201323 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3677/7122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:31 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:33.215566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:33.217480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:33.225367 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:33.226062 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:33.226882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:33.227326 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:33.441601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:33.450172 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a35c02ab-9652-414a-9153-00a5475bd005 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.239972 Mar 29 03:39:33.451196 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3446/7123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:33 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:34.468534 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:34.469216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:34.479454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:34.480105 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:34.481085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:34.481543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:34.713130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:34.722124 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e086cd3c-192a-4808-baf5-160e0e36abf4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.257793 Mar 29 03:39:34.722615 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3678/7124] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:34 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:35.739643 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:35.740915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:35.748565 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:35.749053 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:35.749825 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:35.750263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:35.961383 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:35.969793 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8786d1af-46ce-4e13-8d1b-8bc48f94033a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.234038 Mar 29 03:39:35.970900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3447/7125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:35 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:36.987543 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:36.988089 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:36.995667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:36.996258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:36.996911 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:36.997338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:37.212279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:37.220927 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bcf0ed99-165f-4768-a09c-1da6326ea4d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.237258 Mar 29 03:39:37.221772 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3679/7126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:36 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:38.238107 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:38.238751 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:38.246449 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:38.247044 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:38.247836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:38.248276 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:38.468188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:38.478325 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-09f24ac6-bb98-446f-9d57-f676344e544d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.244759 Mar 29 03:39:38.479065 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3448/7127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:38 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:39.495562 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:39.496140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:39.503248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:39.503689 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:39.504436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:39.504882 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:39.700730 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:39.709533 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3e8d6617-2c92-450a-947a-33975677a5fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1698 microversion: 2.1 time: 0.217693 Mar 29 03:39:39.710089 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3680/7128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:39 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1698 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:40.726392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:40.727006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:40.734108 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:40.734561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:40.735319 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:40.736248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:40.936186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:40.945154 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4e902abd-cd7a-4baa-92cc-a9d2d652c256 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1680 microversion: 2.1 time: 0.222329 Mar 29 03:39:40.945706 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3449/7129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:40 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:41.962497 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:41.963051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:41.966164 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:39:41.971589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:41.972036 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:41.972784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:41.973238 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:42.172383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:42.181332 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d42f4431-b434-42b6-8637-9ad139931caa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1680 microversion: 2.1 time: 0.222574 Mar 29 03:39:42.181888 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3681/7130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:41 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:43.199112 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:43.199742 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:43.207379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.207898 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.208906 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.209351 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.409958 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:43.418426 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-98953bc2-d12b-4b67-bfe8-4948640940d4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1683 microversion: 2.1 time: 0.223736 Mar 29 03:39:43.418983 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3450/7131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:43 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:43.435450 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:39:43.436045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:43.444458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.444942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.445717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.446151 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.480331 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33066. Mar 29 03:39:43.667349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-0499a954-0852-4d21-b6e2-f674dfe3dc27 req-7f4919e9-daa9-4709-a667-3fb9c1d7da42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "name": "network-vif-unplugged", "status": "completed", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:39:43.669007 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:39:43.669007 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:39:43.678760 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0499a954-0852-4d21-b6e2-f674dfe3dc27 req-7f4919e9-daa9-4709-a667-3fb9c1d7da42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.679308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-0499a954-0852-4d21-b6e2-f674dfe3dc27 req-7f4919e9-daa9-4709-a667-3fb9c1d7da42 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.695246 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.compute.server_external_events [req-0499a954-0852-4d21-b6e2-f674dfe3dc27 req-7f4919e9-daa9-4709-a667-3fb9c1d7da42 service nova] Unable to find a host for instance 17325c7d-6c00-442c-921f-ea622c4b005a. Dropping event network-vif-unplugged {{(pid=103514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Mar 29 03:39:43.696113 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-0499a954-0852-4d21-b6e2-f674dfe3dc27 req-7f4919e9-daa9-4709-a667-3fb9c1d7da42 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034742 Mar 29 03:39:43.696688 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3451/7132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 29 03:39:43.774572 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb27a95a-6f4a-4a77-9c9f-c63bd6bbb8ab tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a/action" status: 202 len: 0 microversion: 2.1 time: 0.342430 Mar 29 03:39:43.775369 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3682/7133] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:39:43 2022] POST /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:39:43.783583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:43.784239 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:43.791460 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.791925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:43.792726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:43.793167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:44.003800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:44.012802 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-709a2c89-92f5-4bc6-afb5-0569259f412c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1631 microversion: 2.1 time: 0.233379 Mar 29 03:39:44.013495 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3452/7134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:43 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1631 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:45.030717 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:45.031452 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:45.039487 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:45.039965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:45.040756 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:45.041206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:45.244705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:45.247506 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-806dc84e-d350-4410-85c5-d53cc4230d12 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1631 microversion: 2.1 time: 0.220695 Mar 29 03:39:45.248064 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3683/7135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:45 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1631 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:46.264949 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:46.265505 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:46.273030 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:46.273630 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:46.274401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:46.274836 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:46.477348 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:46.485542 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-fbd07e14-7776-4d84-8657-139498bdd5fc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.224571 Mar 29 03:39:46.486100 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3453/7136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:46 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:47.289254 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-581ae22d-1c35-4d01-b5c6-b87e5486df25 req-ded76dcd-02be-4dd8-b42d-a2351b9f796d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:39:47.295106 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:39:47.295106 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:39:47.307496 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-581ae22d-1c35-4d01-b5c6-b87e5486df25 req-ded76dcd-02be-4dd8-b42d-a2351b9f796d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:47.307934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-581ae22d-1c35-4d01-b5c6-b87e5486df25 req-ded76dcd-02be-4dd8-b42d-a2351b9f796d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:47.325873 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-581ae22d-1c35-4d01-b5c6-b87e5486df25 req-ded76dcd-02be-4dd8-b42d-a2351b9f796d service nova] Creating event network-changed:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h2-828148-1 Mar 29 03:39:47.331462 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-581ae22d-1c35-4d01-b5c6-b87e5486df25 req-ded76dcd-02be-4dd8-b42d-a2351b9f796d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047225 Mar 29 03:39:47.332867 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3684/7137] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:39:47.503480 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:47.504184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:47.511551 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:47.512002 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:47.512774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:47.513234 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:47.713893 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:47.722119 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8189c79a-a478-402c-81b6-10e4ceba03bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.222933 Mar 29 03:39:47.722679 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3454/7138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:47 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:48.740647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:48.741374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:48.751879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:48.753515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:48.754392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:48.754842 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:48.980187 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:48.989131 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0c7718f4-857f-48f9-b43d-1be9ed24adbd tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.252545 Mar 29 03:39:48.989691 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3685/7139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:48 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:50.007388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:50.008015 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:50.016226 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:50.016683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:50.017487 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:50.018061 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:50.227917 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:50.237000 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3fdcfe4a-aee4-4e04-b700-5e5fe7ede04b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.233581 Mar 29 03:39:50.239652 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3455/7140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:50 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:51.255081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:51.255825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:51.263857 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:51.264404 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:51.265286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:51.265795 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:51.474944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:51.483561 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8fa78840-edd4-4509-ac79-7a8075398d50 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.232790 Mar 29 03:39:51.484105 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3686/7141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:51 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:52.501707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:52.502344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:52.509891 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:52.510343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:52.511168 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:52.511601 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:52.845843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:52.854219 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9e5a1a11-897b-4e8e-ae8d-3d955fee0f10 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.356090 Mar 29 03:39:52.855065 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3456/7142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:52 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:53.872548 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:53.873627 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:53.881751 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:53.882265 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:53.883275 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:53.883716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:54.201438 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:54.212453 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3cc5394c-2868-4c3d-bd8a-7af5655ca894 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.344029 Mar 29 03:39:54.213449 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3687/7143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:53 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:55.230072 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:55.231649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:55.240603 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:55.241142 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:55.241887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:55.242361 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:55.453411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:55.462600 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-cfd4fff5-e89e-448e-b5c7-f8378e3ee2b0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.236277 Mar 29 03:39:55.463213 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3457/7144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:55 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:56.479609 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:56.480213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:56.487488 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:56.487926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:56.488679 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:56.489127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:56.772179 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:56.780351 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b16e26dd-4982-4a85-a0e1-686c089fa84e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.304466 Mar 29 03:39:56.780993 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3688/7145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:56 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:57.797925 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:57.798579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:57.806098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:57.806552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:57.807317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:57.807761 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:58.004169 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:58.013982 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-289da5df-c1bb-432e-a6d1-bf7bca05275e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.219669 Mar 29 03:39:58.015572 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3458/7146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:57 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:39:59.031392 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:39:59.033844 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:39:59.039935 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:59.040444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:59.041318 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:39:59.041750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:39:59.239743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:39:59.247953 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0580cf9b-146d-480f-9e21-c78497d0f1cf tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.220347 Mar 29 03:39:59.248515 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3689/7147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:39:59 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:40:00.265090 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:40:00.265675 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:40:00.273068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:00.273532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:00.274341 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:00.274786 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:00.339013 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-131d1c78-9ad2-46f5-8bc0-a87b9580ab02 req-a5e2beb7-7fdf-4e4f-b8cf-5b0bbe3b77ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "name": "network-vif-plugged", "status": "completed", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:40:00.339500 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:40:00.339500 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:40:00.347163 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-131d1c78-9ad2-46f5-8bc0-a87b9580ab02 req-a5e2beb7-7fdf-4e4f-b8cf-5b0bbe3b77ef service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:00.347599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-131d1c78-9ad2-46f5-8bc0-a87b9580ab02 req-a5e2beb7-7fdf-4e4f-b8cf-5b0bbe3b77ef service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:00.363774 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-131d1c78-9ad2-46f5-8bc0-a87b9580ab02 req-a5e2beb7-7fdf-4e4f-b8cf-5b0bbe3b77ef service nova] Creating event network-vif-plugged:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h2-828148-1 Mar 29 03:40:00.368603 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-131d1c78-9ad2-46f5-8bc0-a87b9580ab02 req-a5e2beb7-7fdf-4e4f-b8cf-5b0bbe3b77ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035841 Mar 29 03:40:00.369413 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3690/7148] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:40:00.491735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:40:00.499954 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05a9e26e-b548-4020-9f7e-58b11dc3d63b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.238781 Mar 29 03:40:00.500518 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3459/7149] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:40:00 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:40:01.518607 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:40:01.519422 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:40:01.526869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:01.527314 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:01.528077 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:01.528505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:01.736897 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:40:01.745062 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-893ed834-70f9-44ac-bf7a-9666c7360777 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1689 microversion: 2.1 time: 0.231106 Mar 29 03:40:01.745625 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3691/7150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:40:01 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:40:02.762629 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:40:02.763251 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:40:02.771018 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:02.771464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:02.772222 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:40:02.772653 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:40:02.966402 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:40:02.974578 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f060cd99-07cf-46e6-aec9-f41c1219e523 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1676 microversion: 2.1 time: 0.215604 Mar 29 03:40:02.975130 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3460/7151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:40:02 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1676 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:40:03.453623 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:40:03.453857 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:41:16.090713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:16.091902 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:16.103414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:16.103743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:16.104533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:16.104992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:16.176554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-a7b61d8c-f389-45e1-b423-2f5425fb63a9 req-9d3d07b6-5153-4a36-8758-7daf148846bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:41:16.178254 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:41:16.178254 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:41:16.187706 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a7b61d8c-f389-45e1-b423-2f5425fb63a9 req-9d3d07b6-5153-4a36-8758-7daf148846bc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:16.188150 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-a7b61d8c-f389-45e1-b423-2f5425fb63a9 req-9d3d07b6-5153-4a36-8758-7daf148846bc service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:16.190934 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:41:16.206250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-a7b61d8c-f389-45e1-b423-2f5425fb63a9 req-9d3d07b6-5153-4a36-8758-7daf148846bc service nova] Creating event network-changed:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h2-828148-1 Mar 29 03:41:16.213536 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-a7b61d8c-f389-45e1-b423-2f5425fb63a9 req-9d3d07b6-5153-4a36-8758-7daf148846bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129797 Mar 29 03:41:16.214707 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3461/7152] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:41:16.506167 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-473ea6b0-960f-4de2-ac57-3251c905ac67 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "DELETE /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 204 len: 0 microversion: 2.1 time: 0.425903 Mar 29 03:41:16.507158 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3692/7153] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:41:16 2022] DELETE /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:41:16.515763 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:16.516457 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:16.524095 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:16.524554 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:16.525392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:16.525838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:16.737774 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:16.750400 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c5ed49c9-9bd7-4ff4-af95-865ecb8eeb69 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1563 microversion: 2.1 time: 0.238693 Mar 29 03:41:16.750976 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3462/7154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:16 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:17.768702 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:17.769433 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:17.776708 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:17.777192 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:17.777949 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:17.778382 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:18.218636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:18.229659 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5511da48-2ec4-4a86-a240-4ab17d1c260f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1563 microversion: 2.1 time: 0.464924 Mar 29 03:41:18.230546 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3693/7155] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:17 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1563 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:18.903753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-4761bdf7-394c-4f0b-b6f7-575fa61eef1b req-3cc34614-48d4-4c2c-8c07-6350be6b6f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17325c7d-6c00-442c-921f-ea622c4b005a", "name": "network-vif-deleted", "tag": "26cc863a-df40-431b-8326-9b7cdf80c65e"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:41:18.905951 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:41:18.905951 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:41:18.914541 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4761bdf7-394c-4f0b-b6f7-575fa61eef1b req-3cc34614-48d4-4c2c-8c07-6350be6b6f87 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:18.914992 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-4761bdf7-394c-4f0b-b6f7-575fa61eef1b req-3cc34614-48d4-4c2c-8c07-6350be6b6f87 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:18.931189 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-4761bdf7-394c-4f0b-b6f7-575fa61eef1b req-3cc34614-48d4-4c2c-8c07-6350be6b6f87 service nova] Creating event network-vif-deleted:26cc863a-df40-431b-8326-9b7cdf80c65e for instance 17325c7d-6c00-442c-921f-ea622c4b005a on n-h2-828148-1 Mar 29 03:41:18.936654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-4761bdf7-394c-4f0b-b6f7-575fa61eef1b req-3cc34614-48d4-4c2c-8c07-6350be6b6f87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036433 Mar 29 03:41:18.942029 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3463/7156] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:41:19.246619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:19.248436 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:19.255862 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:19.256306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:19.257117 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:19.260173 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:19.330231 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:19.330674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:19.331121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lazy-loading 'fault' on Instance uuid 17325c7d-6c00-442c-921f-ea622c4b005a {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:41:19.456119 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:19.464175 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-272dce36-2fc7-49a3-9807-76075d43f465 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 200 len: 1336 microversion: 2.1 time: 0.221134 Mar 29 03:41:19.464729 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3694/7157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:19 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:20.482524 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:20.483245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 17325c7d-6c00-442c-921f-ea622c4b005a] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:20.491007 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:20.491455 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:20.492215 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:20.492650 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:20.546250 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] HTTP exception thrown: Instance 17325c7d-6c00-442c-921f-ea622c4b005a could not be found. Mar 29 03:41:20.546853 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Returning 404 to user: Instance 17325c7d-6c00-442c-921f-ea622c4b005a could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:41:20.547681 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7af3114-e54c-45d5-bde0-89c8c6cc65b9 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a" status: 404 len: 111 microversion: 2.1 time: 0.069361 Mar 29 03:41:20.548222 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3464/7158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:20 2022] GET /compute/v2.1/servers/17325c7d-6c00-442c-921f-ea622c4b005a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:41:20.883796 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-984b6ef2-b1fc-488a-b814-35314a196a93 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '.version_select at 0x7f8725ec6f70>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:20.887067 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-984b6ef2-b1fc-488a-b814-35314a196a93 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [041e4ede-e058-4112-8064-8ca9eae076f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:41:21.895378 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-984b6ef2-b1fc-488a-b814-35314a196a93 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [041e4ede-e058-4112-8064-8ca9eae076f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33236. Mar 29 03:41:21.986564 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-984b6ef2-b1fc-488a-b814-35314a196a93 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-715354873" status: 202 len: 0 microversion: 2.1 time: 1.106571 Mar 29 03:41:21.987141 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3695/7159] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 03:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-715354873 => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:41:22.009202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'create', calling method: .version_select at 0x7f8724d1bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-203045542"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:41:22.031060 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:41:22.036092 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:41:22.049381 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [6a0c988b-da76-464f-9004-5185bce6892a] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:41:23.055296 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [6a0c988b-da76-464f-9004-5185bce6892a] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33240. Mar 29 03:41:23.512375 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:41:23.517412 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:41:23.531601 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-9426a9a0-db6c-4998-930a-f05439572f02 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.526143 Mar 29 03:41:23.532197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3465/7160] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:41:22 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:32.113759 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:41:32.114462 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:41:45.595631 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-972774012", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-203045542", "security_groups": [{"name": "tempest-secgroup-smoke-1095885764"}], "networks": [{"uuid": "03656f73-8f91-46a0-b446-ba937ffdd87d"}], "block_device_mapping_v2": [{"uuid": "7b02ee67-6a40-43df-8196-614a343cb015", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:41:45.814926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] validate_networks() for [('03656f73-8f91-46a0-b446-ba937ffdd87d', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:41:46.479855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:41:46.480279 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:41:46.480747 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:41:46.481181 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:41:46.481587 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:41:46.489781 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:46.490219 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:46.491003 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:46.491424 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:46.507941 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for project 8e1c6090c9324384b399f3b26eaee609. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:41:46.513258 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Getting quotas for user 21c750d60e7a4a85b638fa91e4c0e624 and project 8e1c6090c9324384b399f3b26eaee609. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:41:46.601827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:41:46.603938 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7b02ee67-6a40-43df-8196-614a343cb015',volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:41:47.003635 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fa4de982-d334-4bc8-8313-6cd55f0ce82c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.411784 Mar 29 03:41:47.004275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3696/7161] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:41:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:41:47.014730 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a5b173c2-1017-482c-94da-1cb3fc1a0392 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:47.015416 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a5b173c2-1017-482c-94da-1cb3fc1a0392 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:47.089182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a5b173c2-1017-482c-94da-1cb3fc1a0392 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:47.096605 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a5b173c2-1017-482c-94da-1cb3fc1a0392 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1087 microversion: 2.1 time: 0.085938 Mar 29 03:41:47.097153 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3466/7162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:47 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:48.113531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:48.114139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:48.122145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:48.122589 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:48.123346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:48.123822 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:48.235337 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:48.243696 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1390cecc-8134-44c8-9375-e5390b0ee9f4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1137 microversion: 2.1 time: 0.133929 Mar 29 03:41:48.245270 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3697/7163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:48 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1137 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:41:49.260904 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:49.261597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:49.270501 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:49.271045 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:49.271896 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:49.272588 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:49.390094 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:49.399061 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0c06e3e2-6798-45a8-8ccf-c6a455a4b14a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1203 microversion: 2.1 time: 0.141805 Mar 29 03:41:49.399720 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3467/7164] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:49 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1203 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:50.416691 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:50.417397 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:50.425994 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:50.426437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:50.427390 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:50.427989 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:50.911712 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:50.922531 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-459475ed-3698-4bd8-97db-42fd52191296 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1271 microversion: 2.1 time: 0.508925 Mar 29 03:41:50.930275 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3698/7165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:50 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:51.430020 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-65e091b2-ce1c-40fc-8a09-27a6085b5cc6 req-6d21159b-a98d-4aa1-8ea2-1ae81d523407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:41:51.431524 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:41:51.431524 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:41:51.440201 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65e091b2-ce1c-40fc-8a09-27a6085b5cc6 req-6d21159b-a98d-4aa1-8ea2-1ae81d523407 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:51.445722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-65e091b2-ce1c-40fc-8a09-27a6085b5cc6 req-6d21159b-a98d-4aa1-8ea2-1ae81d523407 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:51.463015 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-65e091b2-ce1c-40fc-8a09-27a6085b5cc6 req-6d21159b-a98d-4aa1-8ea2-1ae81d523407 service nova] Creating event network-changed:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:41:51.468807 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-65e091b2-ce1c-40fc-8a09-27a6085b5cc6 req-6d21159b-a98d-4aa1-8ea2-1ae81d523407 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041594 Mar 29 03:41:51.468807 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3468/7166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:41:51.939578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:51.940188 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:51.947559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:51.948005 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:51.948806 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:51.949289 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:52.267345 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:52.275357 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-b74f5539-9afb-402d-a662-96b498776898 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.339759 Mar 29 03:41:52.275919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3699/7167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:51 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:53.293376 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:53.294084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:53.302220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:53.302674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:53.303440 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:53.303880 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:53.511310 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:53.519299 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e7267d4e-cb8a-4712-bee7-6119049e33a7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.229985 Mar 29 03:41:53.519849 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3469/7168] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:53 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:54.535388 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:54.535929 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:54.543215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:54.544010 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:54.544395 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:54.544823 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:54.735633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:54.743724 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-80cbf6f8-7ec9-4642-a0f6-23f973458917 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.212037 Mar 29 03:41:54.744289 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3700/7169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:54 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:55.761176 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:55.761800 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:55.769766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:55.770219 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:55.770988 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:55.771430 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:55.967647 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:55.973071 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-85ade08f-7481-4a4d-9110-c5dbfb53dc98 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.215537 Mar 29 03:41:55.973604 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3470/7170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:55 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:56.990439 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:56.991048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:56.998537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:57.002420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:57.002420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:57.002420 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:57.197347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:57.205622 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1a028997-0b94-4fd5-be6d-521dd50f5675 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.218856 Mar 29 03:41:57.206178 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3701/7171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:56 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:58.222724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:58.223343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:58.230649 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:58.231101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:58.231865 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:58.232302 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:58.428068 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:58.436119 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-695df396-f3ce-4646-95aa-4dfc9a1b9417 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.217462 Mar 29 03:41:58.436672 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3471/7172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:58 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:41:59.453845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:41:59.454458 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:41:59.461856 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:59.462304 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:59.463062 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:41:59.463493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:41:59.657246 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:41:59.665430 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-dc2ba9b5-7afd-4ffa-9960-6a9dd09ac316 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.215836 Mar 29 03:41:59.665991 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3702/7173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:41:59 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:00.681735 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:00.682391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:00.689835 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:00.690294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:00.691067 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:00.691513 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:00.883498 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:00.892103 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a9d94b41-3f3d-441d-8246-5468341c296e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.214240 Mar 29 03:42:00.892658 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3472/7174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:00 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:01.909224 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:01.909835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:01.917336 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:01.917780 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:01.918541 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:01.918970 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:02.223326 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:02.231357 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1166fce5-d86b-4685-9807-7ba2262c57fa tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.326430 Mar 29 03:42:02.231914 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3703/7175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:01 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:03.247294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:03.247907 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:03.255303 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:03.255754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:03.256515 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:03.256974 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:03.456791 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:03.464876 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ffcd4bb6-b953-41f6-85d7-2f1b21d905c8 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.221275 Mar 29 03:42:03.465437 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3473/7176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:03 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:04.482311 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:04.482917 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:04.490637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:04.491081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:04.491835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:04.492260 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:04.686898 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:04.695181 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75a5939e-81db-451d-b9a3-2689537b148b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.216730 Mar 29 03:42:04.695760 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3704/7177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:04 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:05.711561 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:05.712182 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:05.719509 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:05.719961 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:05.720727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:05.721197 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:05.912469 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:05.920458 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-aea0ea55-779f-490f-8d0b-8350e13ddb39 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.212538 Mar 29 03:42:05.921055 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3474/7178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:05 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:06.937926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:06.938535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:06.945861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:06.946306 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:06.947072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:06.947500 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:07.142979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:07.151057 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2b5bae7f-c72b-4221-8139-501d92417fea tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.216827 Mar 29 03:42:07.151621 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3705/7179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:06 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:08.167753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:08.168364 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:08.175845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:08.176301 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:08.177080 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:08.177517 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:08.374022 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:08.383766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f16d20d2-c3bb-4d37-beb2-5ab913afeaac tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.219505 Mar 29 03:42:08.384725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3475/7180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:08 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:08.546000 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-c0c04390-fd43-4a1a-a5ea-0f703edbab2c req-cd46513b-1370-48ff-bcf5-e7a187bbbc31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "name": "network-vif-plugged", "status": "completed", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:42:08.547584 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:42:08.547584 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:42:08.556383 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c0c04390-fd43-4a1a-a5ea-0f703edbab2c req-cd46513b-1370-48ff-bcf5-e7a187bbbc31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:08.556825 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-c0c04390-fd43-4a1a-a5ea-0f703edbab2c req-cd46513b-1370-48ff-bcf5-e7a187bbbc31 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:08.573160 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-c0c04390-fd43-4a1a-a5ea-0f703edbab2c req-cd46513b-1370-48ff-bcf5-e7a187bbbc31 service nova] Creating event network-vif-plugged:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:42:08.578058 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-c0c04390-fd43-4a1a-a5ea-0f703edbab2c req-cd46513b-1370-48ff-bcf5-e7a187bbbc31 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081060 Mar 29 03:42:08.578807 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3706/7181] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:42:09.399506 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:09.400126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:09.407464 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:09.408484 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:09.409282 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:09.409726 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:09.605719 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:09.613842 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-64f5cf6a-c24c-4632-b779-1f105501a2fe tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1259 microversion: 2.1 time: 0.218001 Mar 29 03:42:09.614411 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3476/7182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:09 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:10.632055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:10.632808 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:10.640571 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:10.641121 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:10.641904 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:10.642331 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:10.839869 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:10.848765 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-802bd6b9-e7f4-483e-ae80-c6514652c323 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1443 microversion: 2.1 time: 0.220926 Mar 29 03:42:10.849438 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3707/7183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:10 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:10.864863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:42:10.865585 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:42:10.872950 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:10.873406 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:10.874175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:10.874619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:11.066184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:42:11.074496 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-41de0ce0-f090-4a9b-b6da-67d213e3bae4 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1443 microversion: 2.1 time: 0.213301 Mar 29 03:42:11.075186 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3477/7184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:42:10 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:42:13.993844 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:42:14.044827 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e692ffd8-4871-44c1-b339-8b40ffe4ea1f req-3920789a-da23-4e99-8a31-6b6992ff4f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:42:14.046352 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:42:14.046352 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:42:14.054769 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e692ffd8-4871-44c1-b339-8b40ffe4ea1f req-3920789a-da23-4e99-8a31-6b6992ff4f6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:42:14.055206 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e692ffd8-4871-44c1-b339-8b40ffe4ea1f req-3920789a-da23-4e99-8a31-6b6992ff4f6f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:42:14.071468 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e692ffd8-4871-44c1-b339-8b40ffe4ea1f req-3920789a-da23-4e99-8a31-6b6992ff4f6f service nova] Creating event network-changed:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:42:14.076426 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e692ffd8-4871-44c1-b339-8b40ffe4ea1f req-3920789a-da23-4e99-8a31-6b6992ff4f6f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087777 Mar 29 03:42:14.077111 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3708/7185] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:44:49.797931 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:44:49.798462 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:44:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:44:51.613957 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:44:51.617956 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:44:51.618528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:51.621465 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:44:51.626602 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:51.626989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:51.632332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:51.632332 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:51.687687 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.objects.instance [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lazy-loading 'flavor' on Instance uuid 64faa776-0e5b-45ec-8004-2b45daca4c05 {{(pid=103514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:44:52.085718 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:44:52.123364 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:44:52.123593 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05/action (ip 10.222.0.36) !!! Mar 29 03:44:52.628676 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33552. Mar 29 03:44:52.631791 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33554. Mar 29 03:44:53.094221 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [fc9b6ee8-660b-4bc1-beec-f2455dce8eab] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33558. Mar 29 03:44:53.098171 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4daeea05-649e-48b4-8849-2be6337d62ce tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05/action" status: 202 len: 0 microversion: 2.1 time: 1.485660 Mar 29 03:44:53.098766 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3478/7186] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:44:51 2022] POST /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05/action => generated 0 bytes in 1487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:44:53.104978 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:44:53.108613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:53.109344 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:53.118704 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:53.127442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:53.127442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:53.127442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:53.171117 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33562. Mar 29 03:44:53.373636 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:53.382279 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-f8a95d75-28e0-406a-bd0f-2baaca8e09bc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.278404 Mar 29 03:44:53.382869 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3709/7187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:53 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:44:54.399941 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:54.400671 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:54.408794 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:54.409274 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:54.410034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:54.410470 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:54.647392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:54.655663 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-da2b553a-b689-428d-bbcf-472be2a8d336 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.259789 Mar 29 03:44:54.656218 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3479/7188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:54 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:44:55.673329 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:55.673943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:55.682918 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:55.683367 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:55.684130 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:55.684559 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:55.720730 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33580. Mar 29 03:44:55.879726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:55.888683 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a358e4a3-2473-4e9a-8b7c-33724113e63f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.219274 Mar 29 03:44:55.889268 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3710/7189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:55 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:44:56.905743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:56.906360 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:56.914372 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:56.914827 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:56.915590 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:56.916031 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:57.114438 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:57.122588 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7d12c906-88b6-430d-8856-133e3b04d6cc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.220548 Mar 29 03:44:57.123140 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3480/7190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:56 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:44:58.139408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:58.140025 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:58.147372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:58.147817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:58.148578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:58.149060 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:58.342579 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:58.351253 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4bb520a8-81f7-48cf-8a72-baf9ed649d33 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.215549 Mar 29 03:44:58.351816 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3711/7191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:58 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:44:59.368444 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:44:59.369098 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:44:59.376374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:59.376830 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:59.377622 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:44:59.378063 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:44:59.573379 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:44:59.581471 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d4ffbf29-836c-4a5f-8ea1-db6836999bf0 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.217221 Mar 29 03:44:59.582023 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3481/7192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:44:59 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:00.598764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:00.599374 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:00.606675 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:00.607114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:00.608226 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:00.608657 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:00.848674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:00.857735 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e9c31357-5aed-497e-806d-6f8326708c08 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.262612 Mar 29 03:45:00.858231 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3712/7193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:00 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:01.874902 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:01.875531 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:01.882971 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:01.883431 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:01.884206 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:01.884652 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:02.085849 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:02.094173 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a8cdde69-cb3c-41de-bd03-284d84f7b113 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.223032 Mar 29 03:45:02.094736 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3482/7194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:01 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:03.111301 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:03.112682 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:03.119515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:03.119980 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:03.120824 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:03.121213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:03.320968 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:03.328772 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6df77f49-c130-4abc-b61b-821d5626e94a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.221160 Mar 29 03:45:03.329425 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3713/7195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:03 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:04.346510 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:04.347123 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:04.355034 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:04.355483 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:04.356241 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:04.356680 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:04.713321 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:04.721440 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-057890c3-8ebd-461c-988b-deed0f4143c7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.378591 Mar 29 03:45:04.721986 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3483/7196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:04 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:05.739158 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:05.740396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:05.747685 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:05.748127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:05.748916 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:05.749348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:05.944752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:05.952905 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bc7f3d59-bbbc-414b-9f0d-ff75d28e9d85 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.217479 Mar 29 03:45:05.953465 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3714/7197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:05 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:06.970845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:06.971397 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:06.979228 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:06.979685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:06.980459 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:06.980927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:07.177798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:07.185838 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d5ff3e82-4b50-442f-85c7-2f264e945f7a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.219167 Mar 29 03:45:07.186393 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3484/7198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:06 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:08.203429 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:08.204051 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:08.211493 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:08.211956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:08.212742 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:08.213203 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:08.404797 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:08.413620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e94af937-5925-4cac-857f-04c4a594fa2e tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.214106 Mar 29 03:45:08.414130 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3715/7199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:08 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:09.431263 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:09.431882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:09.439156 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:09.439640 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:09.440424 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:09.440901 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:09.633212 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:09.641503 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-756482fd-9cb1-44ba-9839-5bef677a0037 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.214385 Mar 29 03:45:09.642053 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3485/7200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:09 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:10.661835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:10.661835 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:10.668476 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:10.669009 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:10.669789 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:10.670223 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:11.029138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:11.037778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-0bc34835-7db1-4a98-96f6-b9c86515527b tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.383463 Mar 29 03:45:11.038348 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3716/7201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:10 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:12.055441 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:12.055995 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:12.063170 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.063615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.064377 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.064809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.269026 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:12.277909 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b7254119-5b6a-4f58-8e3f-378b42b37e47 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1569 microversion: 2.1 time: 0.226317 Mar 29 03:45:12.278702 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3486/7202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:12 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:12.294531 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:45:12.295098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:12.302652 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.303090 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.306365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.306365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.580555 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d5963581-14cf-4cd1-a3f8-787471a6773c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "POST /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05/action" status: 202 len: 0 microversion: 2.1 time: 0.289570 Mar 29 03:45:12.581181 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3717/7203] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:45:12 2022] POST /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:45:12.589225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:12.589843 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:12.596993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.597462 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.598250 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:12.598677 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:12.796600 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:12.805577 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-26653665-4549-49cd-b506-eaea112b3c70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1517 microversion: 2.1 time: 0.220041 Mar 29 03:45:12.806200 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3487/7204] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:12 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1517 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:13.823447 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:13.824047 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:13.831437 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:13.831923 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:13.832674 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:13.833133 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:14.029127 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:14.037341 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8634e03f-7573-4bc5-8556-d5e5f1a92111 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1519 microversion: 2.1 time: 0.217766 Mar 29 03:45:14.038095 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3718/7205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:13 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1519 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:15.055078 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:15.055707 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:15.062845 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:15.063333 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:15.064102 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:15.064547 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:15.263423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:15.273068 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c247bae2-6ff8-4187-89ce-99ffb9738971 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1519 microversion: 2.1 time: 0.221712 Mar 29 03:45:15.273937 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3488/7206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:15 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1519 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:15.369879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-05ee0313-4db4-4124-b0bb-3e932c14bc32 req-8b10d9cb-ac58-4f61-a58c-b6fe35cc0a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "name": "network-vif-unplugged", "status": "completed", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:45:15.371503 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:45:15.371503 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:45:15.379663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-05ee0313-4db4-4124-b0bb-3e932c14bc32 req-8b10d9cb-ac58-4f61-a58c-b6fe35cc0a5e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:15.380745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-05ee0313-4db4-4124-b0bb-3e932c14bc32 req-8b10d9cb-ac58-4f61-a58c-b6fe35cc0a5e service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:15.396770 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.compute.server_external_events [req-05ee0313-4db4-4124-b0bb-3e932c14bc32 req-8b10d9cb-ac58-4f61-a58c-b6fe35cc0a5e service nova] Unable to find a host for instance 64faa776-0e5b-45ec-8004-2b45daca4c05. Dropping event network-vif-unplugged {{(pid=103513) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Mar 29 03:45:15.397771 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-05ee0313-4db4-4124-b0bb-3e932c14bc32 req-8b10d9cb-ac58-4f61-a58c-b6fe35cc0a5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031778 Mar 29 03:45:15.398353 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3719/7207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Mar 29 03:45:16.291308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:16.291927 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:16.299296 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:16.299753 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:16.300528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:16.301001 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:16.501892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:16.510576 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2fe82c56-b37b-44df-afe2-407e6c34d6b7 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.222969 Mar 29 03:45:16.511128 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3489/7208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:16 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:17.527578 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:17.528237 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:17.535512 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:17.535981 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:17.537256 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:17.537688 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:17.732176 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:17.740191 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-fb2cecfb-099a-4467-a079-7a4616e248e1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.216325 Mar 29 03:45:17.740750 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3720/7209] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:17 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:18.350470 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:45:18.350622 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:45:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:45:18.756960 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:18.757577 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:18.764884 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:18.765344 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:18.766122 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:18.766559 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:18.960989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:18.969278 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-a45c1f98-55fd-4574-9f9a-a2c7cac4f89f tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.216566 Mar 29 03:45:18.969831 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3490/7210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:18 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:19.986804 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:19.987338 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:19.995209 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:19.995653 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:19.996403 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:19.996831 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:20.185965 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:20.194615 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a4878a78-b8a3-4ad7-b7c4-e2bf2ba6cb8a tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.211577 Mar 29 03:45:20.195166 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3721/7211] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:19 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:21.211019 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:21.211673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:21.218881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:21.222991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:21.222991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:21.222991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:21.520619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:21.528782 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2d6ea620-4695-468d-956b-eb71ac5ea2b6 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.322003 Mar 29 03:45:21.529551 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3491/7212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:21 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:22.546310 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:22.546884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:22.554396 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:22.554845 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:22.555637 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:22.556071 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:22.755183 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:22.763689 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-363d98b7-fccc-46b0-baa4-7175d9801a3c tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.221452 Mar 29 03:45:22.764239 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3722/7213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:22 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:23.782100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:23.782723 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:23.790724 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:23.791178 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:23.791944 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:23.792391 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:23.995308 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:24.003305 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-3ef0a609-bb12-4931-a04a-507d107da215 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.225039 Mar 29 03:45:24.003863 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3492/7214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:23 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:45:25.020113 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:25.020713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:25.027982 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:25.028426 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:25.029213 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:25.029642 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:25.220784 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:25.229521 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-9ae36839-34c7-437d-8ee0-8ad3ed086efc tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.213339 Mar 29 03:45:25.230073 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3723/7215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:25 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:26.246173 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:26.246716 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:26.254126 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:26.254569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:26.255859 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:26.256293 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:26.446374 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:26.454430 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-39304c15-2eea-4962-a10f-4662d7d5bbf1 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.212044 Mar 29 03:45:26.454975 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3493/7216] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:26 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:27.471389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:27.472108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:27.479891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:27.480343 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:27.481131 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:27.481561 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:27.500380 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-de04b759-e618-4bfd-a094-466a563702ce req-5b4182a9-660c-4210-ac61-f7ed857eb709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "name": "network-vif-plugged", "status": "completed", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:45:27.502059 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:45:27.502059 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:45:27.510193 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-de04b759-e618-4bfd-a094-466a563702ce req-5b4182a9-660c-4210-ac61-f7ed857eb709 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:27.521804 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-de04b759-e618-4bfd-a094-466a563702ce req-5b4182a9-660c-4210-ac61-f7ed857eb709 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:27.526862 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-de04b759-e618-4bfd-a094-466a563702ce req-5b4182a9-660c-4210-ac61-f7ed857eb709 service nova] Creating event network-vif-plugged:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:45:27.531795 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-de04b759-e618-4bfd-a094-466a563702ce req-5b4182a9-660c-4210-ac61-f7ed857eb709 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Mar 29 03:45:27.532372 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3494/7217] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:45:27.871058 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:27.879143 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d1227bf7-69a1-492c-9f16-15b2dc8ec2ad tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.411586 Mar 29 03:45:27.880200 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3724/7218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:27 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:28.897097 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:28.897793 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:28.905256 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:28.905704 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:28.906493 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:28.906926 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:29.104220 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:29.112377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-ab02e390-8d76-40f7-89a6-0c6b9ee1159d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1575 microversion: 2.1 time: 0.219888 Mar 29 03:45:29.112897 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3495/7219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:28 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1575 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:45:30.129248 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:45:30.129891 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:45:30.137138 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:30.137582 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:30.138333 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:45:30.138759 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:45:30.334108 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:45:30.342209 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c62fab53-27c1-45dc-bc9d-69d8ffb99f1d tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1562 microversion: 2.1 time: 0.216703 Mar 29 03:45:30.342762 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3725/7220] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:45:30 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1562 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:46:30.792652 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:46:30.793343 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:46:32.266034 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:46:32.266034 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:47:20.227011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:20.227528 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:20.236120 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:20.236612 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:20.237386 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:20.237831 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:20.302727 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:47:20.367078 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-9e9aa58f-4917-4b0b-a7dc-46e7a6697f34 req-eb11134a-35dc-4847-8790-44e2a3ee196b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:47:20.369131 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:47:20.369131 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:47:20.377766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e9aa58f-4917-4b0b-a7dc-46e7a6697f34 req-eb11134a-35dc-4847-8790-44e2a3ee196b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:20.378230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-9e9aa58f-4917-4b0b-a7dc-46e7a6697f34 req-eb11134a-35dc-4847-8790-44e2a3ee196b service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:20.394859 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-9e9aa58f-4917-4b0b-a7dc-46e7a6697f34 req-eb11134a-35dc-4847-8790-44e2a3ee196b service nova] Creating event network-changed:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:47:20.402594 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-9e9aa58f-4917-4b0b-a7dc-46e7a6697f34 req-eb11134a-35dc-4847-8790-44e2a3ee196b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182405 Mar 29 03:47:20.403856 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3726/7221] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:47:20.621459 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-8e3b77c3-fbd4-41a8-ba19-7300eb783841 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "DELETE /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 204 len: 0 microversion: 2.1 time: 0.403847 Mar 29 03:47:20.627263 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3496/7222] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:47:20 2022] DELETE /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:47:20.631846 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:20.632557 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:20.640865 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:20.641454 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:20.642228 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:20.642839 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:21.091683 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:47:21.100560 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-1ff2c489-a299-47f1-9774-fec03bf2b040 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1568 microversion: 2.1 time: 0.472807 Mar 29 03:47:21.111479 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3727/7223] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:47:20 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1568 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:47:22.119418 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:22.120121 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:22.127871 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:22.128329 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:22.129130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:22.129571 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:22.328579 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:47:22.336701 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-45d8f576-bc18-4f29-a75d-6000beec7a41 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1449 microversion: 2.1 time: 0.221366 Mar 29 03:47:22.337295 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3497/7224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:47:22 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1449 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:47:23.249955 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f4335c79-3675-4643-aa9f-2e0e89864743 req-0725b7e4-b56f-4778-bcd2-b211f01b6ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64faa776-0e5b-45ec-8004-2b45daca4c05", "name": "network-vif-deleted", "tag": "8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:47:23.251455 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:47:23.251455 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:47:23.259465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f4335c79-3675-4643-aa9f-2e0e89864743 req-0725b7e4-b56f-4778-bcd2-b211f01b6ad1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:23.263215 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f4335c79-3675-4643-aa9f-2e0e89864743 req-0725b7e4-b56f-4778-bcd2-b211f01b6ad1 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:23.275636 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f4335c79-3675-4643-aa9f-2e0e89864743 req-0725b7e4-b56f-4778-bcd2-b211f01b6ad1 service nova] Creating event network-vif-deleted:8d5ab1e5-9ed0-4163-bf15-d511c8fd2a90 for instance 64faa776-0e5b-45ec-8004-2b45daca4c05 on n-h1-828148-1 Mar 29 03:47:23.280924 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f4335c79-3675-4643-aa9f-2e0e89864743 req-0725b7e4-b56f-4778-bcd2-b211f01b6ad1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035322 Mar 29 03:47:23.281724 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3728/7225] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:47:23.354000 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:23.354566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:23.362532 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:23.362993 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:23.363854 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:23.364298 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:23.494445 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:47:23.502866 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-78c32cf0-a1d4-495b-8bbc-d7b178518947 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1218 microversion: 2.1 time: 0.152848 Mar 29 03:47:23.503432 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3498/7226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:47:23 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:47:24.521259 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:24.521961 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:24.529514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:24.529956 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:24.530711 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:24.531140 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:24.602263 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:24.602703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:24.603147 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lazy-loading 'fault' on Instance uuid 64faa776-0e5b-45ec-8004-2b45daca4c05 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:47:24.735193 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21c750d60e7a4a85b638fa91e4c0e624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e1c6090c9324384b399f3b26eaee609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:47:24.743661 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7a00f4b0-a631-4542-9ad3-3f1a207c0869 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 200 len: 1223 microversion: 2.1 time: 0.226845 Mar 29 03:47:24.747093 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3729/7227] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:47:24 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 1223 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:47:25.760972 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:25.761545 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] [instance: 64faa776-0e5b-45ec-8004-2b45daca4c05] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:47:25.769676 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:25.770292 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:25.771076 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:25.771685 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:25.820755 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] HTTP exception thrown: Instance 64faa776-0e5b-45ec-8004-2b45daca4c05 could not be found. Mar 29 03:47:25.821414 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Returning 404 to user: Instance 64faa776-0e5b-45ec-8004-2b45daca4c05 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:47:25.822249 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-843a8bfe-3828-4c00-9ca9-657fbbcc8af3 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05" status: 404 len: 111 microversion: 2.1 time: 0.065169 Mar 29 03:47:25.822804 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3499/7228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:47:25 2022] GET /compute/v2.1/servers/64faa776-0e5b-45ec-8004-2b45daca4c05 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:47:26.133944 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e13cbd23-352f-465e-a967-59dcda20ce70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] Calling method '.version_select at 0x7f8724bad040>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:47:26.190156 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e13cbd23-352f-465e-a967-59dcda20ce70 tempest-TestShelveInstance-1879128022 tempest-TestShelveInstance-1879128022-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203045542" status: 202 len: 0 microversion: 2.1 time: 0.059846 Mar 29 03:47:26.190611 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3730/7229] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Mar 29 03:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-203045542 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:47:55.343164 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:47:55.343740 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:47:55.516987 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Action: 'create', calling method: .version_select at 0x7f8717f8a790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-521762493"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:47:55.539892 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for project f404dfee81704a668826802b21e932f1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:47:55.545915 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for user 7f108782939c41cebf3fa8d28f84cb04 and project f404dfee81704a668826802b21e932f1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:47:55.809202 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for project f404dfee81704a668826802b21e932f1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:47:55.815335 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for user 7f108782939c41cebf3fa8d28f84cb04 and project f404dfee81704a668826802b21e932f1. Resources: {'key_pairs'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:47:55.830517 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-1d718dc7-b655-4c5e-a5b3-6ec511a92af6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.492947 Mar 29 03:47:55.831333 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3500/7230] 10.222.0.36 () {60 vars in 1157 bytes} [Tue Mar 29 03:47:55 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:47:58.534745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-346964873", "imageRef": "de7524d7-d38d-4b70-85cc-a7e4732b733f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-521762493", "security_groups": [{"name": "tempest-secgroup-smoke-1545934968"}], "networks": [{"uuid": "ea9a7298-04de-4ea9-8c95-2e27b70a32b1"}]}} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:47:58.553969 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 29 03:47:58.554444 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:47:58.727754 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.network.neutron [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] validate_networks() for [('ea9a7298-04de-4ea9-8c95-2e27b70a32b1', None, None, None)] {{(pid=103513) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:47:59.543327 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Flavor limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:47:59.543884 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Image limits 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:47:59.544205 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Flavor pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:47:59.544613 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Image pref 0:0:0 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:47:59.545057 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.virt.hardware [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:47:59.553285 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:59.553722 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:59.554514 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:47:59.554942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:47:59.575342 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33914. Mar 29 03:47:59.576212 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33916. Mar 29 03:47:59.580888 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for project f404dfee81704a668826802b21e932f1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:47:59.586069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.quota [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for user 7f108782939c41cebf3fa8d28f84cb04 and project f404dfee81704a668826802b21e932f1. Resources: {'cores', 'ram', 'instances'} {{(pid=103513) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:47:59.598139 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Going to run 1 instances... {{(pid=103513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:47:59.600418 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='de7524d7-d38d-4b70-85cc-a7e4732b733f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:47:59.725971 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 29 03:48:00.734310 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [97d5a54b-91c3-4b55-8fbf-fbf8b0fd70f1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33920. Mar 29 03:48:00.738096 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-6699b08c-fa02-44ab-9ae7-158ad8ebea05 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.207123 Mar 29 03:48:00.738737 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3731/7231] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:47:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:48:00.756765 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33924. Mar 29 03:48:00.761006 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-5315d928-c3f5-4db5-89b5-a4eae68bf712 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:00.761637 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-5315d928-c3f5-4db5-89b5-a4eae68bf712 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:00.771615 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 33926. Mar 29 03:48:00.836986 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-5315d928-c3f5-4db5-89b5-a4eae68bf712 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:00.844815 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-5315d928-c3f5-4db5-89b5-a4eae68bf712 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1247 microversion: 2.1 time: 0.100108 Mar 29 03:48:00.849356 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3501/7232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:00 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1247 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:01.862069 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ea8d986-35ac-4ed4-9f09-46191b32a6d9 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:01.862686 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ea8d986-35ac-4ed4-9f09-46191b32a6d9 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:01.931673 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ea8d986-35ac-4ed4-9f09-46191b32a6d9 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:01.939841 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ea8d986-35ac-4ed4-9f09-46191b32a6d9 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1247 microversion: 2.1 time: 0.081374 Mar 29 03:48:01.940394 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3732/7233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:01 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:02.956526 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-6fff841a-57f6-4ff9-9205-b86a23514037 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:02.957075 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-6fff841a-57f6-4ff9-9205-b86a23514037 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:03.027294 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-6fff841a-57f6-4ff9-9205-b86a23514037 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:03.034806 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-6fff841a-57f6-4ff9-9205-b86a23514037 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1247 microversion: 2.1 time: 0.082109 Mar 29 03:48:03.035354 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3502/7234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:02 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:04.051745 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-8aa5fbae-8bbe-4f6b-a38c-929f1ee60a81 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:04.052353 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-8aa5fbae-8bbe-4f6b-a38c-929f1ee60a81 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:04.122937 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-8aa5fbae-8bbe-4f6b-a38c-929f1ee60a81 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:04.130095 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-8aa5fbae-8bbe-4f6b-a38c-929f1ee60a81 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1247 microversion: 2.1 time: 0.082007 Mar 29 03:48:04.130642 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3733/7235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:04 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:05.147315 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:05.147930 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:05.155838 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:05.156286 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:05.157091 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:05.157522 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:05.266012 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:05.273898 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-098f15e9-30e5-40e6-93f5-4ad7a63a0776 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1251 microversion: 2.1 time: 0.130310 Mar 29 03:48:05.274454 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3503/7236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:05 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1251 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:06.291134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:06.291750 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:06.300474 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:06.300943 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:06.301716 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:06.302149 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:06.414525 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:06.423507 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-48617750-6df3-49ae-9252-258297e77ee1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1243 microversion: 2.1 time: 0.136057 Mar 29 03:48:06.424072 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3734/7237] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:06 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1243 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:48:07.441101 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:07.441737 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:07.449139 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:07.454548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:07.454548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:07.454548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:07.569271 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:07.577930 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-798e0675-0841-4e14-9dd1-7b454db679ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1305 microversion: 2.1 time: 0.140650 Mar 29 03:48:07.578491 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3504/7238] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:07 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:08.595526 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:08.596070 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:08.603428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:08.603879 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:08.604643 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:08.605097 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:09.051678 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:09.061236 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-58921129-b24a-49bd-b9e5-24a1571ba2f0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.469333 Mar 29 03:48:09.061932 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3735/7239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:08 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:09.374698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-aad2f6a3-1266-4d7e-b2c9-333a0fb0def1 req-74e10a5f-cefd-4691-8ceb-d6bf20823702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:48:09.377387 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:48:09.377387 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:48:09.387472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aad2f6a3-1266-4d7e-b2c9-333a0fb0def1 req-74e10a5f-cefd-4691-8ceb-d6bf20823702 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:09.387856 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-aad2f6a3-1266-4d7e-b2c9-333a0fb0def1 req-74e10a5f-cefd-4691-8ceb-d6bf20823702 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:09.404523 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-aad2f6a3-1266-4d7e-b2c9-333a0fb0def1 req-74e10a5f-cefd-4691-8ceb-d6bf20823702 service nova] Creating event network-changed:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:48:09.409523 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-aad2f6a3-1266-4d7e-b2c9-333a0fb0def1 req-74e10a5f-cefd-4691-8ceb-d6bf20823702 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039167 Mar 29 03:48:09.410370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3505/7240] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:48:10.077505 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:10.078124 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:10.085550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:10.085992 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:10.086752 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:10.087180 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:10.422444 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:10.430534 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-c1feaa87-004c-494d-b3c3-cbc143cfe368 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.356805 Mar 29 03:48:10.431090 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3736/7241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:10 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:11.447818 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:11.448591 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:11.455991 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:11.456442 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:11.457257 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:11.457695 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:11.662370 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:11.671208 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-f6ea297b-dd27-4051-be24-48eef432fcbd tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.227533 Mar 29 03:48:11.671786 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3506/7242] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:11 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:12.132345 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:48:12.132589 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:48:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:48:12.688890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:12.689667 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:12.697325 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:12.697773 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:12.698580 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:12.699038 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:12.895081 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:12.903088 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-e76a8892-1c8d-4d9b-9473-5fa33af7b5c0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.218004 Mar 29 03:48:12.903648 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3737/7243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:12 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:13.919919 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:13.920535 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:13.927946 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:13.928401 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:13.929203 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:13.929645 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:14.128136 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:14.136181 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-60de5f7c-524f-4c98-be20-fe352e729a0c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.220255 Mar 29 03:48:14.136725 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3507/7244] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:13 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:15.154241 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:15.154859 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:15.163017 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:15.163502 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:15.164305 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:15.164739 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:15.363408 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:15.371512 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-2db251fb-9965-4098-91ea-978c7f632c44 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.221730 Mar 29 03:48:15.372070 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3738/7245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:15 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:16.347781 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-ee5d3e09-37aa-46eb-a935-2437ea747caf req-d7059376-6678-4881-89fc-b97f0b3f5cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "name": "network-vif-plugged", "status": "completed", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:48:16.349341 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:48:16.349341 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:48:16.358167 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ee5d3e09-37aa-46eb-a935-2437ea747caf req-d7059376-6678-4881-89fc-b97f0b3f5cab service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:16.358684 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-ee5d3e09-37aa-46eb-a935-2437ea747caf req-d7059376-6678-4881-89fc-b97f0b3f5cab service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:16.374303 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-ee5d3e09-37aa-46eb-a935-2437ea747caf req-d7059376-6678-4881-89fc-b97f0b3f5cab service nova] Creating event network-vif-plugged:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:48:16.379185 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-ee5d3e09-37aa-46eb-a935-2437ea747caf req-d7059376-6678-4881-89fc-b97f0b3f5cab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086703 Mar 29 03:48:16.380827 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3508/7246] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:48:16.389230 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:16.390389 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:16.402428 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:16.404510 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:16.404855 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:16.405485 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:16.660515 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:16.669778 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acf7a7c6-b7c5-497b-812d-e593c7ab495d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.285540 Mar 29 03:48:16.670331 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3739/7247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:16 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:17.687489 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:17.688211 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:17.695721 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:17.696179 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:17.696976 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:17.697423 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:17.900103 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:17.908756 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-b9743e5d-43fd-4ec5-80a9-679b04eaf2da tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1373 microversion: 2.1 time: 0.226079 Mar 29 03:48:17.909363 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3509/7248] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:17 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1373 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:18.926498 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:18.927110 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:18.935346 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:18.935764 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:18.936529 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:18.936997 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:19.131666 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:19.139757 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-4c4c3a50-fd51-416b-915f-948b7dd9f2ff tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1558 microversion: 2.1 time: 0.216997 Mar 29 03:48:19.140325 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3740/7249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:18 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:19.155388 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:48:19.156011 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:48:19.163240 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:19.163696 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:19.164472 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:19.164945 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:19.359175 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:48:19.367341 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-35d35f7f-ec6d-4094-9cdf-d42db24c70e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1558 microversion: 2.1 time: 0.215614 Mar 29 03:48:19.367900 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3510/7250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:48:19 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:48:22.242554 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-ad76c1bb-e93f-4fbf-b791-d4245fa33ab9 req-adff7055-b786-4292-ab6c-1475535bef2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:48:22.244129 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:48:22.244129 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:48:22.252286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ad76c1bb-e93f-4fbf-b791-d4245fa33ab9 req-adff7055-b786-4292-ab6c-1475535bef2d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:48:22.252726 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-ad76c1bb-e93f-4fbf-b791-d4245fa33ab9 req-adff7055-b786-4292-ab6c-1475535bef2d service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:48:22.268978 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-ad76c1bb-e93f-4fbf-b791-d4245fa33ab9 req-adff7055-b786-4292-ab6c-1475535bef2d service nova] Creating event network-changed:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:48:22.274210 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-ad76c1bb-e93f-4fbf-b791-d4245fa33ab9 req-adff7055-b786-4292-ab6c-1475535bef2d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089444 Mar 29 03:48:22.274875 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3741/7251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:49:50.801320 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:49:50.801929 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:50:45.331595 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-757424863"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:50:45.332627 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:50:45.339875 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:50:45.340331 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:50:45.341130 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:50:45.341569 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:50:46.035184 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-20192022-6edf-42d9-8df9-771c7e123fbb tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "POST /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.708256 Mar 29 03:50:46.035872 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3511/7252] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:50:45 2022] POST /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 03:50:52.950114 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:50:52.951153 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:50:52.955663 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-e4d44e44-3975-42df-a98b-36586042c878 req-1fc8846a-0f49-4d00-9867-5d2bf96e0deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "name": "network-vif-plugged", "status": "completed", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:50:52.957198 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:50:52.957198 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:50:52.966082 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e4d44e44-3975-42df-a98b-36586042c878 req-1fc8846a-0f49-4d00-9867-5d2bf96e0deb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:50:52.966519 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-e4d44e44-3975-42df-a98b-36586042c878 req-1fc8846a-0f49-4d00-9867-5d2bf96e0deb service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:50:52.981664 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-e4d44e44-3975-42df-a98b-36586042c878 req-1fc8846a-0f49-4d00-9867-5d2bf96e0deb service nova] Creating event network-vif-plugged:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:50:52.986730 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-e4d44e44-3975-42df-a98b-36586042c878 req-1fc8846a-0f49-4d00-9867-5d2bf96e0deb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037903 Mar 29 03:50:52.987294 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3742/7253] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:51:05.930143 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:51:05.933900 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-517014799", "imageRef": "71a3d5bb-78db-425e-8763-329d43e2f77f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-521762493", "security_groups": [{"name": "tempest-secgroup-smoke-1545934968"}], "networks": [{"uuid": "ea9a7298-04de-4ea9-8c95-2e27b70a32b1"}]}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:51:05.944595 n-d-828148-1 devstack@n-api.service[103514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] AMQP server on 10.222.0.36:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Mar 29 03:51:06.047548 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.network.neutron [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] validate_networks() for [('ea9a7298-04de-4ea9-8c95-2e27b70a32b1', None, None, None)] {{(pid=103514) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} Mar 29 03:51:06.731749 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Flavor limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 29 03:51:06.732186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Image limits 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 29 03:51:06.732674 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Flavor pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 29 03:51:06.733134 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Image pref 0:0:0 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 29 03:51:06.733566 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.virt.hardware [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=103514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 29 03:51:06.742392 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:06.742872 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:06.743673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:06.744196 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:06.761673 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for project f404dfee81704a668826802b21e932f1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:387}} Mar 29 03:51:06.766798 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.quota [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Getting quotas for user 7f108782939c41cebf3fa8d28f84cb04 and project f404dfee81704a668826802b21e932f1. Resources: {'cores', 'ram', 'instances'} {{(pid=103514) _get_quotas /opt/stack/nova/nova/quota.py:377}} Mar 29 03:51:06.778312 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Going to run 1 instances... {{(pid=103514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Mar 29 03:51:06.780766 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='71a3d5bb-78db-425e-8763-329d43e2f77f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=103514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Mar 29 03:51:06.916151 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c010ce3f-697c-491e-888d-f959bd8c95f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987192 Mar 29 03:51:06.916794 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3512/7254] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Mar 29 03:51:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 29 03:51:06.928537 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ec31d44-a34a-436b-a6a1-dffc6cfe6b56 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:06.929264 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ec31d44-a34a-436b-a6a1-dffc6cfe6b56 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:06.949930 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34228. Mar 29 03:51:06.955201 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34226. Mar 29 03:51:07.073790 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-7ec31d44-a34a-436b-a6a1-dffc6cfe6b56 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:07.084620 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ec31d44-a34a-436b-a6a1-dffc6cfe6b56 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1247 microversion: 2.1 time: 0.161091 Mar 29 03:51:07.085215 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3743/7255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:06 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1247 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:08.103728 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:08.104349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:08.115384 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:08.115844 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:08.116615 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:08.117086 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:08.118214 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [1861630e-c0ba-4222-8f68-de478a3fefd5] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34242. Mar 29 03:51:08.151072 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] [49d85493-8779-4304-b068-4840389a639b] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34244. Mar 29 03:51:08.230809 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:08.239718 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-0e34bd85-a0ef-4c57-803b-8402207df04c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1243 microversion: 2.1 time: 0.142213 Mar 29 03:51:08.242997 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3513/7256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:08 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1243 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:08.977550 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-4553b2d9-9690-42bb-9abe-6d9860306ba2 req-768a6e10-576d-4c07-ad97-3f71e1c5a295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "name": "network-vif-unplugged", "status": "completed", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:51:08.979391 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:51:08.979391 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:51:08.990280 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4553b2d9-9690-42bb-9abe-6d9860306ba2 req-768a6e10-576d-4c07-ad97-3f71e1c5a295 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:08.990852 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-4553b2d9-9690-42bb-9abe-6d9860306ba2 req-768a6e10-576d-4c07-ad97-3f71e1c5a295 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:09.008650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-4553b2d9-9690-42bb-9abe-6d9860306ba2 req-768a6e10-576d-4c07-ad97-3f71e1c5a295 service nova] Creating event network-vif-unplugged:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:51:09.012650 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-4553b2d9-9690-42bb-9abe-6d9860306ba2 req-768a6e10-576d-4c07-ad97-3f71e1c5a295 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041281 Mar 29 03:51:09.013297 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3744/7257] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:51:09.257223 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:09.257866 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:09.265533 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:09.265997 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:09.267278 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:09.267720 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:09.389504 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:09.398489 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-05551172-0039-4146-b1f8-d38f71e8dbc1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1305 microversion: 2.1 time: 0.145678 Mar 29 03:51:09.399540 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3514/7258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:09 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:10.415647 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:10.416456 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:10.424817 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:10.425630 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:10.426775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:10.427468 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:10.766486 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:10.778348 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-5a969505-0630-4968-87f1-8e4e2658c9cf tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.366858 Mar 29 03:51:10.786446 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3745/7259] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:10 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:11.799300 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:11.800698 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:11.810317 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:11.811093 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:11.812346 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:11.813177 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:12.037860 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:12.046853 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7a1a41aa-9a75-4841-b7ef-e439cf0fe010 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.252672 Mar 29 03:51:12.047468 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3515/7260] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:11 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:13.064059 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:13.064694 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:13.072354 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:13.072800 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:13.073619 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:13.074045 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:13.278129 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:13.287033 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-75884e8c-f4dc-4386-9c6c-9c31a8ab4b4e tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.227366 Mar 29 03:51:13.287735 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3746/7261] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:13 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:14.304057 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:14.304657 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:14.312114 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:14.312583 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:14.314084 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:14.314584 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:14.578778 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:14.586987 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-2a943b78-22fa-4114-88b6-f940cb8e6f6d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.286550 Mar 29 03:51:14.587741 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3516/7262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:14 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:15.604347 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:15.606136 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:15.616055 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:15.616507 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:15.617465 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:15.618317 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:15.882925 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:15.891850 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-30c0654f-edf3-4b31-a159-0c7ce9ca0da1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.292078 Mar 29 03:51:15.892614 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3747/7263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:15 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:51:16.909164 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:16.909743 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:16.917604 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:16.919450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:16.919450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:16.919450 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:17.132186 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:17.141654 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-4df8353a-94a5-4023-9cf5-e0dd337396de tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.236733 Mar 29 03:51:17.152126 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3517/7264] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:16 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:18.159134 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:18.159775 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:18.168098 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:18.173229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:18.173229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:18.173229 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:18.526103 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:18.534699 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a409aa03-a6c2-4370-8531-4e7a38bae632 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.380534 Mar 29 03:51:18.535262 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3748/7265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:18 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:19.379245 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-b1f8a09e-a37a-4395-979e-a92e0335f412 req-f85da8b4-e827-4547-9913-e83b35cffc2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:51:19.381070 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:51:19.381070 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:51:19.390188 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1f8a09e-a37a-4395-979e-a92e0335f412 req-f85da8b4-e827-4547-9913-e83b35cffc2a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:19.390683 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-b1f8a09e-a37a-4395-979e-a92e0335f412 req-f85da8b4-e827-4547-9913-e83b35cffc2a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:19.408539 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-b1f8a09e-a37a-4395-979e-a92e0335f412 req-f85da8b4-e827-4547-9913-e83b35cffc2a service nova] Creating event network-changed:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:51:19.414328 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-b1f8a09e-a37a-4395-979e-a92e0335f412 req-f85da8b4-e827-4547-9913-e83b35cffc2a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039894 Mar 29 03:51:19.418374 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3518/7266] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:51:19.553298 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:19.554352 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:19.562178 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:19.562713 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:19.563995 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:19.564599 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:19.983861 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:19.991807 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-eb9584dc-dad4-4692-976a-8c01c7e462f1 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.443427 Mar 29 03:51:19.992377 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3749/7267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:19 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:21.010722 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:21.011343 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:21.018882 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:21.019339 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:21.020119 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:21.020562 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:21.217254 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:21.225331 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7efca75a-ff86-4f3e-b669-c6f294841f22 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.218891 Mar 29 03:51:21.225892 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3519/7268] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:21 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:22.242532 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:22.243085 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:22.250903 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:22.251348 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:22.252106 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:22.252535 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:22.447365 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:22.456152 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-bb49264e-2162-4dca-a424-95939ae831c6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.217443 Mar 29 03:51:22.456702 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3750/7269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:22 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:23.473373 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:23.473990 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:23.481410 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:23.481868 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:23.482633 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:23.483077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:23.675932 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:23.684694 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7891b339-dfeb-46e6-aee2-2d36c334029b tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.215542 Mar 29 03:51:23.685520 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3520/7270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:23 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:24.702633 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:24.703872 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:24.711252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:24.711705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:24.712480 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:24.712942 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:24.909324 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:24.917883 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-46ccece7-f877-484e-8798-e9ee46e1fa45 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.219013 Mar 29 03:51:24.918445 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3751/7271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:24 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:25.918689 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-8c729d21-38ea-4158-a3c9-80f2081d5a43 req-0efa9f66-aa6a-4c08-96f6-05d5b3b1cf97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "name": "network-vif-plugged", "status": "completed", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:51:25.924090 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:51:25.924090 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:51:25.929029 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c729d21-38ea-4158-a3c9-80f2081d5a43 req-0efa9f66-aa6a-4c08-96f6-05d5b3b1cf97 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:25.929488 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-8c729d21-38ea-4158-a3c9-80f2081d5a43 req-0efa9f66-aa6a-4c08-96f6-05d5b3b1cf97 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:25.934746 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:25.935387 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:25.942766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:25.943216 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:25.943991 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:25.944414 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:25.945484 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-8c729d21-38ea-4158-a3c9-80f2081d5a43 req-0efa9f66-aa6a-4c08-96f6-05d5b3b1cf97 service nova] Creating event network-vif-plugged:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:51:25.950434 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-8c729d21-38ea-4158-a3c9-80f2081d5a43 req-0efa9f66-aa6a-4c08-96f6-05d5b3b1cf97 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035546 Mar 29 03:51:25.951197 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3521/7272] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:51:26.234143 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:26.242219 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-89417562-2c15-42ec-8a68-e0f9fa012d63 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.311691 Mar 29 03:51:26.242754 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3752/7273] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:25 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 29 03:51:27.258754 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:27.259518 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:27.267077 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:27.267537 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:27.268316 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:27.268783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:27.473224 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:27.481480 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-7e028bd1-99d8-44f7-aa80-7bb263740849 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1373 microversion: 2.1 time: 0.226818 Mar 29 03:51:27.482045 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3522/7274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:27 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1373 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:28.498583 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:28.499194 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:28.507093 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:28.507533 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:28.508286 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:28.508707 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:28.707890 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:28.716080 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d083582e-726d-403e-a755-38d587e4e096 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1558 microversion: 2.1 time: 0.221214 Mar 29 03:51:28.716696 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3753/7275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:28 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:28.731829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:51:28.732443 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:51:28.740100 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:28.740552 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:28.741347 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:28.741783 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:28.936563 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:51:28.944766 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-969a7064-245a-4178-b31d-0421180c7c5c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1558 microversion: 2.1 time: 0.216496 Mar 29 03:51:28.945370 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3523/7276] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:51:28 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:51:31.705453 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-324531be-cddd-4048-afa1-e8ebc5dcd8e5 req-b3cc7f84-de72-4b31-82fd-3763a01ea478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:51:31.706995 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:51:31.706995 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:51:31.715278 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-324531be-cddd-4048-afa1-e8ebc5dcd8e5 req-b3cc7f84-de72-4b31-82fd-3763a01ea478 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:51:31.715714 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-324531be-cddd-4048-afa1-e8ebc5dcd8e5 req-b3cc7f84-de72-4b31-82fd-3763a01ea478 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:51:31.731384 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-324531be-cddd-4048-afa1-e8ebc5dcd8e5 req-b3cc7f84-de72-4b31-82fd-3763a01ea478 service nova] Creating event network-changed:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:51:31.736810 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-324531be-cddd-4048-afa1-e8ebc5dcd8e5 req-b3cc7f84-de72-4b31-82fd-3763a01ea478 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035618 Mar 29 03:51:31.737592 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3754/7277] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:02.864365 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-789322949"}} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:02.865411 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:02.872491 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:02.872989 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:02.882863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:02.882863 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:03.430609 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d9b5d43a-0f87-47df-bd39-c91fce0eb6b0 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "POST /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3/action" status: 202 len: 0 microversion: 2.1 time: 0.613160 Mar 29 03:53:03.431248 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3524/7278] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Mar 29 03:53:02 2022] POST /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Mar 29 03:53:09.812944 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:53:09.812944 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:53:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:53:10.447460 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-2afdd607-ea78-40e8-991c-f5e5311d6cb3 req-5ff18797-cbea-4e87-87f0-ec1a6e85d464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "name": "network-vif-plugged", "status": "completed", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:10.449071 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:10.449071 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:53:10.452982 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:53:10.453749 n-d-828148-1 devstack@n-api.service[103513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 29 03:53:10.459615 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2afdd607-ea78-40e8-991c-f5e5311d6cb3 req-5ff18797-cbea-4e87-87f0-ec1a6e85d464 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:10.466072 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-2afdd607-ea78-40e8-991c-f5e5311d6cb3 req-5ff18797-cbea-4e87-87f0-ec1a6e85d464 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:10.479253 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-2afdd607-ea78-40e8-991c-f5e5311d6cb3 req-5ff18797-cbea-4e87-87f0-ec1a6e85d464 service nova] Creating event network-vif-plugged:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:53:10.484408 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-2afdd607-ea78-40e8-991c-f5e5311d6cb3 req-5ff18797-cbea-4e87-87f0-ec1a6e85d464 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043500 Mar 29 03:53:10.485021 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3755/7279] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:10.809825 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:53:10.810031 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:53:12.143305 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:53:12.143919 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:53:12.274591 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:53:12.275050 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:53:19.592916 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:19.593786 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [req-f89bc0cd-c997-4d54-8f11-f5c1e53f56dd req-93dcb725-06d3-4269-966e-1af4347f1f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:19.594248 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:19.595546 n-d-828148-1 devstack@n-api.service[103513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:19.595546 n-d-828148-1 devstack@n-api.service[103513]: warnings.warn(msg) Mar 29 03:53:19.606245 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f89bc0cd-c997-4d54-8f11-f5c1e53f56dd req-93dcb725-06d3-4269-966e-1af4347f1f4f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:19.606768 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [req-f89bc0cd-c997-4d54-8f11-f5c1e53f56dd req-93dcb725-06d3-4269-966e-1af4347f1f4f service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:19.606881 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:19.607887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:19.608311 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:19.608887 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:19.624292 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d085484-2bf2-4ed6-aaab-c32cf64e3f01] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34532. Mar 29 03:53:19.627086 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] [3afca0fb-eea5-4f9a-8e14-c20a4c2c7cf1] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 34534. Mar 29 03:53:19.627301 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.compute.server_external_events [req-f89bc0cd-c997-4d54-8f11-f5c1e53f56dd req-93dcb725-06d3-4269-966e-1af4347f1f4f service nova] Creating event network-changed:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:53:19.632760 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [req-f89bc0cd-c997-4d54-8f11-f5c1e53f56dd req-93dcb725-06d3-4269-966e-1af4347f1f4f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045324 Mar 29 03:53:19.633790 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3756/7280] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:19.686795 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Going to try to terminate instance {{(pid=103514) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:53:20.013613 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-d2063907-fb4a-4fd8-9fb1-ac23396ae5a5 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "DELETE /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 204 len: 0 microversion: 2.1 time: 0.428088 Mar 29 03:53:20.014198 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3525/7281] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:53:19 2022] DELETE /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:53:20.024048 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:20.024767 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:20.032614 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:20.033421 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:20.034252 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:20.034905 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:20.480236 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-1578c34b-a6c0-4971-828e-cc6978aeca06 req-b5b5a4dc-b8e5-4c84-86db-2f933ee11238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "name": "network-vif-unplugged", "status": "completed", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:20.481812 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:20.481812 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:53:20.490184 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1578c34b-a6c0-4971-828e-cc6978aeca06 req-b5b5a4dc-b8e5-4c84-86db-2f933ee11238 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:20.490715 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-1578c34b-a6c0-4971-828e-cc6978aeca06 req-b5b5a4dc-b8e5-4c84-86db-2f933ee11238 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:20.492125 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:53:20.501785 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-acf0bc66-9153-445f-ad4d-677efd4702e6 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1682 microversion: 2.1 time: 0.482609 Mar 29 03:53:20.512211 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3757/7282] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:20 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1682 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:53:20.512377 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-1578c34b-a6c0-4971-828e-cc6978aeca06 req-b5b5a4dc-b8e5-4c84-86db-2f933ee11238 service nova] Creating event network-vif-unplugged:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:53:20.514418 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-1578c34b-a6c0-4971-828e-cc6978aeca06 req-b5b5a4dc-b8e5-4c84-86db-2f933ee11238 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101285 Mar 29 03:53:20.515317 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3526/7283] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 29 03:53:21.519092 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:21.520247 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:21.527705 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:21.528154 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:21.536144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:21.536144 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:21.932625 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:53:21.940831 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-a5f330e6-f662-44c3-90f3-15f42956d017 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1564 microversion: 2.1 time: 0.425467 Mar 29 03:53:21.941919 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3758/7284] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:21 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1564 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:53:22.564140 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-9e99b3f3-158b-4da6-9e58-0de85a4ecb8a req-c684dfaf-08aa-41e2-85b7-5704f0aebe57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3", "name": "network-vif-deleted", "tag": "9747a412-79b1-4e58-957d-c8da1e2e3072"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:22.565616 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:22.565616 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:53:22.575349 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9e99b3f3-158b-4da6-9e58-0de85a4ecb8a req-c684dfaf-08aa-41e2-85b7-5704f0aebe57 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:22.575829 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-9e99b3f3-158b-4da6-9e58-0de85a4ecb8a req-c684dfaf-08aa-41e2-85b7-5704f0aebe57 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:22.595339 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-9e99b3f3-158b-4da6-9e58-0de85a4ecb8a req-c684dfaf-08aa-41e2-85b7-5704f0aebe57 service nova] Creating event network-vif-deleted:9747a412-79b1-4e58-957d-c8da1e2e3072 for instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 on n-h2-828148-1 Mar 29 03:53:22.600084 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-9e99b3f3-158b-4da6-9e58-0de85a4ecb8a req-c684dfaf-08aa-41e2-85b7-5704f0aebe57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089864 Mar 29 03:53:22.600664 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3527/7285] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:22.958445 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:22.958985 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:22.966546 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:22.966987 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:22.967743 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:22.968170 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:23.036727 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:23.037114 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:23.037560 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.objects.instance [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lazy-loading 'fault' on Instance uuid 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 {{(pid=103513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Mar 29 03:53:23.160145 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:53:23.168277 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-716287fc-9be1-45db-8231-cf08a443205c tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 200 len: 1337 microversion: 2.1 time: 0.213626 Mar 29 03:53:23.168921 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3759/7286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:22 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 1337 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:53:24.186807 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:24.187521 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:24.195161 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:24.195619 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:24.196407 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:24.196864 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:24.246077 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.wsgi [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] HTTP exception thrown: Instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 could not be found. Mar 29 03:53:24.246678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Returning 404 to user: Instance 2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 could not be found. {{(pid=103514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:53:24.247498 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e899cab0-f76c-44e5-bc45-450e05d4da46 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3" status: 404 len: 111 microversion: 2.1 time: 0.065015 Mar 29 03:53:24.248035 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3528/7287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:24 2022] GET /compute/v2.1/servers/2f9f07ca-ee58-4f60-bd8c-36bf3ec0b5a3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:53:27.158250 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:27.158738 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:27.160771 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-12c27d10-a0c3-4ce3-9be0-1467283d65ea req-1a374e6b-1ffa-4c11-8324-5767e16986f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:27.163267 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:27.163267 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:53:27.166926 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:27.167372 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:27.168300 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:27.168744 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:27.174195 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-12c27d10-a0c3-4ce3-9be0-1467283d65ea req-1a374e6b-1ffa-4c11-8324-5767e16986f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:27.174658 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-12c27d10-a0c3-4ce3-9be0-1467283d65ea req-1a374e6b-1ffa-4c11-8324-5767e16986f8 service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:27.192334 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-12c27d10-a0c3-4ce3-9be0-1467283d65ea req-1a374e6b-1ffa-4c11-8324-5767e16986f8 service nova] Creating event network-changed:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:53:27.197533 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-12c27d10-a0c3-4ce3-9be0-1467283d65ea req-1a374e6b-1ffa-4c11-8324-5767e16986f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 Mar 29 03:53:27.200453 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3529/7288] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:27.230710 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Going to try to terminate instance {{(pid=103513) delete /opt/stack/nova/nova/compute/api.py:2562}} Mar 29 03:53:27.538745 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-7ed56459-33ed-499e-857a-1abe2a4330ed tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 204 len: 0 microversion: 2.1 time: 0.383485 Mar 29 03:53:27.540389 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3760/7289] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Mar 29 03:53:27 2022] DELETE /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 29 03:53:27.552052 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:27.552806 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.compute.api [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103514) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:27.560699 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:27.564125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:27.564125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:27.564125 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:27.879741 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.policy [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103514) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:53:27.890012 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-c20edc16-632f-4bb9-94ad-594993bc16a8 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1683 microversion: 2.1 time: 0.345194 Mar 29 03:53:27.890938 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3530/7290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:27 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1683 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:53:28.909684 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:28.910413 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:28.922524 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:28.922979 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:28.923766 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:28.924204 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:29.200703 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.policy [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f108782939c41cebf3fa8d28f84cb04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f404dfee81704a668826802b21e932f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=103513) authorize /opt/stack/nova/nova/policy.py:199}} Mar 29 03:53:29.209288 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-3d08cf07-b34b-4760-9836-feaf9910576d tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 200 len: 1564 microversion: 2.1 time: 0.303794 Mar 29 03:53:29.212979 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3761/7291] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:28 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 1564 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 29 03:53:29.337597 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [req-be7cb5c5-f46c-414d-902e-32cb5ebe51ed req-f740e753-1101-4820-a961-f8931183338a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29993b7-d7b0-49ad-8b9a-a424fb67f5dc", "name": "network-vif-deleted", "tag": "d5d15c4a-a30d-4f26-b934-2a4cb175d007"}]} {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 29 03:53:29.339257 n-d-828148-1 devstack@n-api.service[103514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 29 03:53:29.339257 n-d-828148-1 devstack@n-api.service[103514]: warnings.warn(msg) Mar 29 03:53:29.347678 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-be7cb5c5-f46c-414d-902e-32cb5ebe51ed req-f740e753-1101-4820-a961-f8931183338a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:29.348127 n-d-828148-1 devstack@n-api.service[103514]: DEBUG oslo_concurrency.lockutils [req-be7cb5c5-f46c-414d-902e-32cb5ebe51ed req-f740e753-1101-4820-a961-f8931183338a service nova] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:29.364021 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.compute.server_external_events [req-be7cb5c5-f46c-414d-902e-32cb5ebe51ed req-f740e753-1101-4820-a961-f8931183338a service nova] Creating event network-vif-deleted:d5d15c4a-a30d-4f26-b934-2a4cb175d007 for instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc on n-h1-828148-1 Mar 29 03:53:29.369443 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [req-be7cb5c5-f46c-414d-902e-32cb5ebe51ed req-f740e753-1101-4820-a961-f8931183338a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035507 Mar 29 03:53:29.370010 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3531/7292] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Mar 29 03:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 29 03:53:30.227046 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '>' {{(pid=103513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:30.227720 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.compute.api [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] [instance: c29993b7-d7b0-49ad-8b9a-a424fb67f5dc] Fetching instance by UUID {{(pid=103513) get /opt/stack/nova/nova/compute/api.py:2813}} Mar 29 03:53:30.235217 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:30.235669 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:30.236442 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Mar 29 03:53:30.236892 n-d-828148-1 devstack@n-api.service[103513]: DEBUG oslo_concurrency.lockutils [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Lock "465b9be6-8890-42cd-be93-13bd5816ef58" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Mar 29 03:53:30.286422 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.wsgi [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] HTTP exception thrown: Instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc could not be found. Mar 29 03:53:30.287029 n-d-828148-1 devstack@n-api.service[103513]: DEBUG nova.api.openstack.wsgi [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Returning 404 to user: Instance c29993b7-d7b0-49ad-8b9a-a424fb67f5dc could not be found. {{(pid=103513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Mar 29 03:53:30.287999 n-d-828148-1 devstack@n-api.service[103513]: INFO nova.api.openstack.requestlog [None req-d331978f-668a-475e-847e-7c00a998fe76 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc" status: 404 len: 111 microversion: 2.1 time: 0.065241 Mar 29 03:53:30.288549 n-d-828148-1 devstack@n-api.service[103513]: [pid: 103513|app: 0|req: 3762/7293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Mar 29 03:53:30 2022] GET /compute/v2.1/servers/c29993b7-d7b0-49ad-8b9a-a424fb67f5dc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 29 03:53:30.649225 n-d-828148-1 devstack@n-api.service[103514]: DEBUG nova.api.openstack.wsgi [None req-e4cd2191-8615-4469-bd13-d586ff439d42 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] Calling method '.version_select at 0x7f8717c56ca0>' {{(pid=103514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 29 03:53:30.739709 n-d-828148-1 devstack@n-api.service[103514]: INFO nova.api.openstack.requestlog [None req-e4cd2191-8615-4469-bd13-d586ff439d42 tempest-TestSnapshotPattern-1775989018 tempest-TestSnapshotPattern-1775989018-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-521762493" status: 202 len: 0 microversion: 2.1 time: 0.094656 Mar 29 03:53:30.740323 n-d-828148-1 devstack@n-api.service[103514]: [pid: 103514|app: 0|req: 3532/7294] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Mar 29 03:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-521762493 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 29 03:56:29.827322 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:56:29.827807 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:56:30.818251 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:56:30.818423 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:56:32.152164 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:56:32.152693 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:56:32.283677 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:56:32.283807 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:56:43.475412 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:56:43.476007 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:58:38.369306 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:58:38.369882 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:59:49.835528 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:59:49.836080 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:59:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:59:50.826396 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:59:50.826534 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 03:59:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:59:52.160639 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:59:52.161125 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 03:59:52.290721 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 03:59:52.290843 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 03:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 04:00:03.484900 n-d-828148-1 devstack@n-api.service[103514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 04:00:03.485591 n-d-828148-1 devstack@n-api.service[103514]: Tue Mar 29 04:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 29 04:01:58.378702 n-d-828148-1 devstack@n-api.service[103513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 29 04:01:58.379291 n-d-828148-1 devstack@n-api.service[103513]: Tue Mar 29 04:01:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!